ZuulTag
ActivePublic
Watch Project

Members (3)

Paladox (Paladox)
User
hashar (Antoine Musso)
Logistics
greg (Greg Grossmeier)
Director of Engineering
View All

Watchers (1)

hashar (Antoine Musso)
Logistics
View All

Details

Description

Zuul is a python daemon which acts as a gateway between Gerrit and Jenkins. It listens to Gerrit stream-events feed and trigger jobs function registered by Jenkins using the Jenkins Gearman plugin. The jobs triggering specification is written in YAML and hosted in the git repository integration/config.git as /zuul/layout.yaml.

https://www.mediawiki.org/wiki/Continuous_integration/Zuul

Note: This Phabricator project is about Zuul from an infrastructure perspective (e.g. Upgrading Zuul, its integration with Gerrit and Jenkins etc.). It is merely a tag and all tasks should be also be tagged with Continuous-Integration-Infrastructure

Recent Activity
View All

Oct 11 2024

Maintenance_bot removed a project from T252310: pywikibot get merge rejections due to zuul-merger not being able to update tags: Patch-For-Review.

Oct 11 2024, 9:30 AM · Release-Engineering-Team (CI & Testing services), Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), Zuul, Regression, Continuous-Integration-Infrastructure, Pywikibot

Jun 25 2024

hashar changed the status of T231913: zuul promote broken: Exception: Unable to find shared change queue for 534195,1 from Resolved to Declined.

That is still a thing:

zuul.rpcclient.RPCFailure: Traceback (most recent call last):
  File "/srv/deployment/zuul/venv/lib/python2.7/site-packages/zuul/rpclistener.py", line 76, in run
    f(job)
  File "/srv/deployment/zuul/venv/lib/python2.7/site-packages/zuul/rpclistener.py", line 146, in handle_promote
    self.sched.promote(pipeline_name, change_ids)
  File "/srv/deployment/zuul/venv/lib/python2.7/site-packages/zuul/scheduler.py", line 725, in promote
    event.wait()
  File "/srv/deployment/zuul/venv/lib/python2.7/site-packages/zuul/scheduler.py", line 141, in wait
    six.reraise(*self._exc_info)
  File "/srv/deployment/zuul/venv/lib/python2.7/site-packages/zuul/scheduler.py", line 1056, in process_management_queue
    self._doPromoteEvent(event)
  File "/srv/deployment/zuul/venv/lib/python2.7/site-packages/zuul/scheduler.py", line 908, in _doPromoteEvent
    event.change_ids[0])
Exception: Unable to find shared change queue for 1049510,2

Jun 25 2024, 2:35 PM · Release-Engineering-Team, Continuous-Integration-Infrastructure, Zuul

Jun 21 2024

hashar closed T204125: Run less tests when a patch is in WIP mode in Gerrit as Declined.

Jun 21 2024, 3:46 PM · Upstream, Zuul, Continuous-Integration-Infrastructure, User-Addshore

Jun 18 2024

Stashbot added a comment to T157818: zuul-merger fails when repository names overlaps.

Mentioned in SAL (#wikimedia-releng) [2024-06-18T10:36:28Z] <hashar> contint1002: deleted /srv/zuul/git/operations/software/homer/deploy and /srv/zuul/git/operations/software/homer for topranks due to zuul-merger bug T157818

Jun 18 2024, 10:36 AM · Zuul, Continuous-Integration-Infrastructure

May 17 2024

hashar closed T259611: The python-build images regenerate wheels even when matching ones are already available, a subtask of T258630: Improve scheduling of CI jobs invoked by zuul , as Resolved.

May 17 2024, 3:20 PM · Patch-For-Review, Release-Engineering-Team (Doing), Upstream, Continuous-Integration-Infrastructure, Zuul, User-dancy

hashar closed T259611: The python-build images regenerate wheels even when matching ones are already available, a subtask of T342346: Refresh integration/zuul/deploy to work on Debian Bullseye, as Resolved.

May 17 2024, 3:20 PM · Patch-For-Review, Release-Engineering-Team (Priority Backlog 📥), Zuul, Continuous-Integration-Infrastructure

Stashbot added a comment to T157818: zuul-merger fails when repository names overlaps.

Mentioned in SAL (#wikimedia-releng) [2024-05-17T07:48:11Z] <hashar> zuul: deleted /srv/zuul/git/operations/software due to namespace clash | T157818

May 17 2024, 7:48 AM · Zuul, Continuous-Integration-Infrastructure

May 15 2024

gerritbot added a comment to T361224: Test zuul under Bullseye with contint1003.

Change #1015332 abandoned by Hashar:

[test/gerrit-ping@master] For testing Zuul under Bullseye

Reason:

https://gerrit.wikimedia.org/r/1015332

May 15 2024, 9:57 AM · Patch-For-Review, Continuous-Integration-Infrastructure, Zuul, Release-Engineering-Team (Radar), collaboration-services

Apr 24 2024

Dreamy_Jazz added a comment to T229708: Jenkins 'test' pipeline should cancel old jobs after new patch sets.

Another example where the failure for the first patchset occurred after the third had been uploaded for at least 7 or so minutes: https://gerrit.wikimedia.org/r/c/mediawiki/extensions/CheckUser/+/1023890/3

Apr 24 2024, 5:01 PM · Release-Engineering-Team (Seen), Continuous-Integration-Infrastructure, Zuul

Apr 18 2024

gerritbot added a comment to T361224: Test zuul under Bullseye with contint1003.

Change #1015332 restored by Hashar:

[test/gerrit-ping@master] For testing Zuul under Bullseye

https://gerrit.wikimedia.org/r/1015332

Apr 18 2024, 8:16 PM · Patch-For-Review, Continuous-Integration-Infrastructure, Zuul, Release-Engineering-Team (Radar), collaboration-services

gerritbot added a comment to T361224: Test zuul under Bullseye with contint1003.

Change #1015332 abandoned by Hashar:

[test/gerrit-ping@master] For testing Zuul under Bullseye

Reason:

https://gerrit.wikimedia.org/r/1015332

Apr 18 2024, 8:16 PM · Patch-For-Review, Continuous-Integration-Infrastructure, Zuul, Release-Engineering-Team (Radar), collaboration-services

gerritbot added a comment to T361224: Test zuul under Bullseye with contint1003.

Change #1015332 restored by Hashar:

[test/gerrit-ping@master] For testing Zuul under Bullseye

https://gerrit.wikimedia.org/r/1015332

Apr 18 2024, 8:12 PM · Patch-For-Review, Continuous-Integration-Infrastructure, Zuul, Release-Engineering-Team (Radar), collaboration-services

Apr 17 2024

Dzahn added a parent task for T157818: zuul-merger fails when repository names overlaps: T334517: upgrade contint servers to bullseye.

Apr 17 2024, 9:08 PM · Zuul, Continuous-Integration-Infrastructure

Apr 16 2024

Dzahn added a parent task for T361224: Test zuul under Bullseye with contint1003: T358237: Ganeti VM for contint migration.

Apr 16 2024, 7:51 PM · Patch-For-Review, Continuous-Integration-Infrastructure, Zuul, Release-Engineering-Team (Radar), collaboration-services

gerritbot added a comment to T342346: Refresh integration/zuul/deploy to work on Debian Bullseye.

Change #1020329 merged by Dzahn:

[operations/puppet@production] zuul: require python2.7

https://gerrit.wikimedia.org/r/1020329

Apr 16 2024, 7:46 PM · Patch-For-Review, Release-Engineering-Team (Priority Backlog 📥), Zuul, Continuous-Integration-Infrastructure

gerritbot added a comment to T342346: Refresh integration/zuul/deploy to work on Debian Bullseye.

Change #1020329 restored by Hashar:

[operations/puppet@production] zuul: require python2.7

https://gerrit.wikimedia.org/r/1020329

Apr 16 2024, 7:35 PM · Patch-For-Review, Release-Engineering-Team (Priority Backlog 📥), Zuul, Continuous-Integration-Infrastructure

gerritbot added a comment to T342346: Refresh integration/zuul/deploy to work on Debian Bullseye.

Change #1020329 abandoned by Hashar:

[operations/puppet@production] zuul: require python2.7

Reason:

The issue lies in modules/base/manifests/standard_packages.pp which removes the python package but never reinstall them when the feature `remove_python2_on_bullseye` is flipped to `true`.

https://gerrit.wikimedia.org/r/1020329

Apr 16 2024, 7:30 PM · Patch-For-Review, Release-Engineering-Team (Priority Backlog 📥), Zuul, Continuous-Integration-Infrastructure

gerritbot added a comment to T342346: Refresh integration/zuul/deploy to work on Debian Bullseye.

Change #1020329 had a related patch set uploaded (by Hashar; author: Hashar):

[operations/puppet@production] zuul: require python2.7

https://gerrit.wikimedia.org/r/1020329

Apr 16 2024, 7:27 PM · Patch-For-Review, Release-Engineering-Team (Priority Backlog 📥), Zuul, Continuous-Integration-Infrastructure

hashar closed T361224: Test zuul under Bullseye with contint1003 as Resolved.

I have done the basic testing and Zuul seems to have been working on contint1003 which is Bullseye based. We can keep the instance around for some weeks in case something is broken, that might be handy.

Apr 16 2024, 7:46 AM · Patch-For-Review, Continuous-Integration-Infrastructure, Zuul, Release-Engineering-Team (Radar), collaboration-services

Apr 15 2024

hashar added a comment to T229708: Jenkins 'test' pipeline should cancel old jobs after new patch sets.

@Dreamy_Jazz awesome! Everything ends up easier when there is a very recent case since that means we still have the debug logs from Zuul. So here we go.

Apr 15 2024, 7:43 PM · Release-Engineering-Team (Seen), Continuous-Integration-Infrastructure, Zuul

Dreamy_Jazz reopened T229708: Jenkins 'test' pipeline should cancel old jobs after new patch sets as "Open".

Marking this as open again because I have an example of this.

Apr 15 2024, 6:17 PM · Release-Engineering-Team (Seen), Continuous-Integration-Infrastructure, Zuul

Dreamy_Jazz added a comment to T229708: Jenkins 'test' pipeline should cancel old jobs after new patch sets.

@hashar Example: https://gerrit.wikimedia.org/r/c/mediawiki/extensions/CheckUser/+/1018767

Apr 15 2024, 6:15 PM · Release-Engineering-Team (Seen), Continuous-Integration-Infrastructure, Zuul

Apr 11 2024

Stashbot added a comment to T361224: Test zuul under Bullseye with contint1003.

Mentioned in SAL (#wikimedia-cloud) [2024-04-11T19:03:05Z] <mutante> - deleting instance contint-bullseye which was only used by me for a test before we created contint1003 in prod T334517 T361224

Apr 11 2024, 7:03 PM · Patch-For-Review, Continuous-Integration-Infrastructure, Zuul, Release-Engineering-Team (Radar), collaboration-services

Apr 8 2024

LSobanski moved T361224: Test zuul under Bullseye with contint1003 from Incoming to Consultation on the collaboration-services board.

Apr 8 2024, 3:23 PM · Patch-For-Review, Continuous-Integration-Infrastructure, Zuul, Release-Engineering-Team (Radar), collaboration-services

Mar 30 2024

Dreamy_Jazz added a comment to T229708: Jenkins 'test' pipeline should cancel old jobs after new patch sets.

I've seen this happening for CheckUser recently.

Mar 30 2024, 12:35 PM · Release-Engineering-Team (Seen), Continuous-Integration-Infrastructure, Zuul

Mar 29 2024

gerritbot added a comment to T361224: Test zuul under Bullseye with contint1003.

Change #1015332 abandoned by Hashar:

[test/gerrit-ping@master] For testing Zuul under Bullseye

Reason:

https://gerrit.wikimedia.org/r/1015332

Mar 29 2024, 6:04 PM · Patch-For-Review, Continuous-Integration-Infrastructure, Zuul, Release-Engineering-Team (Radar), collaboration-services

hashar closed T222645: Add two more zuul-merger process as Declined.

We are back on SSD now and the merger are faster as a result. If we'd want to add some more (which would be nice) we can always reopen this task or create a new one.

Mar 29 2024, 3:15 PM · Sustainability (Incident Followup), Zuul, Continuous-Integration-Infrastructure

hashar closed T222645: Add two more zuul-merger process, a subtask of T187897: fatal: remote error: access denied or repository not exported: /mediawiki/extensions/ReadingLists, as Declined.

Mar 29 2024, 3:14 PM · Release-Engineering-Team (Seen), Zuul, ci-test-error (WMF-deployed Build Failure), Continuous-Integration-Infrastructure

hashar closed T65744: Zuul: Implement support for customizing status_url to include the change.id as Declined.

Mar 29 2024, 3:10 PM · Release-Engineering-Team (Seen), Zuul, Upstream, Continuous-Integration-Infrastructure

hashar closed T65744: Zuul: Implement support for customizing status_url to include the change.id, a subtask of T65399: Zuul: Highlight relevant change on Zuul status page when following submit pipeline url, as Declined.

Mar 29 2024, 3:10 PM · Zuul, Continuous-Integration-Infrastructure

hashar closed T229708: Jenkins 'test' pipeline should cancel old jobs after new patch sets as Declined.

Declining since we could not reproduce the issue.

Mar 29 2024, 3:09 PM · Release-Engineering-Team (Seen), Continuous-Integration-Infrastructure, Zuul

hashar closed T103528: Run zuul-clear-refs.py daily on all our repositories to reclaim Zuul references as Declined.

Mar 29 2024, 3:08 PM · Zuul, Continuous-Integration-Infrastructure

hashar closed T103528: Run zuul-clear-refs.py daily on all our repositories to reclaim Zuul references, a subtask of T70481: Zuul repositories have too many refs causing slow updates, as Declined.

Mar 29 2024, 3:08 PM · Zuul, Upstream, Continuous-Integration-Infrastructure

hashar closed T248531: Abort a Zuul pipeline when one job completed with failures (change zuul scheduler's failure check from areAllJobsComplete to didAnyJobFail) as Declined.

Mar 29 2024, 3:06 PM · Upstream, Release-Engineering-Team (Seen), Developer Productivity, Zuul, Continuous-Integration-Infrastructure

hashar closed T187897: fatal: remote error: access denied or repository not exported: /mediawiki/extensions/ReadingLists as Resolved.

daemon.c

static int daemon_error(const char *dir, const char *msg)
{
        if (!informative_errors)
                msg = "access denied or repository not exported";
        packet_write_fmt(1, "ERR %s: %s", msg, dir);
        return -1;
}