[03:54:54] + ulimit -n 512 [03:54:54] + LOCKFILE=/var/lock/scap.operations_mediawiki-config.lock [03:54:54] + '[' -O /var/lock/scap.operations_mediawiki-config.lock ']' [03:54:54] + /usr/bin/scap version [03:54:55] 4.261.0 [03:54:55] + /usr/bin/scap prep auto [03:54:56] 03:54:56 Started scap prep auto [03:54:56] 03:54:56 Update https://gerrit.wikimedia.org/r/operations/mediawiki-config (master branch) in /srv/mediawiki-staging [03:54:57] 03:54:57 https://gerrit.wikimedia.org/r/operations/mediawiki-config checked out at commit ee3d1b814a5c342eae33f6c35ab49ccc1bbfcc6e [03:54:57] 03:54:57 Update https://gerrit.wikimedia.org/r/mediawiki/core (master branch) in /srv/mediawiki-staging/php-master [03:54:58] 03:54:58 https://gerrit.wikimedia.org/r/mediawiki/core checked out at commit 9d3c32015830144dcf98560e8faa3a4de1a7cdf6 [03:54:58] 03:54:58 Update https://gerrit.wikimedia.org/r/mediawiki/extensions (master branch) in /srv/mediawiki-staging/php-master/extensions [03:54:59] 03:54:59 https://gerrit.wikimedia.org/r/mediawiki/extensions checked out at commit 376e119e6448ce764c9a32644a72ad19aa15bfca [03:57:02] 03:57:02 Update https://gerrit.wikimedia.org/r/mediawiki/vendor (master branch) in /srv/mediawiki-staging/php-master/vendor [03:57:03] 03:57:03 https://gerrit.wikimedia.org/r/mediawiki/vendor checked out at commit be635f69a64e93fb8f72d5addb9505cf03cf1343 [03:57:03] 03:57:03 Update https://gerrit.wikimedia.org/r/mediawiki/skins (master branch) in /srv/mediawiki-staging/php-master/skins [03:57:04] 03:57:04 https://gerrit.wikimedia.org/r/mediawiki/skins checked out at commit 7f745baeabb3eacbe21043b6fa94aa1b0b92ec86 [03:57:11] 03:57:11 MediaWiki master successfully checked out. [03:57:11] 03:57:11 Finished scap prep auto (duration: 02m 14s) [03:57:11] + /usr/bin/scap sync-world 'wmf-beta-update-all run' [03:57:12] ___ ____ [03:57:12] ⎛ ⎛ ,---- [03:57:12] \ //==--' [03:57:12] _//|,.·//==--' ____________________________ [03:57:12] _OO≣=- ︶ ᴹw ⎞_§ ______ ___\ ___\ ,\__ \/ __ \ [03:57:12] (∞)_, ) ( | ______/__ \/ /__ / /_/ / /_/ / [03:57:12] ¨--¨|| |- ( / ______\____/ \___/ \__^_/ .__/ [03:57:12] ««_/ «_/ jgs/bd808 /_/ [03:57:12] [03:57:12] 03:57:12 Started scap sync-world: wmf-beta-update-all run [03:57:19] 03:57:19 Started cache_git_info [03:57:43] 03:57:43 Finished cache_git_info (duration: 00m 24s) [03:57:43] 03:57:43 Started l10n-update [03:57:52] 03:57:52 Updating ExtensionMessages-master.php [03:58:05] 03:58:05 Updating LocalisationCache for master using 2 thread(s) [03:58:05] 03:58:05 Running rebuildLocalisationCache.php (cdb) [03:58:11] 03:58:11 0 languages rebuilt out of 549 [03:58:11] 03:58:11 Use --force to rebuild the caches which are still fresh. [03:58:14] 03:58:14 Running rebuildLocalisationCache.php (php) [03:58:20] 03:58:20 0 languages rebuilt out of 549 [03:58:20] 03:58:20 Use --force to rebuild the caches which are still fresh. [03:58:23] 03:58:23 Generating JSON versions and md5 files (as www-data) [03:58:30] 03:58:30 Finished l10n-update (duration: 00m 47s) [03:58:30] 03:58:30 Checking for new runtime errors locally [03:58:36] 03:58:36 Started sync-canaries [03:58:36] 03:58:36 sync-canaries: 0% (ok: 0; fail: 0; left: 1) [03:58:42] 03:58:42 sync-canaries: 100% (in-flight: 0; ok: 1; fail: 0; left: 0) [03:58:42] 03:58:42 Per-host sync duration: average 6.7s, median 6.7s [03:58:42] 03:58:42 rsync transfer: average 418475 bytes/host, total 418475 bytes [03:58:42] 03:58:42 Started scap-cdb-rebuild-canaries [03:58:42] 03:58:42 scap-cdb-rebuild: 0% (ok: 0; fail: 0; left: 1) [03:58:44] 03:58:44 scap-cdb-rebuild: 100% (in-flight: 0; ok: 1; fail: 0; left: 0) [03:58:44] 03:58:44 Finished scap-cdb-rebuild-canaries (duration: 00m 01s) [03:58:44] 03:58:44 Started sync-wikiversions-canaries [03:58:44] 03:58:44 sync-wikiversions: 0% (ok: 0; fail: 0; left: 1) [03:58:45] 03:58:45 sync-wikiversions: 100% (in-flight: 0; ok: 1; fail: 0; left: 0) [03:58:45] 03:58:45 Finished sync-wikiversions-canaries (duration: 00m 00s) [03:58:45] 03:58:45 Started php-fpm-restarts-canaries [03:58:45] 03:58:45 Running '/usr/local/sbin/restart-php-fpm-all' on 1 host(s) [03:58:45] 03:58:45 php-fpm-restart: 0% (ok: 0; fail: 0; left: 0) [03:58:46] 03:58:46 php-fpm-restart: 100% (in-flight: 0; ok: 1; fail: 0; left: 0) [03:58:46] 03:58:46 Finished php-fpm-restarts-canaries (duration: 00m 00s) [03:58:46] 03:58:46 Finished sync-canaries (duration: 00m 10s) [03:58:46] 03:58:46 Waiting 20 seconds for canary traffic... [03:59:06] 03:59:06 Logstash checker counted 0 error(s) in the last 20 seconds. OK. [03:59:06] 03:59:06 Started sync-apaches [03:59:06] 03:59:06 sync-apaches: 0% (ok: 0; fail: 0; left: 3) [03:59:17] 03:59:17 sync-apaches: 100% (in-flight: 0; ok: 3; fail: 0; left: 0) [03:59:17] 03:59:17 Per-host sync duration: average 8.1s, median 6.6s [03:59:17] 03:59:17 rsync transfer: average 418475 bytes/host, total 1255425 bytes [03:59:17] 03:59:17 Finished sync-apaches (duration: 00m 11s) [03:59:17] 03:59:17 Waiting 20 seconds for production traffic... [03:59:37] 03:59:37 Logstash checker counted 25 error(s) in the last 20 seconds. OK. [03:59:37] 03:59:37 Started scap-cdb-rebuild-prod [03:59:37] 03:59:37 scap-cdb-rebuild: 0% (ok: 0; fail: 0; left: 4) [03:59:39] 03:59:39 scap-cdb-rebuild: 100% (in-flight: 0; ok: 4; fail: 0; left: 0) [03:59:39] 03:59:39 Finished scap-cdb-rebuild-prod (duration: 00m 02s) [03:59:39] 03:59:39 Started sync-wikiversions-prod [03:59:39] 03:59:39 sync-wikiversions: 0% (ok: 0; fail: 0; left: 4) [03:59:40] 03:59:40 sync-wikiversions: 100% (in-flight: 0; ok: 4; fail: 0; left: 0) [03:59:40] 03:59:40 Finished sync-wikiversions-prod (duration: 00m 00s) [03:59:40] 03:59:40 Started php-fpm-restarts-prod [03:59:40] 03:59:40 Running '/usr/local/sbin/restart-php-fpm-all' on 2 host(s) [03:59:40] 03:59:40 php-fpm-restart: 0% (ok: 0; fail: 0; left: 0) [03:59:42] 03:59:42 php-fpm-restart: 100% (in-flight: 0; ok: 2; fail: 0; left: 0) [03:59:42] 03:59:42 Finished php-fpm-restarts-prod (duration: 00m 01s) [03:59:42] 03:59:42 Running purgeMessageBlobStore.php [03:59:44] 03:59:44 Finished scap sync-world: wmf-beta-update-all run (duration: 02m 32s) [03:59:45] + /usr/local/bin/wmf-beta-update-databases.py