[02:20:07] + ulimit -n 512
[02:20:07] + LOCKFILE=/var/lock/scap.operations_mediawiki-config.lock
[02:20:07] + '[' -O /var/lock/scap.operations_mediawiki-config.lock ']'
[02:20:07] + /usr/bin/scap version
[02:20:08] 4.287.0
[02:20:08] + /usr/bin/scap prep auto
[02:20:09] 02:20:09 Started scap prep auto
[02:20:09] 02:20:09 Update https://gerrit.wikimedia.org/r/operations/mediawiki-config (master branch) in /srv/mediawiki-staging
[02:20:09] 02:20:09 https://gerrit.wikimedia.org/r/operations/mediawiki-config checked out at commit 368a1f04cc064d6d248f7dadf9fcc47ae3c51a4c
[02:20:10] 02:20:10 Update https://gerrit.wikimedia.org/r/mediawiki/core (master branch) in /srv/mediawiki-staging/php-master
[02:20:11] 02:20:11 https://gerrit.wikimedia.org/r/mediawiki/core checked out at commit eb2c0acaeeb2135c7a6e2952b536f0deb3343ba2
[02:20:11] 02:20:11 Update https://gerrit.wikimedia.org/r/mediawiki/extensions (master branch) in /srv/mediawiki-staging/php-master/extensions
[02:20:12] 02:20:12 https://gerrit.wikimedia.org/r/mediawiki/extensions checked out at commit 1aee6274ae54de55cb6fde1e832858de5aa84157
[02:22:11] 02:22:11 Update https://gerrit.wikimedia.org/r/mediawiki/vendor (master branch) in /srv/mediawiki-staging/php-master/vendor
[02:22:11] 02:22:11 https://gerrit.wikimedia.org/r/mediawiki/vendor checked out at commit 8cb7395acace2d2826c90d0267feda80de741407
[02:22:12] 02:22:12 Update https://gerrit.wikimedia.org/r/mediawiki/skins (master branch) in /srv/mediawiki-staging/php-master/skins
[02:22:12] 02:22:12 https://gerrit.wikimedia.org/r/mediawiki/skins checked out at commit e6f509716284156be1ad25cc1b1c4ae33ae51fcc
[02:22:18] 02:22:18 MediaWiki master successfully checked out.
[02:22:18] 02:22:18 Finished scap prep auto (duration: 02m 09s)
[02:22:19] + /usr/bin/scap sync-world 'wmf-beta-update-all run'
[02:22:20]            ___ ____
[02:22:20]          ⎛   ⎛ ,----
[02:22:20]           \  //==--'
[02:22:20]      _//|,.·//==--'    ____________________________
[02:22:20]     _OO≣=-  ︶ ᴹw ⎞_§ ______  ___\ ___\ ,\__ \/ __ \
[02:22:20]    (∞)_, )  (     |  ______/__  \/ /__ / /_/ / /_/ /
[02:22:20]      ¨--¨|| |- (  / ______\____/ \___/ \__^_/  .__/
[02:22:20]          ««_/  «_/ jgs/bd808                /_/
[02:22:20] 
[02:22:20] 02:22:20 Started scap sync-world: wmf-beta-update-all run
[02:22:24] 02:22:24 Started cache_git_info
[02:22:51] 02:22:51 Finished cache_git_info (duration: 00m 26s)
[02:22:51] 02:22:51 Started l10n-update
[02:22:55] 02:22:55 Updating ExtensionMessages-master.php
[02:23:05] 02:23:05 Updating LocalisationCache for master using 6 thread(s)
[02:23:05] 02:23:05 Running rebuildLocalisationCache.php (cdb)
[02:23:09] 02:23:09 0 languages rebuilt out of 549
[02:23:09] 02:23:09 Use --force to rebuild the caches which are still fresh.
[02:23:12] 02:23:12 Running rebuildLocalisationCache.php (php)
[02:23:15] 02:23:15 0 languages rebuilt out of 549
[02:23:15] 02:23:15 Use --force to rebuild the caches which are still fresh.
[02:23:18] 02:23:18 Generating JSON versions and md5 files (as www-data)
[02:23:21] 02:23:21 Finished l10n-update (duration: 00m 30s)
[02:23:21] 02:23:21 Checking for new runtime errors locally
[02:23:24] 02:23:24 Started sync-canaries
[02:23:24] 02:23:24 sync-canaries:   0% (ok: 0; fail: 0; left: 2)                          
[02:23:25] 02:23:25 ['/usr/bin/scap', 'pull', '--no-php-restart', '--no-update-l10n', '--exclude-wikiversions.php', 'deployment-deploy04.deployment-prep.eqiad1.wikimedia.cloud', 'deployment-deploy04.deployment-prep.eqiad1.wikimedia.cloud'] (ran as mwdeploy@deployment-mediawiki14.deployment-prep.eqiad1.wikimedia.cloud) returned [255]: mwdeploy@deployment-mediawiki14.deployment-prep.eqiad1.wikimedia.cloud: Permission denied (publickey).
[02:23:25] 
[02:23:30] 02:23:30 sync-canaries: 100% (in-flight: 0; ok: 1; fail: 1; left: 0)            
[02:23:30] 02:23:30 Per-host sync duration: average 2.9s, median 2.9s
[02:23:30] 02:23:30 rsync transfer: average 220421 bytes/host, total 440843 bytes
[02:23:30] 02:23:30 1 canaries had sync errors
[02:23:30] 02:23:30 Started scap-cdb-rebuild-canaries
[02:23:30] 02:23:30 scap-cdb-rebuild:   0% (ok: 0; fail: 0; left: 2)                       
[02:23:32] 02:23:32 scap-cdb-rebuild: 100% (in-flight: 0; ok: 2; fail: 0; left: 0)         
[02:23:32] 02:23:32 Finished scap-cdb-rebuild-canaries (duration: 00m 02s)
[02:23:32] 02:23:32 Started sync-wikiversions-canaries
[02:23:32] 02:23:32 sync-wikiversions:   0% (ok: 0; fail: 0; left: 2)                      
[02:23:33] 02:23:33 sync-wikiversions: 100% (in-flight: 0; ok: 2; fail: 0; left: 0)        
[02:23:33] 02:23:33 Finished sync-wikiversions-canaries (duration: 00m 00s)
[02:23:33] 02:23:33 Started php-fpm-restarts-canaries
[02:23:33] 02:23:33 Running '/usr/local/sbin/restart-php-fpm-all' on 2 host(s)
[02:23:33] 02:23:33 php-fpm-restart:   0% (ok: 0; fail: 0; left: 0)                        
[02:23:35] 02:23:35 php-fpm-restart: 100% (in-flight: 0; ok: 2; fail: 0; left: 0)          
[02:23:35] 02:23:35 Finished php-fpm-restarts-canaries (duration: 00m 01s)
[02:23:35] 02:23:35 Finished sync-canaries (duration: 00m 10s)
[02:23:35] 02:23:35 Waiting 20 seconds for canary traffic...
[02:23:55] 02:23:55 Logstash checker counted 0 error(s) in the last 20 seconds. OK.
[02:23:55] 02:23:55 Started sync-apaches
[02:23:55] 02:23:55 sync-apaches:   0% (ok: 0; fail: 0; left: 6)                           
[02:24:01] 02:24:01 sync-apaches: 100% (in-flight: 0; ok: 6; fail: 0; left: 0)             
[02:24:01] 02:24:01 Per-host sync duration: average 5.7s, median 5.9s
[02:24:01] 02:24:01 rsync transfer: average 440843 bytes/host, total 2645058 bytes
[02:24:01] 02:24:01 Finished sync-apaches (duration: 00m 06s)
[02:24:01] 02:24:01 Waiting 20 seconds for production traffic...
[02:24:21] 02:24:21 Logstash checker counted 0 error(s) in the last 20 seconds. OK.
[02:24:21] 02:24:21 Started scap-cdb-rebuild-prod
[02:24:21] 02:24:21 scap-cdb-rebuild:   0% (ok: 0; fail: 0; left: 8)                       
[02:24:23] 02:24:23 scap-cdb-rebuild: 100% (in-flight: 0; ok: 8; fail: 0; left: 0)         
[02:24:23] 02:24:23 Finished scap-cdb-rebuild-prod (duration: 00m 02s)
[02:24:23] 02:24:23 Started sync-wikiversions-prod
[02:24:23] 02:24:23 sync-wikiversions:   0% (ok: 0; fail: 0; left: 8)                      
[02:24:24] 02:24:24 sync-wikiversions: 100% (in-flight: 0; ok: 8; fail: 0; left: 0)        
[02:24:24] 02:24:24 Finished sync-wikiversions-prod (duration: 00m 00s)
[02:24:24] 02:24:24 Started php-fpm-restarts-prod
[02:24:24] 02:24:24 Running '/usr/local/sbin/restart-php-fpm-all' on 5 host(s)
[02:24:24] 02:24:24 php-fpm-restart:   0% (ok: 0; fail: 0; left: 0)                        
[02:24:28] 02:24:28 php-fpm-restart: 100% (in-flight: 0; ok: 5; fail: 0; left: 0)          
[02:24:28] 02:24:28 Finished php-fpm-restarts-prod (duration: 00m 03s)
[02:24:28] 02:24:28 Running purgeMessageBlobStore.php
[02:24:30] 02:24:30 Finished scap sync-world: wmf-beta-update-all run (duration: 02m 10s)
[02:24:30]