[06:13:56.744] New invocation is queued and will start shortly
[06:13:57.926] Starting the invocation (attempt 1)
[06:13:57.965] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a702f824bd1e6f591f112f5ed53192d78ee765ac"
[06:13:57.965] Popped gitiles commit info from properties and tags
[06:13:57.965] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[06:13:57.972] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[06:13:57.972] Buildbucket request:
{
"requestId": "8998305645701740256",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a702f824bd1e6f591f112f5ed53192d78ee765ac",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8998305645701740256"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[06:13:58.638] Scheduled build:
{
"id": "8832875583548259921",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 25722,
"createdBy": "project:chromium",
"createTime": "2021-10-20T06:13:58.166778320Z",
"updateTime": "2021-10-20T06:13:58.432908967Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a702f824bd1e6f591f112f5ed53192d78ee765ac",
"ref": "refs/heads/main"
}
},
"canary": true
}
[06:13:58.638] Task URL: https://cr-buildbucket.appspot.com/build/8832875583548259921
[06:13:58.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:2:0) after 3m9s
[06:17:07.666] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:2:0)
[06:17:07.864] Build status: SCHEDULED
[06:17:07.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:3:0) after 8m7s
[06:19:52.172] Received PubSub notification, asking Buildbucket for the build status
[06:19:52.203] Build status: STARTED
[06:25:14.968] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:3:0)
[06:25:14.996] Build status: STARTED
[06:25:14.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:5:0) after 5m52s
[06:31:07.131] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:5:0)
[06:31:07.160] Build status: STARTED
[06:31:07.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:6:0) after 6m38s
[06:37:45.135] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:6:0)
[06:37:45.174] Build status: STARTED
[06:37:45.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:7:0) after 5m57s
[06:43:42.481] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:7:0)
[06:43:42.514] Build status: STARTED
[06:43:42.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:8:0) after 5m34s
[06:49:16.616] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:8:0)
[06:49:16.649] Build status: STARTED
[06:49:16.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:9:0) after 6m3s
[06:55:19.691] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:9:0)
[06:55:19.717] Build status: STARTED
[06:55:19.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:10:0) after 8m56s
[07:04:15.740] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:10:0)
[07:04:15.769] Build status: STARTED
[07:04:15.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:11:0) after 1m31s
[07:05:46.880] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:11:0)
[07:05:46.916] Build status: STARTED
[07:05:46.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:12:0) after 5m26s
[07:11:13.009] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:12:0)
[07:11:13.041] Build status: STARTED
[07:11:13.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:13:0) after 3m1s
[07:14:14.067] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:13:0)
[07:14:14.098] Build status: STARTED
[07:14:14.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:14:0) after 3m54s
[07:18:08.128] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:14:0)
[07:18:08.181] Build status: STARTED
[07:18:08.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:15:0) after 2m54s
[07:21:02.300] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:15:0)
[07:21:02.333] Build status: STARTED
[07:21:02.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:16:0) after 3m13s
[07:24:15.358] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:16:0)
[07:24:15.512] Build status: STARTED
[07:24:15.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:17:0) after 6m41s
[07:30:56.540] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:17:0)
[07:30:56.581] Build status: STARTED
[07:30:56.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:18:0) after 7m52s
[07:38:48.609] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:18:0)
[07:38:48.645] Build status: STARTED
[07:38:48.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:19:0) after 5m50s
[07:44:38.824] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:19:0)
[07:44:38.855] Build status: STARTED
[07:44:38.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:20:0) after 8m52s
[07:53:30.886] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:20:0)
[07:53:30.920] Build status: STARTED
[07:53:30.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:21:0) after 4m15s
[07:57:46.032] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:21:0)
[07:57:46.083] Build status: STARTED
[07:57:46.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:22:0) after 4m42s
[08:02:28.195] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:22:0)
[08:02:28.224] Build status: STARTED
[08:02:28.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:23:0) after 1m58s
[08:04:26.530] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:23:0)
[08:04:26.559] Build status: STARTED
[08:04:26.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:24:0) after 1m32s
[08:05:58.586] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:24:0)
[08:05:58.622] Build status: STARTED
[08:05:58.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:25:0) after 3m6s
[08:09:04.954] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:25:0)
[08:09:04.986] Build status: STARTED
[08:09:04.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:26:0) after 3m57s
[08:13:01.989] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:26:0)
[08:13:02.058] Build status: STARTED
[08:13:02.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:27:0) after 1m15s
[08:14:17.081] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:27:0)
[08:14:17.111] Build status: STARTED
[08:14:17.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:28:0) after 9m1s
[08:23:18.134] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:28:0)
[08:23:18.164] Build status: STARTED
[08:23:18.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:29:0) after 1m15s
[08:24:33.190] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:29:0)
[08:24:33.218] Build status: STARTED
[08:24:33.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:30:0) after 9m38s
[08:34:11.441] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:30:0)
[08:34:11.467] Build status: STARTED
[08:34:11.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:31:0) after 2m6s
[08:36:17.879] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:31:0)
[08:36:17.950] Build status: STARTED
[08:36:17.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:32:0) after 9m46s
[08:46:04.011] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:32:0)
[08:46:04.039] Build status: STARTED
[08:46:04.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:33:0) after 6m29s
[08:52:33.179] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:33:0)
[08:52:33.249] Build status: STARTED
[08:52:33.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:34:0) after 9m45s
[09:02:18.276] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:34:0)
[09:02:18.310] Build status: STARTED
[09:02:18.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:35:0) after 1m33s
[09:03:51.336] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:35:0)
[09:03:51.613] Build status: STARTED
[09:03:51.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:36:0) after 6m37s
[09:10:28.645] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:36:0)
[09:10:28.674] Build status: STARTED
[09:10:28.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:37:0) after 6m41s
[09:17:09.700] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:37:0)
[09:17:10.029] Build status: STARTED
[09:17:10.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:38:0) after 2m34s
[09:19:44.062] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:38:0)
[09:19:44.100] Build status: STARTED
[09:19:44.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:39:0) after 7m8s
[09:26:52.191] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:39:0)
[09:26:52.219] Build status: STARTED
[09:26:52.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:40:0) after 8m10s
[09:35:02.254] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:40:0)
[09:35:02.382] Build status: STARTED
[09:35:02.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:41:0) after 1m49s
[09:36:51.414] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:41:0)
[09:36:51.441] Build status: STARTED
[09:36:51.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:42:0) after 3m45s
[09:40:36.668] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:42:0)
[09:40:36.702] Build status: STARTED
[09:40:36.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:43:0) after 1m45s
[09:42:21.727] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:43:0)
[09:42:21.756] Build status: STARTED
[09:42:21.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:44:0) after 8m24s
[09:50:45.780] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:44:0)
[09:50:45.816] Build status: STARTED
[09:50:45.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:45:0) after 7m36s
[09:58:21.906] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:45:0)
[09:58:21.945] Build status: STARTED
[09:58:21.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:46:0) after 3m41s
[10:02:03.000] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:46:0)
[10:02:03.060] Build status: STARTED
[10:02:03.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:47:0) after 3m29s
[10:05:32.082] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:47:0)
[10:05:32.178] Build status: STARTED
[10:05:32.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:48:0) after 9m20s
[10:14:52.209] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:48:0)
[10:14:52.239] Build status: STARTED
[10:14:52.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:49:0) after 4m21s
[10:19:13.325] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:49:0)
[10:19:13.357] Build status: STARTED
[10:19:13.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:50:0) after 8m3s
[10:27:16.392] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:50:0)
[10:27:16.420] Build status: STARTED
[10:27:16.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:51:0) after 1m34s
[10:28:50.529] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:51:0)
[10:28:50.557] Build status: STARTED
[10:28:50.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:52:0) after 6m32s
[10:35:22.623] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:52:0)
[10:35:22.707] Build status: STARTED
[10:35:22.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:53:0) after 1m27s
[10:36:50.244] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:53:0)
[10:36:50.290] Build status: STARTED
[10:36:50.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:54:0) after 5m56s
[10:42:46.487] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:54:0)
[10:42:46.514] Build status: STARTED
[10:42:46.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:55:0) after 8m46s
[10:51:32.584] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:55:0)
[10:51:32.611] Build status: STARTED
[10:51:32.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:56:0) after 4m52s
[10:56:24.635] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:56:0)
[10:56:24.665] Build status: STARTED
[10:56:24.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:57:0) after 1m5s
[10:57:29.697] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:57:0)
[10:57:29.731] Build status: STARTED
[10:57:29.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:58:0) after 5m59s
[11:03:28.986] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:58:0)
[11:03:29.027] Build status: STARTED
[11:03:29.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:59:0) after 6m4s
[11:09:33.281] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:59:0)
[11:09:33.329] Build status: STARTED
[11:09:33.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:60:0) after 3m30s
[11:13:03.414] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:60:0)
[11:13:03.445] Build status: STARTED
[11:13:03.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:61:0) after 3m46s
[11:16:49.699] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:61:0)
[11:16:49.733] Build status: STARTED
[11:16:49.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:62:0) after 2m43s
[11:19:32.810] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:62:0)
[11:19:32.840] Build status: STARTED
[11:19:32.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:63:0) after 1m15s
[11:20:47.897] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:63:0)
[11:20:47.927] Build status: STARTED
[11:20:47.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:64:0) after 5m3s
[11:25:51.022] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:64:0)
[11:25:51.051] Build status: STARTED
[11:25:51.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:65:0) after 5m49s
[11:31:40.216] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:65:0)
[11:31:40.264] Build status: STARTED
[11:31:40.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:66:0) after 9m27s
[11:41:07.304] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:66:0)
[11:41:07.330] Build status: STARTED
[11:41:07.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:67:0) after 9m17s
[11:50:24.362] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:67:0)
[11:50:24.395] Build status: STARTED
[11:50:24.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:68:0) after 1m48s
[11:52:12.430] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:68:0)
[11:52:12.462] Build status: STARTED
[11:52:12.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:69:0) after 3m50s
[11:56:02.789] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:69:0)
[11:56:02.827] Build status: STARTED
[11:56:02.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:70:0) after 2m6s
[11:58:08.862] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:70:0)
[11:58:09.007] Build status: STARTED
[11:58:09.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:71:0) after 4m25s
[12:02:34.109] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:71:0)
[12:02:34.138] Build status: STARTED
[12:02:34.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:72:0) after 8m30s
[12:11:04.774] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:72:0)
[12:11:04.801] Build status: STARTED
[12:11:04.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:73:0) after 2m34s
[12:13:38.852] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:73:0)
[12:13:38.980] Build status: STARTED
[12:13:38.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:74:0) after 5m32s
[12:19:11.116] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:74:0)
[12:19:11.152] Build status: STARTED
[12:19:11.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:75:0) after 8m38s
[12:27:49.254] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:75:0)
[12:27:49.281] Build status: STARTED
[12:27:49.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:76:0) after 8m11s
[12:36:00.308] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:76:0)
[12:36:00.339] Build status: STARTED
[12:36:00.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:77:0) after 3m49s
[12:39:49.533] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:77:0)
[12:39:49.560] Build status: STARTED
[12:39:49.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:78:0) after 7m31s
[12:47:20.758] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:78:0)
[12:47:20.789] Build status: STARTED
[12:47:20.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:79:0) after 6m27s
[12:53:47.908] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:79:0)
[12:53:47.934] Build status: STARTED
[12:53:47.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:80:0) after 6m24s
[13:00:12.099] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:80:0)
[13:00:12.128] Build status: STARTED
[13:00:12.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:81:0) after 1m58s
[13:02:10.186] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:81:0)
[13:02:10.259] Build status: STARTED
[13:02:10.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:82:0) after 5m6s
[13:07:16.390] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:82:0)
[13:07:16.425] Build status: STARTED
[13:07:16.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:83:0) after 2m54s
[13:10:10.629] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:83:0)
[13:10:10.658] Build status: STARTED
[13:10:10.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:84:0) after 5m14s
[13:15:24.803] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:84:0)
[13:15:24.857] Build status: STARTED
[13:15:24.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:85:0) after 1m33s
[13:16:57.964] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:85:0)
[13:16:57.994] Build status: STARTED
[13:16:57.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:86:0) after 2m55s
[13:19:53.167] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:86:0)
[13:19:53.212] Build status: STARTED
[13:19:53.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:87:0) after 4m38s
[13:24:31.265] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:87:0)
[13:24:31.294] Build status: STARTED
[13:24:31.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:88:0) after 8m49s
[13:33:20.331] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:88:0)
[13:33:20.364] Build status: STARTED
[13:33:20.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:89:0) after 6m36s
[13:39:56.394] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:89:0)
[13:39:56.457] Build status: STARTED
[13:39:56.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:90:0) after 6m31s
[13:46:27.514] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:90:0)
[13:46:27.542] Build status: STARTED
[13:46:27.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:91:0) after 1m35s
[13:48:02.743] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:91:0)
[13:48:02.781] Build status: STARTED
[13:48:02.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:92:0) after 8m25s
[13:56:27.826] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:92:0)
[13:56:27.865] Build status: STARTED
[13:56:27.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:93:0) after 5m29s
[14:01:56.895] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:93:0)
[14:01:56.923] Build status: STARTED
[14:01:56.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:94:0) after 4m57s
[14:06:53.947] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:94:0)
[14:06:53.978] Build status: STARTED
[14:06:53.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:95:0) after 3m1s
[14:09:55.006] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:95:0)
[14:09:55.037] Build status: STARTED
[14:09:55.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:96:0) after 8m3s
[14:17:58.066] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:96:0)
[14:17:58.101] Build status: STARTED
[14:17:58.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:97:0) after 5m17s
[14:23:15.232] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:97:0)
[14:23:15.264] Build status: STARTED
[14:23:15.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:98:0) after 7m53s
[14:31:08.313] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:98:0)
[14:31:08.343] Build status: STARTED
[14:31:08.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:99:0) after 1m13s
[14:32:21.371] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:99:0)
[14:32:21.412] Build status: STARTED
[14:32:21.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:100:0) after 9m1s
[14:41:22.477] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:100:0)
[14:41:22.654] Build status: STARTED
[14:41:22.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:101:0) after 5m54s
[14:47:16.684] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:101:0)
[14:47:16.714] Build status: STARTED
[14:47:16.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:102:0) after 9m41s
[14:56:57.774] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:102:0)
[14:56:57.934] Build status: STARTED
[14:56:57.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:103:0) after 6m5s
[15:03:02.966] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:103:0)
[15:03:03.042] Build status: STARTED
[15:03:03.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:104:0) after 1m21s
[15:04:24.133] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:104:0)
[15:04:24.188] Build status: STARTED
[15:04:24.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:105:0) after 1m46s
[15:06:10.220] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:105:0)
[15:06:10.330] Build status: STARTED
[15:06:10.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:106:0) after 8m11s
[15:14:21.466] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:106:0)
[15:14:21.499] Build status: STARTED
[15:14:21.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:107:0) after 8m3s
[15:22:24.534] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:107:0)
[15:22:24.564] Build status: STARTED
[15:22:24.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:108:0) after 3m45s
[15:26:09.800] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:108:0)
[15:26:09.832] Build status: STARTED
[15:26:09.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:109:0) after 4m48s
[15:30:57.917] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:109:0)
[15:30:57.948] Build status: STARTED
[15:30:57.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:110:0) after 3m55s
[15:34:53.161] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:110:0)
[15:34:53.262] Build status: STARTED
[15:34:53.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:111:0) after 8m18s
[15:43:11.413] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:111:0)
[15:43:11.461] Build status: STARTED
[15:43:11.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:112:0) after 7m5s
[15:50:16.497] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:112:0)
[15:50:16.559] Build status: STARTED
[15:50:16.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:113:0) after 2m32s
[15:52:48.588] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:113:0)
[15:52:48.626] Build status: STARTED
[15:52:48.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:114:0) after 5m56s
[15:58:44.853] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:114:0)
[15:58:44.885] Build status: STARTED
[15:58:44.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:115:0) after 6m4s
[16:04:48.916] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:115:0)
[16:04:48.954] Build status: STARTED
[16:04:48.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:116:0) after 5m28s
[16:10:17.952] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:116:0)
[16:10:18.073] Build status: STARTED
[16:10:18.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:117:0) after 6m29s
[16:16:47.073] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:117:0)
[16:16:47.151] Build status: STARTED
[16:16:47.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:118:0) after 3m12s
[16:19:59.395] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:118:0)
[16:19:59.426] Build status: STARTED
[16:19:59.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:119:0) after 7m9s
[16:27:08.570] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:119:0)
[16:27:08.603] Build status: STARTED
[16:27:08.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998305645701740256:120:0) after 9m58s
[16:34:34.679] Received PubSub notification, asking Buildbucket for the build status
[16:34:34.726] Build:
{
"id": "8832875583548259921",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 25722,
"createdBy": "project:chromium",
"createTime": "2021-10-20T06:13:58.166778320Z",
"startTime": "2021-10-20T06:19:50.167972Z",
"endTime": "2021-10-20T16:34:34.278392394Z",
"updateTime": "2021-10-20T16:34:34.278976409Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a702f824bd1e6f591f112f5ed53192d78ee765ac",
"ref": "refs/heads/main"
}
},
"canary": true
}
[16:34:34.726] Invocation finished in 10h20m37.997940634s with status FAILED