[10:48:51.327] New invocation is queued and will start shortly
[10:48:52.431] Starting the invocation (attempt 1)
[10:48:52.473] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/6e6877fd9bb92eb73bcf7516ce3bad70bb616b0b"
[10:48:52.473] Popped gitiles commit info from properties and tags
[10:48:52.473] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:48:52.473] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:48:52.474] Buildbucket request:
{
"requestId": "8999013125608575136",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6e6877fd9bb92eb73bcf7516ce3bad70bb616b0b",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8999013125608575136"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:48:52.974] Scheduled build:
{
"id": "8833583063636432721",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 25681,
"createdBy": "project:chromium",
"createTime": "2021-10-12T10:48:52.576327151Z",
"updateTime": "2021-10-12T10:48:52.806273075Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6e6877fd9bb92eb73bcf7516ce3bad70bb616b0b",
"ref": "refs/heads/main"
}
},
"canary": true
}
[10:48:52.974] Task URL: https://cr-buildbucket.appspot.com/build/8833583063636432721
[10:48:52.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:2:0) after 4m47s
[10:53:39.954] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:2:0)
[10:53:39.992] Build status: SCHEDULED
[10:53:39.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:3:0) after 7m32s
[10:54:51.389] Received PubSub notification, asking Buildbucket for the build status
[10:54:51.445] Build status: STARTED
[11:01:12.019] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:3:0)
[11:01:12.045] Build status: STARTED
[11:01:12.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:5:0) after 8m59s
[11:10:11.113] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:5:0)
[11:10:11.146] Build status: STARTED
[11:10:11.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:6:0) after 7m27s
[11:17:38.170] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:6:0)
[11:17:38.294] Build status: STARTED
[11:17:38.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:7:0) after 3m36s
[11:21:14.293] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:7:0)
[11:21:14.321] Build status: STARTED
[11:21:14.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:8:0) after 9m33s
[11:30:47.403] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:8:0)
[11:30:47.429] Build status: STARTED
[11:30:47.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:9:0) after 1m14s
[11:32:01.652] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:9:0)
[11:32:01.681] Build status: STARTED
[11:32:01.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:10:0) after 6m48s
[11:38:49.779] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:10:0)
[11:38:49.815] Build status: STARTED
[11:38:49.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:11:0) after 7m28s
[11:46:17.902] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:11:0)
[11:46:17.931] Build status: STARTED
[11:46:17.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:12:0) after 7m45s
[11:54:02.955] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:12:0)
[11:54:03.001] Build status: STARTED
[11:54:03.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:13:0) after 8m57s
[12:03:00.061] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:13:0)
[12:03:00.092] Build status: STARTED
[12:03:00.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:14:0) after 6m0s
[12:09:00.314] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:14:0)
[12:09:00.363] Build status: STARTED
[12:09:00.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:15:0) after 9m37s
[12:18:37.384] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:15:0)
[12:18:37.410] Build status: STARTED
[12:18:37.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:16:0) after 7m29s
[12:26:06.474] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:16:0)
[12:26:06.502] Build status: STARTED
[12:26:06.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:17:0) after 9m4s
[12:35:10.661] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:17:0)
[12:35:10.689] Build status: STARTED
[12:35:10.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:18:0) after 5m35s
[12:40:45.727] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:18:0)
[12:40:45.768] Build status: STARTED
[12:40:45.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:19:0) after 7m25s
[12:48:10.751] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:19:0)
[12:48:10.776] Build status: STARTED
[12:48:10.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:20:0) after 4m3s
[12:52:14.062] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:20:0)
[12:52:14.091] Build status: STARTED
[12:52:14.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:21:0) after 6m22s
[12:58:36.117] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:21:0)
[12:58:36.154] Build status: STARTED
[12:58:36.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:22:0) after 8m34s
[13:07:10.325] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:22:0)
[13:07:10.371] Build status: STARTED
[13:07:10.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:23:0) after 9m4s
[13:16:14.389] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:23:0)
[13:16:14.421] Build status: STARTED
[13:16:14.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:24:0) after 7m1s
[13:23:15.467] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:24:0)
[13:23:15.520] Build status: STARTED
[13:23:15.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:25:0) after 8m16s
[13:31:31.553] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:25:0)
[13:31:31.615] Build status: STARTED
[13:31:31.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:26:0) after 8m6s
[13:39:37.796] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:26:0)
[13:39:37.824] Build status: STARTED
[13:39:37.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:27:0) after 1m51s
[13:41:28.866] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:27:0)
[13:41:28.901] Build status: STARTED
[13:41:28.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:28:0) after 8m15s
[13:49:44.027] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:28:0)
[13:49:44.057] Build status: STARTED
[13:49:44.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:29:0) after 7m31s
[13:57:15.285] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:29:0)
[13:57:15.375] Build status: STARTED
[13:57:15.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:30:0) after 8m48s
[14:06:03.512] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:30:0)
[14:06:03.549] Build status: STARTED
[14:06:03.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:31:0) after 7m37s
[14:13:40.574] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:31:0)
[14:13:40.606] Build status: STARTED
[14:13:40.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:32:0) after 9m57s
[14:23:37.771] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:32:0)
[14:23:37.801] Build status: STARTED
[14:23:37.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:33:0) after 1m44s
[14:25:21.983] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:33:0)
[14:25:22.065] Build status: STARTED
[14:25:22.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:34:0) after 2m21s
[14:27:43.191] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:34:0)
[14:27:43.223] Build status: STARTED
[14:27:43.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:35:0) after 3m7s
[14:30:50.245] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:35:0)
[14:30:50.282] Build status: STARTED
[14:30:50.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:36:0) after 4m7s
[14:34:57.312] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:36:0)
[14:34:57.344] Build status: STARTED
[14:34:57.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:37:0) after 3m57s
[14:38:54.595] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:37:0)
[14:38:54.623] Build status: STARTED
[14:38:54.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:38:0) after 5m16s
[14:44:10.993] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:38:0)
[14:44:11.026] Build status: STARTED
[14:44:11.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:39:0) after 8m43s
[14:52:54.226] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:39:0)
[14:52:54.263] Build status: STARTED
[14:52:54.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:40:0) after 3m1s
[14:55:55.288] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:40:0)
[14:55:55.321] Build status: STARTED
[14:55:55.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:41:0) after 6m32s
[15:02:27.463] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:41:0)
[15:02:27.496] Build status: STARTED
[15:02:27.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:42:0) after 1m58s
[15:04:25.635] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:42:0)
[15:04:25.664] Build status: STARTED
[15:04:25.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:43:0) after 1m20s
[15:05:45.787] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:43:0)
[15:05:45.827] Build status: STARTED
[15:05:45.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:44:0) after 4m5s
[15:09:50.888] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:44:0)
[15:09:50.920] Build status: STARTED
[15:09:50.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:45:0) after 7m32s
[15:17:22.946] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:45:0)
[15:17:22.984] Build status: STARTED
[15:17:22.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:46:0) after 6m51s
[15:24:14.074] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:46:0)
[15:24:14.110] Build status: STARTED
[15:24:14.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:47:0) after 7m35s
[15:31:49.102] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:47:0)
[15:31:49.152] Build status: STARTED
[15:31:49.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:48:0) after 1m36s
[15:33:25.454] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:48:0)
[15:33:25.482] Build status: STARTED
[15:33:25.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:49:0) after 4m50s
[15:38:15.935] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:49:0)
[15:38:16.071] Build status: STARTED
[15:38:16.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:50:0) after 1m52s
[15:40:08.094] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:50:0)
[15:40:08.122] Build status: STARTED
[15:40:08.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:51:0) after 7m28s
[15:47:36.286] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:51:0)
[15:47:36.319] Build status: STARTED
[15:47:36.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:52:0) after 2m54s
[15:50:30.339] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:52:0)
[15:50:30.366] Build status: STARTED
[15:50:30.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:53:0) after 8m26s
[15:58:56.414] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:53:0)
[15:58:56.441] Build status: STARTED
[15:58:56.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:54:0) after 5m27s
[16:04:23.476] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:54:0)
[16:04:23.684] Build status: STARTED
[16:04:23.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:55:0) after 4m38s
[16:09:01.788] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:55:0)
[16:09:01.819] Build status: STARTED
[16:09:01.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:56:0) after 4m41s
[16:13:42.842] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:56:0)
[16:13:42.873] Build status: STARTED
[16:13:42.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:57:0) after 4m46s
[16:18:28.892] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:57:0)
[16:18:28.917] Build status: STARTED
[16:18:28.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:58:0) after 7m41s
[16:26:10.060] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:58:0)
[16:26:10.088] Build status: STARTED
[16:26:10.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:59:0) after 8m33s
[16:34:43.377] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:59:0)
[16:34:43.411] Build status: STARTED
[16:34:43.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:60:0) after 9m58s
[16:44:41.446] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:60:0)
[16:44:41.476] Build status: STARTED
[16:44:41.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:61:0) after 9m47s
[16:54:28.597] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:61:0)
[16:54:28.630] Build status: STARTED
[16:54:28.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:62:0) after 5m52s
[17:00:20.718] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:62:0)
[17:00:20.753] Build status: STARTED
[17:00:20.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:63:0) after 6m49s
[17:07:09.998] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:63:0)
[17:07:10.048] Build status: STARTED
[17:07:10.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:64:0) after 4m20s
[17:11:30.048] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:64:0)
[17:11:30.082] Build status: STARTED
[17:11:30.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:65:0) after 5m15s
[17:16:45.193] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:65:0)
[17:16:45.226] Build status: STARTED
[17:16:45.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:66:0) after 8m14s
[17:24:59.251] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:66:0)
[17:24:59.282] Build status: STARTED
[17:24:59.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:67:0) after 6m54s
[17:31:53.406] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:67:0)
[17:31:53.443] Build status: STARTED
[17:31:53.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:68:0) after 1m24s
[17:33:17.590] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:68:0)
[17:33:17.624] Build status: STARTED
[17:33:17.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:69:0) after 7m2s
[17:40:19.898] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:69:0)
[17:40:19.926] Build status: STARTED
[17:40:19.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:70:0) after 2m35s
[17:42:55.372] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:70:0)
[17:42:55.459] Build status: STARTED
[17:42:55.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:71:0) after 5m58s
[17:48:53.849] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:71:0)
[17:48:53.878] Build status: STARTED
[17:48:53.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:72:0) after 6m31s
[17:55:25.073] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:72:0)
[17:55:25.192] Build status: STARTED
[17:55:25.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:73:0) after 9m12s
[18:04:38.119] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:73:0)
[18:04:38.161] Build status: STARTED
[18:04:38.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:74:0) after 6m38s
[18:11:16.187] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:74:0)
[18:11:16.213] Build status: STARTED
[18:11:16.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:75:0) after 8m24s
[18:19:40.256] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:75:0)
[18:19:40.288] Build status: STARTED
[18:19:40.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:76:0) after 6m52s
[18:26:32.360] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:76:0)
[18:26:32.390] Build status: STARTED
[18:26:32.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:77:0) after 2m16s
[18:28:48.415] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:77:0)
[18:28:48.511] Build status: STARTED
[18:28:48.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:78:0) after 5m44s
[18:34:32.552] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:78:0)
[18:34:32.583] Build status: STARTED
[18:34:32.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:79:0) after 2m36s
[18:37:08.664] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:79:0)
[18:37:08.709] Build status: STARTED
[18:37:08.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:80:0) after 4m1s
[18:41:09.739] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:80:0)
[18:41:09.778] Build status: STARTED
[18:41:09.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:81:0) after 8m38s
[18:49:47.800] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:81:0)
[18:49:47.829] Build status: STARTED
[18:49:47.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:82:0) after 8m42s
[18:58:29.867] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:82:0)
[18:58:29.900] Build status: STARTED
[18:58:29.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:83:0) after 3m39s
[19:02:09.031] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:83:0)
[19:02:09.082] Build status: STARTED
[19:02:09.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:84:0) after 1m53s
[19:04:02.172] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:84:0)
[19:04:02.215] Build status: STARTED
[19:04:02.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:85:0) after 1m34s
[19:05:36.236] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:85:0)
[19:05:36.277] Build status: STARTED
[19:05:36.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:86:0) after 6m4s
[19:11:40.300] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:86:0)
[19:11:40.333] Build status: STARTED
[19:11:40.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:87:0) after 5m10s
[19:16:50.346] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:87:0)
[19:16:50.559] Build status: STARTED
[19:16:50.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:88:0) after 3m59s
[19:20:49.685] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:88:0)
[19:20:49.715] Build status: STARTED
[19:20:49.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:89:0) after 7m4s
[19:27:53.739] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:89:0)
[19:27:53.774] Build status: STARTED
[19:27:53.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:90:0) after 7m40s
[19:35:33.800] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:90:0)
[19:35:33.869] Build status: STARTED
[19:35:33.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:91:0) after 9m22s
[19:44:55.881] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:91:0)
[19:44:55.919] Build status: STARTED
[19:44:55.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:92:0) after 7m38s
[19:52:33.993] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:92:0)
[19:52:34.020] Build status: STARTED
[19:52:34.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:93:0) after 7m44s
[20:00:18.052] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:93:0)
[20:00:18.081] Build status: STARTED
[20:00:18.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:94:0) after 4m17s
[20:04:35.115] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:94:0)
[20:04:35.141] Build status: STARTED
[20:04:35.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:95:0) after 5m10s
[20:09:45.251] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:95:0)
[20:09:45.277] Build status: STARTED
[20:09:45.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:96:0) after 2m2s
[20:11:47.418] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:96:0)
[20:11:47.446] Build status: STARTED
[20:11:47.446] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:97:0) after 4m29s
[20:16:16.651] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:97:0)
[20:16:16.694] Build status: STARTED
[20:16:16.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:98:0) after 3m49s
[20:20:05.806] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:98:0)
[20:20:05.840] Build status: STARTED
[20:20:05.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:99:0) after 3m46s
[20:23:51.866] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:99:0)
[20:23:51.899] Build status: STARTED
[20:23:51.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:100:0) after 9m32s
[20:33:23.973] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:100:0)
[20:33:24.018] Build status: STARTED
[20:33:24.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:101:0) after 1m21s
[20:34:45.043] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:101:0)
[20:34:45.072] Build status: STARTED
[20:34:45.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:102:0) after 9m33s
[20:44:18.101] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:102:0)
[20:44:18.133] Build status: STARTED
[20:44:18.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:103:0) after 1m34s
[20:45:52.159] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:103:0)
[20:45:52.186] Build status: STARTED
[20:45:52.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:104:0) after 1m25s
[20:47:17.288] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:104:0)
[20:47:17.323] Build status: STARTED
[20:47:17.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:105:0) after 9m29s
[20:56:46.519] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:105:0)
[20:56:46.570] Build status: STARTED
[20:56:46.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:106:0) after 4m12s
[21:00:58.937] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:106:0)
[21:00:58.970] Build status: STARTED
[21:00:58.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999013125608575136:107:0) after 5m16s
[21:04:10.942] Received PubSub notification, asking Buildbucket for the build status
[21:04:10.977] Build:
{
"id": "8833583063636432721",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 25681,
"createdBy": "project:chromium",
"createTime": "2021-10-12T10:48:52.576327151Z",
"startTime": "2021-10-12T10:54:50.564179Z",
"endTime": "2021-10-12T21:04:10.382710382Z",
"updateTime": "2021-10-12T21:04:10.383077125Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6e6877fd9bb92eb73bcf7516ce3bad70bb616b0b",
"ref": "refs/heads/main"
}
},
"canary": true
}
[21:04:10.977] Invocation finished in 10h15m19.664524017s with status FAILED