[01:38:17.328] New invocation is queued and will start shortly
[01:38:18.382] Starting the invocation (attempt 1)
[01:38:18.414] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9505815e25568f9581080024b460049bad619f91"
[01:38:18.414] Popped gitiles commit info from properties and tags
[01:38:18.414] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:38:18.414] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:38:18.414] Buildbucket request:
{
"requestId": "9006204924630664176",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTFuchsia x64"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9505815e25568f9581080024b460049bad619f91",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9006204924630664176"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTFuchsia x64"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:38:19.452] Scheduled build:
{
"id": "8840774862658165120",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTFuchsia x64"
},
"number": 1224,
"createdBy": "project:chromium",
"createTime": "2021-07-25T01:38:18.560731Z",
"updateTime": "2021-07-25T01:38:19.378656Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9505815e25568f9581080024b460049bad619f91",
"ref": "refs/heads/main"
}
},
"canary": true
}
[01:38:19.452] Task URL: https://cr-buildbucket.appspot.com/build/8840774862658165120
[01:38:19.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:2:0) after 6m2s
[01:39:21.154] Received PubSub notification, asking Buildbucket for the build status
[01:39:21.187] Build status: STARTED
[01:44:21.469] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:2:0)
[01:44:21.496] Build status: STARTED
[01:44:21.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:4:0) after 5m54s
[01:50:15.512] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:4:0)
[01:50:15.536] Build status: STARTED
[01:50:15.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:5:0) after 1m36s
[01:51:51.977] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:5:0)
[01:51:52.001] Build status: STARTED
[01:51:52.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:6:0) after 8m19s
[02:00:11.024] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:6:0)
[02:00:11.094] Build status: STARTED
[02:00:11.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:7:0) after 6m33s
[02:06:44.463] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:7:0)
[02:06:44.489] Build status: STARTED
[02:06:44.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:8:0) after 8m38s
[02:15:22.507] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:8:0)
[02:15:22.539] Build status: STARTED
[02:15:22.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:9:0) after 2m56s
[02:18:18.757] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:9:0)
[02:18:18.784] Build status: STARTED
[02:18:18.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:10:0) after 7m41s
[02:26:00.159] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:10:0)
[02:26:00.194] Build status: STARTED
[02:26:00.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:11:0) after 8m49s
[02:34:49.560] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:11:0)
[02:34:49.589] Build status: STARTED
[02:34:49.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:12:0) after 9m55s
[02:44:45.920] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:12:0)
[02:44:45.949] Build status: STARTED
[02:44:45.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:13:0) after 2m55s
[02:47:40.952] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:13:0)
[02:47:40.979] Build status: STARTED
[02:47:40.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:14:0) after 3m21s
[02:51:02.371] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:14:0)
[02:51:02.407] Build status: STARTED
[02:51:02.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:15:0) after 5m43s
[02:56:45.472] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:15:0)
[02:56:45.500] Build status: STARTED
[02:56:45.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:16:0) after 5m32s
[03:02:17.788] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:16:0)
[03:02:17.820] Build status: STARTED
[03:02:17.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:17:0) after 7m34s
[03:09:51.920] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:17:0)
[03:09:51.944] Build status: STARTED
[03:09:51.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:18:0) after 6m50s
[03:16:41.962] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:18:0)
[03:16:41.988] Build status: STARTED
[03:16:41.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:19:0) after 3m3s
[03:19:45.857] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:19:0)
[03:19:45.882] Build status: STARTED
[03:19:45.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:20:0) after 3m43s
[03:23:28.953] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:20:0)
[03:23:28.983] Build status: STARTED
[03:23:28.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:21:0) after 2m15s
[03:25:44.289] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:21:0)
[03:25:44.317] Build status: STARTED
[03:25:44.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:22:0) after 7m55s
[03:33:39.333] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:22:0)
[03:33:39.377] Build status: STARTED
[03:33:39.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:23:0) after 6m2s
[03:39:41.392] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:23:0)
[03:39:41.416] Build status: STARTED
[03:39:41.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:24:0) after 6m15s
[03:45:56.746] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:24:0)
[03:45:56.818] Build status: STARTED
[03:45:56.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:25:0) after 8m9s
[03:54:05.864] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:25:0)
[03:54:05.887] Build status: STARTED
[03:54:05.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:26:0) after 5m2s
[03:59:08.360] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:26:0)
[03:59:08.393] Build status: STARTED
[03:59:08.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:27:0) after 9m43s
[04:08:51.533] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:27:0)
[04:08:51.569] Build status: STARTED
[04:08:51.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:28:0) after 3m10s
[04:12:01.589] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:28:0)
[04:12:01.621] Build status: STARTED
[04:12:01.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:29:0) after 1m7s
[04:13:08.845] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:29:0)
[04:13:08.878] Build status: STARTED
[04:13:08.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:30:0) after 2m28s
[04:15:37.018] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:30:0)
[04:15:37.046] Build status: STARTED
[04:15:37.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:31:0) after 8m18s
[04:23:55.839] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:31:0)
[04:23:55.865] Build status: STARTED
[04:23:55.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:32:0) after 5m9s
[04:29:05.158] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:32:0)
[04:29:05.185] Build status: STARTED
[04:29:05.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:33:0) after 3m49s
[04:32:54.153] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:33:0)
[04:32:54.181] Build status: STARTED
[04:32:54.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:34:0) after 8m35s
[04:41:29.402] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:34:0)
[04:41:29.435] Build status: STARTED
[04:41:29.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:35:0) after 1m24s
[04:42:53.438] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:35:0)
[04:42:53.470] Build status: STARTED
[04:42:53.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:36:0) after 1m26s
[04:44:19.738] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:36:0)
[04:44:19.764] Build status: STARTED
[04:44:19.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:37:0) after 2m34s
[04:46:53.989] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:37:0)
[04:46:54.023] Build status: STARTED
[04:46:54.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:38:0) after 8m9s
[04:55:03.790] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:38:0)
[04:55:03.817] Build status: STARTED
[04:55:03.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:39:0) after 3m7s
[04:58:10.842] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:39:0)
[04:58:10.866] Build status: STARTED
[04:58:10.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:40:0) after 7m54s
[05:06:05.167] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:40:0)
[05:06:05.192] Build status: STARTED
[05:06:05.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:41:0) after 8m35s
[05:14:40.629] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:41:0)
[05:14:40.658] Build status: STARTED
[05:14:40.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:42:0) after 2m16s
[05:16:56.683] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:42:0)
[05:16:56.712] Build status: STARTED
[05:16:56.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:43:0) after 9m31s
[05:26:28.565] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:43:0)
[05:26:28.597] Build status: STARTED
[05:26:28.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:44:0) after 4m27s
[05:30:55.616] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:44:0)
[05:30:55.657] Build status: STARTED
[05:30:55.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:45:0) after 9m26s
[05:40:21.679] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:45:0)
[05:40:21.724] Build status: STARTED
[05:40:21.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:46:0) after 9m43s
[05:50:04.743] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:46:0)
[05:50:04.770] Build status: STARTED
[05:50:04.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:47:0) after 9m15s
[05:59:20.016] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:47:0)
[05:59:20.043] Build status: STARTED
[05:59:20.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:48:0) after 7m10s
[06:06:30.398] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:48:0)
[06:06:30.431] Build status: STARTED
[06:06:30.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:49:0) after 4m38s
[06:11:08.455] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:49:0)
[06:11:08.483] Build status: STARTED
[06:11:08.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:50:0) after 6m2s
[06:17:11.010] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:50:0)
[06:17:11.072] Build status: STARTED
[06:17:11.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:51:0) after 3m9s
[06:20:20.133] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:51:0)
[06:20:20.164] Build status: STARTED
[06:20:20.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:52:0) after 5m10s
[06:25:30.442] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:52:0)
[06:25:30.472] Build status: STARTED
[06:25:30.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:53:0) after 6m59s
[06:32:30.042] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:53:0)
[06:32:30.076] Build status: STARTED
[06:32:30.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:54:0) after 9m49s
[06:42:19.288] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:54:0)
[06:42:19.317] Build status: STARTED
[06:42:19.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:55:0) after 8m33s
[06:50:52.389] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:55:0)
[06:50:52.417] Build status: STARTED
[06:50:52.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:56:0) after 2m29s
[06:53:21.561] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:56:0)
[06:53:21.596] Build status: STARTED
[06:53:21.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:57:0) after 1m30s
[06:54:51.880] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:57:0)
[06:54:52.281] Build status: STARTED
[06:54:52.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:58:0) after 8m40s
[07:03:32.591] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:58:0)
[07:03:32.621] Build status: STARTED
[07:03:32.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:59:0) after 9m12s
[07:12:44.722] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:59:0)
[07:12:44.752] Build status: STARTED
[07:12:44.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:60:0) after 3m56s
[07:16:40.777] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:60:0)
[07:16:40.806] Build status: STARTED
[07:16:40.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:61:0) after 6m32s
[07:23:12.964] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:61:0)
[07:23:13.001] Build status: STARTED
[07:23:13.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:62:0) after 1m38s
[07:24:51.024] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:62:0)
[07:24:51.058] Build status: STARTED
[07:24:51.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:63:0) after 1m26s
[07:26:17.130] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:63:0)
[07:26:17.171] Build status: STARTED
[07:26:17.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:64:0) after 5m40s
[07:31:57.344] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:64:0)
[07:31:57.377] Build status: STARTED
[07:31:57.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:65:0) after 8m9s
[07:40:06.410] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:65:0)
[07:40:06.438] Build status: STARTED
[07:40:06.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:9006204924630664176:66:0) after 4m53s
[07:41:17.003] Received PubSub notification, asking Buildbucket for the build status
[07:41:17.033] Build:
{
"id": "8840774862658165120",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTFuchsia x64"
},
"number": 1224,
"createdBy": "project:chromium",
"createTime": "2021-07-25T01:38:18.560731Z",
"startTime": "2021-07-25T01:39:20.123297Z",
"endTime": "2021-07-25T07:41:15.628613452Z",
"updateTime": "2021-07-25T07:41:15.629040356Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9505815e25568f9581080024b460049bad619f91",
"ref": "refs/heads/main"
}
},
"canary": true
}
[07:41:17.033] Invocation finished in 6h2m59.736691528s with status FAILED