[03:37:53.246] New invocation is queued and will start shortly
[03:37:54.457] Starting the invocation (attempt 1)
[03:37:54.515] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/6bacca2aadfb391fb06d3c5ae9cf447bc084fea7"
[03:37:54.515] Popped gitiles commit info from properties and tags
[03:37:54.515] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:37:54.515] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:37:54.515] Buildbucket request:
{
"requestId": "8878999259280182432",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTFuchsia x64"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6bacca2aadfb391fb06d3c5ae9cf447bc084fea7",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8878999259280182432"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTFuchsia x64"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:37:55.024] Scheduled build:
{
"id": "8713569197199836753",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTFuchsia x64"
},
"number": 25449,
"createdBy": "project:chromium",
"createTime": "2025-05-29T03:37:54.609244774Z",
"updateTime": "2025-05-29T03:37:54.609244774Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6bacca2aadfb391fb06d3c5ae9cf447bc084fea7",
"ref": "refs/heads/main"
}
},
"canary": true
}
[03:37:55.024] Task URL: https://cr-buildbucket.appspot.com/build/8713569197199836753
[03:37:55.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:2:0) after 5m22s
[03:37:56.026] Received PubSub notification, asking Buildbucket for the build status
[03:37:56.055] Build status: SCHEDULED
[03:38:47.418] Received PubSub notification, asking Buildbucket for the build status
[03:38:47.493] Build status: STARTED
[03:43:17.181] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:2:0)
[03:43:17.217] Build status: STARTED
[03:43:17.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:5:0) after 7m5s
[03:50:22.242] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:5:0)
[03:50:22.266] Build status: STARTED
[03:50:22.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:6:0) after 6m43s
[03:57:05.283] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:6:0)
[03:57:05.307] Build status: STARTED
[03:57:05.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:7:0) after 5m9s
[04:02:14.333] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:7:0)
[04:02:14.374] Build status: STARTED
[04:02:14.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:8:0) after 9m29s
[04:11:43.398] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:8:0)
[04:11:43.421] Build status: STARTED
[04:11:43.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:9:0) after 1m28s
[04:13:11.438] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:9:0)
[04:13:11.459] Build status: STARTED
[04:13:11.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:10:0) after 9m38s
[04:22:49.533] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:10:0)
[04:22:49.560] Build status: STARTED
[04:22:49.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:11:0) after 2m54s
[04:25:43.538] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:11:0)
[04:25:43.564] Build status: STARTED
[04:25:43.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:12:0) after 1m26s
[04:27:09.547] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:12:0)
[04:27:09.578] Build status: STARTED
[04:27:09.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:13:0) after 7m53s
[04:35:02.600] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:13:0)
[04:35:02.631] Build status: STARTED
[04:35:02.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:14:0) after 6m36s
[04:41:38.648] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:14:0)
[04:41:38.668] Build status: STARTED
[04:41:38.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:15:0) after 7m41s
[04:49:19.688] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:15:0)
[04:49:19.718] Build status: STARTED
[04:49:19.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:16:0) after 8m33s
[04:57:52.745] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:16:0)
[04:57:52.769] Build status: STARTED
[04:57:52.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:17:0) after 4m47s
[05:02:39.834] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:17:0)
[05:02:39.860] Build status: STARTED
[05:02:39.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:18:0) after 9m31s
[05:12:10.927] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:18:0)
[05:12:10.943] Build status: STARTED
[05:12:10.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:19:0) after 1m38s
[05:13:48.973] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:19:0)
[05:13:49.009] Build status: STARTED
[05:13:49.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:20:0) after 8m56s
[05:22:45.117] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:20:0)
[05:22:45.199] Build status: STARTED
[05:22:45.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:21:0) after 5m45s
[05:28:30.220] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:21:0)
[05:28:30.251] Build status: STARTED
[05:28:30.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:22:0) after 9m23s
[05:37:53.272] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:22:0)
[05:37:53.290] Build status: STARTED
[05:37:53.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:23:0) after 7m2s
[05:44:55.373] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:23:0)
[05:44:55.399] Build status: STARTED
[05:44:55.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:24:0) after 2m41s
[05:47:36.417] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:24:0)
[05:47:36.434] Build status: STARTED
[05:47:36.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:25:0) after 2m26s
[05:50:02.500] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:25:0)
[05:50:02.526] Build status: STARTED
[05:50:02.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:26:0) after 1m23s
[05:51:25.551] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:26:0)
[05:51:25.567] Build status: STARTED
[05:51:25.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:27:0) after 9m2s
[06:00:28.117] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:27:0)
[06:00:28.135] Build status: STARTED
[06:00:28.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:28:0) after 3m7s
[06:03:35.181] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:28:0)
[06:03:35.217] Build status: STARTED
[06:03:35.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:29:0) after 7m13s
[06:10:48.249] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:29:0)
[06:10:48.272] Build status: STARTED
[06:10:48.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:30:0) after 4m31s
[06:15:19.399] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:30:0)
[06:15:19.416] Build status: STARTED
[06:15:19.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:31:0) after 2m6s
[06:17:25.474] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:31:0)
[06:17:25.538] Build status: STARTED
[06:17:25.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:32:0) after 6m10s
[06:23:35.614] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:32:0)
[06:23:35.630] Build status: STARTED
[06:23:35.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:33:0) after 9m27s
[06:33:02.650] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:33:0)
[06:33:02.678] Build status: STARTED
[06:33:02.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:34:0) after 2m59s
[06:36:01.697] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:34:0)
[06:36:01.713] Build status: STARTED
[06:36:01.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:35:0) after 6m13s
[06:42:15.251] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:35:0)
[06:42:15.267] Build status: STARTED
[06:42:15.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:36:0) after 5m28s
[06:47:43.362] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:36:0)
[06:47:43.384] Build status: STARTED
[06:47:43.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:37:0) after 5m28s
[06:53:11.630] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:37:0)
[06:53:11.648] Build status: STARTED
[06:53:11.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:38:0) after 2m23s
[06:55:34.881] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:38:0)
[06:55:34.895] Build status: STARTED
[06:55:34.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:39:0) after 2m33s
[06:58:07.969] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:39:0)
[06:58:07.986] Build status: STARTED
[06:58:07.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:40:0) after 7m27s
[07:05:35.451] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:40:0)
[07:05:35.470] Build status: STARTED
[07:05:35.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:41:0) after 5m2s
[07:10:37.756] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:41:0)
[07:10:37.775] Build status: STARTED
[07:10:37.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:42:0) after 7m48s
[07:18:25.748] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:42:0)
[07:18:25.763] Build status: STARTED
[07:18:25.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:43:0) after 9m19s
[07:27:44.777] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:43:0)
[07:27:44.985] Build status: STARTED
[07:27:44.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:44:0) after 7m58s
[07:35:43.062] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:44:0)
[07:35:43.081] Build status: STARTED
[07:35:43.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:45:0) after 7m21s
[07:43:04.347] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:45:0)
[07:43:04.445] Build status: STARTED
[07:43:04.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:46:0) after 8m27s
[07:51:31.521] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:46:0)
[07:51:31.541] Build status: STARTED
[07:51:31.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:47:0) after 6m41s
[07:58:12.622] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:47:0)
[07:58:12.639] Build status: STARTED
[07:58:12.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:48:0) after 4m45s
[08:02:58.108] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:48:0)
[08:02:58.126] Build status: STARTED
[08:02:58.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:49:0) after 8m40s
[08:11:38.284] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:49:0)
[08:11:38.309] Build status: STARTED
[08:11:38.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:50:0) after 5m36s
[08:17:14.334] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:50:0)
[08:17:14.351] Build status: STARTED
[08:17:14.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:51:0) after 1m31s
[08:18:45.689] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:51:0)
[08:18:45.704] Build status: STARTED
[08:18:45.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:52:0) after 1m59s
[08:20:44.979] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:52:0)
[08:20:45.016] Build status: STARTED
[08:20:45.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:53:0) after 4m26s
[08:25:11.153] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:53:0)
[08:25:11.174] Build status: STARTED
[08:25:11.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:54:0) after 7m37s
[08:32:48.234] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:54:0)
[08:32:48.260] Build status: STARTED
[08:32:48.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:55:0) after 8m28s
[08:41:16.312] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:55:0)
[08:41:16.332] Build status: STARTED
[08:41:16.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:56:0) after 8m58s
[08:50:14.348] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:56:0)
[08:50:14.421] Build status: STARTED
[08:50:14.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:57:0) after 9m55s
[09:00:09.478] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:57:0)
[09:00:09.534] Build status: STARTED
[09:00:09.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:58:0) after 9m30s
[09:09:39.621] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:58:0)
[09:09:39.646] Build status: STARTED
[09:09:39.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:59:0) after 7m31s
[09:17:10.669] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:59:0)
[09:17:10.685] Build status: STARTED
[09:17:10.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:60:0) after 7m28s
[09:24:38.730] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:60:0)
[09:24:38.830] Build status: STARTED
[09:24:38.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:61:0) after 4m22s
[09:29:00.849] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:61:0)
[09:29:00.875] Build status: STARTED
[09:29:00.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:62:0) after 2m32s
[09:31:32.906] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:62:0)
[09:31:32.926] Build status: STARTED
[09:31:32.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:63:0) after 1m16s
[09:32:48.988] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:63:0)
[09:32:49.010] Build status: STARTED
[09:32:49.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:64:0) after 9m30s
[09:42:19.157] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:64:0)
[09:42:19.172] Build status: STARTED
[09:42:19.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8878999259280182432:65:0) after 9m12s
[09:51:00.824] Received PubSub notification, asking Buildbucket for the build status
[09:51:00.853] Build:
{
"id": "8713569197199836753",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTFuchsia x64"
},
"number": 25449,
"createdBy": "project:chromium",
"createTime": "2025-05-29T03:37:54.609244774Z",
"startTime": "2025-05-29T03:38:47.194528303Z",
"endTime": "2025-05-29T09:51:00.457974653Z",
"updateTime": "2025-05-29T09:51:00.457974653Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6bacca2aadfb391fb06d3c5ae9cf447bc084fea7",
"ref": "refs/heads/main"
}
},
"canary": true
}
[09:51:00.853] Invocation finished in 6h13m7.610412873s with status FAILED