[21:15:34.608] New invocation is queued and will start shortly
[21:15:35.703] Starting the invocation (attempt 1)
[21:15:35.826] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/430a50d9a629d4a755b1d5593e003c9af48e23af"
[21:15:35.826] Popped gitiles commit info from properties and tags
[21:15:35.826] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:15:35.826] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:15:35.826] Buildbucket request:
{
"requestId": "8832818859408376400",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "430a50d9a629d4a755b1d5593e003c9af48e23af",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8832818859408376400"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOS"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:15:36.416] Scheduled build:
{
"id": "8667388797291592449",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 38354,
"createdBy": "project:chromium",
"createTime": "2026-10-20T21:15:35.923515036Z",
"updateTime": "2026-10-20T21:15:35.923515036Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "430a50d9a629d4a755b1d5593e003c9af48e23af",
"ref": "refs/heads/main"
}
}
}
[21:15:36.416] Task URL: https://cr-buildbucket.appspot.com/build/8667388797291592449
[21:15:36.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:2:0) after 3m12s
[21:15:36.767] Received PubSub notification, asking Buildbucket for the build status
[21:15:36.792] Build status: SCHEDULED
[21:15:40.434] Received PubSub notification, asking Buildbucket for the build status
[21:15:40.455] Build status: STARTED
[21:18:48.732] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:2:0)
[21:18:48.759] Build status: STARTED
[21:18:48.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:5:0) after 2m3s
[21:20:51.835] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:5:0)
[21:20:51.859] Build status: STARTED
[21:20:51.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:6:0) after 2m28s
[21:23:19.888] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:6:0)
[21:23:19.911] Build status: STARTED
[21:23:19.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:7:0) after 5m22s
[21:28:41.975] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:7:0)
[21:28:41.993] Build status: STARTED
[21:28:41.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:8:0) after 5m38s
[21:34:20.041] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:8:0)
[21:34:20.076] Build status: STARTED
[21:34:20.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:9:0) after 5m23s
[21:39:43.105] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:9:0)
[21:39:43.134] Build status: STARTED
[21:39:43.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:10:0) after 1m51s
[21:41:34.165] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:10:0)
[21:41:34.184] Build status: STARTED
[21:41:34.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:11:0) after 6m7s
[21:47:41.422] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:11:0)
[21:47:41.445] Build status: STARTED
[21:47:41.446] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:12:0) after 3m56s
[21:51:37.516] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:12:0)
[21:51:37.731] Build status: STARTED
[21:51:37.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:13:0) after 1m24s
[21:53:01.798] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:13:0)
[21:53:01.823] Build status: STARTED
[21:53:01.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:14:0) after 6m53s
[21:59:54.890] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:14:0)
[21:59:54.907] Build status: STARTED
[21:59:54.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:15:0) after 2m30s
[22:02:24.926] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:15:0)
[22:02:24.945] Build status: STARTED
[22:02:24.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:16:0) after 6m0s
[22:08:24.961] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:16:0)
[22:08:24.980] Build status: STARTED
[22:08:24.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:17:0) after 1m15s
[22:09:40.071] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:17:0)
[22:09:40.135] Build status: STARTED
[22:09:40.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:18:0) after 1m34s
[22:11:16.342] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:18:0)
[22:11:16.381] Build status: STARTED
[22:11:16.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:19:0) after 2m37s
[22:13:53.407] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:19:0)
[22:13:53.428] Build status: STARTED
[22:13:53.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:20:0) after 1m6s
[22:14:59.454] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:20:0)
[22:14:59.491] Build status: STARTED
[22:14:59.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:21:0) after 1m56s
[22:16:55.533] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:21:0)
[22:16:55.577] Build status: STARTED
[22:16:55.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:22:0) after 4m9s
[22:21:04.700] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:22:0)
[22:21:04.744] Build status: STARTED
[22:21:04.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:23:0) after 4m30s
[22:25:34.769] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:23:0)
[22:25:34.792] Build status: STARTED
[22:25:34.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:24:0) after 5m13s
[22:30:47.945] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:24:0)
[22:30:47.984] Build status: STARTED
[22:30:47.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:25:0) after 8m37s
[22:39:25.257] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:25:0)
[22:39:25.320] Build status: STARTED
[22:39:25.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:26:0) after 2m20s
[22:41:45.391] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:26:0)
[22:41:45.419] Build status: STARTED
[22:41:45.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:27:0) after 4m32s
[22:46:17.444] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:27:0)
[22:46:17.544] Build status: STARTED
[22:46:17.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:28:0) after 2m21s
[22:48:38.617] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:28:0)
[22:48:38.646] Build status: STARTED
[22:48:38.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:29:0) after 1m0s
[22:49:38.709] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:29:0)
[22:49:38.727] Build status: STARTED
[22:49:38.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:30:0) after 1m7s
[22:50:45.796] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:30:0)
[22:50:45.855] Build status: STARTED
[22:50:45.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:31:0) after 6m33s
[22:57:18.904] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:31:0)
[22:57:18.930] Build status: STARTED
[22:57:18.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:32:0) after 5m49s
[23:03:07.984] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:32:0)
[23:03:08.005] Build status: STARTED
[23:03:08.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:33:0) after 7m55s
[23:11:03.251] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:33:0)
[23:11:03.268] Build status: STARTED
[23:11:03.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:34:0) after 5m18s
[23:16:21.309] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:34:0)
[23:16:21.329] Build status: STARTED
[23:16:21.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:35:0) after 3m53s
[23:20:14.395] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:35:0)
[23:20:14.465] Build status: STARTED
[23:20:14.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:36:0) after 9m44s
[23:29:58.549] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:36:0)
[23:29:58.661] Build status: STARTED
[23:29:58.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:37:0) after 6m25s
[23:36:23.683] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:37:0)
[23:36:23.710] Build status: STARTED
[23:36:23.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:38:0) after 2m34s
[23:38:57.732] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:38:0)
[23:38:57.755] Build status: STARTED
[23:38:57.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:39:0) after 4m33s
[23:43:30.801] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:39:0)
[23:43:30.824] Build status: STARTED
[23:43:30.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:40:0) after 5m59s
[23:49:29.885] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:40:0)
[23:49:29.903] Build status: STARTED
[23:49:29.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:41:0) after 2m12s
[23:51:41.948] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:41:0)
[23:51:41.979] Build status: STARTED
[23:51:41.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:42:0) after 8m11s
[23:59:53.105] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:42:0)
[23:59:53.126] Build status: STARTED
[23:59:53.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:43:0) after 1m13s
[00:01:06.203] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:43:0)
[00:01:06.228] Build status: STARTED
[00:01:06.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:44:0) after 6m17s
[00:07:23.251] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:44:0)
[00:07:23.328] Build status: STARTED
[00:07:23.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:45:0) after 8m22s
[00:15:45.456] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:45:0)
[00:15:45.496] Build status: STARTED
[00:15:45.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:46:0) after 9m50s
[00:25:35.610] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:46:0)
[00:25:35.644] Build status: STARTED
[00:25:35.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:47:0) after 2m33s
[00:28:08.665] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:47:0)
[00:28:08.729] Build status: STARTED
[00:28:08.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:48:0) after 4m42s
[00:32:50.753] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:48:0)
[00:32:50.780] Build status: STARTED
[00:32:50.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:49:0) after 4m56s
[00:37:46.753] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:49:0)
[00:37:46.848] Build status: STARTED
[00:37:46.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:50:0) after 4m32s
[00:42:18.885] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:50:0)
[00:42:18.925] Build status: STARTED
[00:42:18.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:51:0) after 7m7s
[00:49:26.056] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:51:0)
[00:49:26.076] Build status: STARTED
[00:49:26.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:52:0) after 2m22s
[00:51:48.209] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:52:0)
[00:51:48.237] Build status: STARTED
[00:51:48.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:53:0) after 5m42s
[00:57:30.259] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:53:0)
[00:57:30.295] Build status: STARTED
[00:57:30.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:54:0) after 1m34s
[00:59:04.390] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:54:0)
[00:59:04.420] Build status: STARTED
[00:59:04.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:55:0) after 4m31s
[01:03:35.496] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:55:0)
[01:03:35.518] Build status: STARTED
[01:03:35.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:56:0) after 3m18s
[01:06:53.534] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:56:0)
[01:06:53.553] Build status: STARTED
[01:06:53.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:57:0) after 5m23s
[01:12:16.543] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:57:0)
[01:12:16.617] Build status: STARTED
[01:12:16.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:58:0) after 1m56s
[01:14:12.646] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:58:0)
[01:14:12.691] Build status: STARTED
[01:14:12.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:59:0) after 8m34s
[01:22:46.780] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:59:0)
[01:22:46.800] Build status: STARTED
[01:22:46.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:60:0) after 3m40s
[01:26:26.857] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:60:0)
[01:26:26.876] Build status: STARTED
[01:26:26.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:61:0) after 4m2s
[01:30:29.027] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:61:0)
[01:30:29.048] Build status: STARTED
[01:30:29.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:62:0) after 2m47s
[01:33:16.119] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:62:0)
[01:33:16.135] Build status: STARTED
[01:33:16.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:63:0) after 2m46s
[01:36:02.176] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:63:0)
[01:36:02.206] Build status: STARTED
[01:36:02.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:64:0) after 4m32s
[01:40:34.234] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:64:0)
[01:40:34.292] Build status: STARTED
[01:40:34.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:65:0) after 8m23s
[01:48:57.317] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:65:0)
[01:48:57.380] Build status: STARTED
[01:48:57.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:66:0) after 7m52s
[01:56:49.412] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:66:0)
[01:56:49.435] Build status: STARTED
[01:56:49.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:67:0) after 7m36s
[02:04:25.558] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:67:0)
[02:04:25.577] Build status: STARTED
[02:04:25.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:68:0) after 9m22s
[02:13:47.670] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:68:0)
[02:13:47.690] Build status: STARTED
[02:13:47.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832818859408376400:69:0) after 2m53s
[02:14:38.724] Received PubSub notification, asking Buildbucket for the build status
[02:14:38.817] Build:
{
"id": "8667388797291592449",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 38354,
"createdBy": "project:chromium",
"createTime": "2026-10-20T21:15:35.923515036Z",
"startTime": "2026-10-20T21:15:40.038938339Z",
"endTime": "2026-10-21T02:14:38.325406405Z",
"updateTime": "2026-10-21T02:14:38.325406405Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "430a50d9a629d4a755b1d5593e003c9af48e23af",
"ref": "refs/heads/main"
}
}
}
[02:14:38.817] Invocation finished in 4h59m4.295565088s with status FAILED