[00:56:01.357] New invocation is queued and will start shortly
[00:56:02.494] Starting the invocation (attempt 1)
[00:56:02.590] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/33a08c31677deee72a4992901a4fc355ffd61900"
[00:56:02.590] Popped gitiles commit info from properties and tags
[00:56:02.590] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:56:02.591] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:56:02.591] Buildbucket request:
{
"requestId": "8832895587040718960",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "33a08c31677deee72a4992901a4fc355ffd61900",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8832895587040718960"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOS"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[00:56:03.137] Scheduled build:
{
"id": "8667465524984894305",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 38350,
"createdBy": "project:chromium",
"createTime": "2026-10-20T00:56:02.693448442Z",
"updateTime": "2026-10-20T00:56:02.693448442Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "33a08c31677deee72a4992901a4fc355ffd61900",
"ref": "refs/heads/main"
}
}
}
[00:56:03.137] Task URL: https://cr-buildbucket.appspot.com/build/8667465524984894305
[00:56:03.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:2:0) after 7m7s
[00:56:03.236] Received PubSub notification, asking Buildbucket for the build status
[00:56:03.260] Build status: SCHEDULED
[00:56:07.529] Received PubSub notification, asking Buildbucket for the build status
[00:56:07.551] Build status: STARTED
[01:03:10.164] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:2:0)
[01:03:10.191] Build status: STARTED
[01:03:10.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:5:0) after 5m4s
[01:08:14.256] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:5:0)
[01:08:14.293] Build status: STARTED
[01:08:14.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:6:0) after 3m15s
[01:11:29.284] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:6:0)
[01:11:29.305] Build status: STARTED
[01:11:29.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:7:0) after 2m1s
[01:13:30.329] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:7:0)
[01:13:30.351] Build status: STARTED
[01:13:30.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:8:0) after 4m14s
[01:17:44.386] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:8:0)
[01:17:44.425] Build status: STARTED
[01:17:44.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:9:0) after 5m26s
[01:23:10.478] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:9:0)
[01:23:10.503] Build status: STARTED
[01:23:10.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:10:0) after 2m53s
[01:26:03.523] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:10:0)
[01:26:03.548] Build status: STARTED
[01:26:03.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:11:0) after 9m33s
[01:35:36.679] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:11:0)
[01:35:36.724] Build status: STARTED
[01:35:36.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:12:0) after 4m3s
[01:39:39.747] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:12:0)
[01:39:39.796] Build status: STARTED
[01:39:39.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:13:0) after 8m59s
[01:48:38.850] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:13:0)
[01:48:38.871] Build status: STARTED
[01:48:38.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:14:0) after 2m35s
[01:51:13.947] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:14:0)
[01:51:13.975] Build status: STARTED
[01:51:13.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:15:0) after 6m26s
[01:57:39.954] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:15:0)
[01:57:40.006] Build status: STARTED
[01:57:40.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:16:0) after 5m31s
[02:03:10.980] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:16:0)
[02:03:11.007] Build status: STARTED
[02:03:11.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:17:0) after 3m40s
[02:06:51.293] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:17:0)
[02:06:51.321] Build status: STARTED
[02:06:51.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:18:0) after 5m48s
[02:12:39.502] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:18:0)
[02:12:39.599] Build status: STARTED
[02:12:39.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:19:0) after 7m15s
[02:19:54.630] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:19:0)
[02:19:54.648] Build status: STARTED
[02:19:54.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:20:0) after 6m1s
[02:25:55.879] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:20:0)
[02:25:55.932] Build status: STARTED
[02:25:55.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:21:0) after 7m13s
[02:33:08.938] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:21:0)
[02:33:08.962] Build status: STARTED
[02:33:08.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:22:0) after 8m30s
[02:41:38.948] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:22:0)
[02:41:38.967] Build status: STARTED
[02:41:38.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:23:0) after 1m54s
[02:43:33.119] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:23:0)
[02:43:33.134] Build status: STARTED
[02:43:33.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:24:0) after 6m46s
[02:50:19.866] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:24:0)
[02:50:19.897] Build status: STARTED
[02:50:19.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:25:0) after 9m58s
[03:00:17.965] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:25:0)
[03:00:17.990] Build status: STARTED
[03:00:17.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:26:0) after 9m26s
[03:09:44.086] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:26:0)
[03:09:44.108] Build status: STARTED
[03:09:44.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:27:0) after 8m13s
[03:17:57.184] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:27:0)
[03:17:57.209] Build status: STARTED
[03:17:57.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:28:0) after 9m34s
[03:27:31.280] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:28:0)
[03:27:31.300] Build status: STARTED
[03:27:31.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:29:0) after 1m36s
[03:29:07.308] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:29:0)
[03:29:07.333] Build status: STARTED
[03:29:07.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:30:0) after 9m38s
[03:38:45.350] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:30:0)
[03:38:45.366] Build status: STARTED
[03:38:45.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:31:0) after 5m21s
[03:44:06.391] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:31:0)
[03:44:06.415] Build status: STARTED
[03:44:06.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:32:0) after 7m53s
[03:51:59.545] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:32:0)
[03:51:59.594] Build status: STARTED
[03:51:59.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:33:0) after 7m23s
[03:59:22.618] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:33:0)
[03:59:22.634] Build status: STARTED
[03:59:22.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:34:0) after 3m26s
[04:02:48.717] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:34:0)
[04:02:48.755] Build status: STARTED
[04:02:48.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:35:0) after 8m17s
[04:11:05.815] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:35:0)
[04:11:05.834] Build status: STARTED
[04:11:05.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:36:0) after 9m57s
[04:21:02.902] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:36:0)
[04:21:02.922] Build status: STARTED
[04:21:02.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:37:0) after 9m45s
[04:30:47.953] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:37:0)
[04:30:47.970] Build status: STARTED
[04:30:47.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:38:0) after 1m9s
[04:31:56.993] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:38:0)
[04:31:57.024] Build status: STARTED
[04:31:57.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:39:0) after 3m48s
[04:35:45.160] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:39:0)
[04:35:45.178] Build status: STARTED
[04:35:45.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:40:0) after 1m23s
[04:37:08.288] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:40:0)
[04:37:08.364] Build status: STARTED
[04:37:08.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:41:0) after 5m21s
[04:42:29.383] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:41:0)
[04:42:29.401] Build status: STARTED
[04:42:29.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:42:0) after 8m12s
[04:50:41.615] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:42:0)
[04:50:41.641] Build status: STARTED
[04:50:41.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:43:0) after 1m5s
[04:51:46.978] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:43:0)
[04:51:47.000] Build status: STARTED
[04:51:47.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:44:0) after 1m5s
[04:52:52.226] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:44:0)
[04:52:52.406] Build status: STARTED
[04:52:52.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:45:0) after 6m31s
[04:59:23.479] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:45:0)
[04:59:23.518] Build status: STARTED
[04:59:23.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:46:0) after 8m46s
[05:08:09.596] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:46:0)
[05:08:09.613] Build status: STARTED
[05:08:09.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:47:0) after 6m52s
[05:15:01.754] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:47:0)
[05:15:01.771] Build status: STARTED
[05:15:01.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:48:0) after 6m24s
[05:21:25.849] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:48:0)
[05:21:25.864] Build status: STARTED
[05:21:25.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:49:0) after 8m15s
[05:29:40.888] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:49:0)
[05:29:40.905] Build status: STARTED
[05:29:40.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:50:0) after 3m8s
[05:32:49.033] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:50:0)
[05:32:49.049] Build status: STARTED
[05:32:49.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:51:0) after 3m18s
[05:36:07.097] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:51:0)
[05:36:07.122] Build status: STARTED
[05:36:07.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:52:0) after 6m59s
[05:43:06.326] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:52:0)
[05:43:06.348] Build status: STARTED
[05:43:06.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:53:0) after 3m48s
[05:46:54.373] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:53:0)
[05:46:54.390] Build status: STARTED
[05:46:54.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:54:0) after 3m18s
[05:50:12.458] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:54:0)
[05:50:12.479] Build status: STARTED
[05:50:12.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:55:0) after 1m9s
[05:51:21.652] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:55:0)
[05:51:21.673] Build status: STARTED
[05:51:21.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:56:0) after 6m54s
[05:58:15.765] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:56:0)
[05:58:15.816] Build status: STARTED
[05:58:15.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8832895587040718960:57:0) after 6m27s
[06:02:18.671] Received PubSub notification, asking Buildbucket for the build status
[06:02:18.692] Build:
{
"id": "8667465524984894305",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 38350,
"createdBy": "project:chromium",
"createTime": "2026-10-20T00:56:02.693448442Z",
"startTime": "2026-10-20T00:56:07.302023502Z",
"endTime": "2026-10-20T06:02:18.375604703Z",
"updateTime": "2026-10-20T06:02:18.375604703Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "33a08c31677deee72a4992901a4fc355ffd61900",
"ref": "refs/heads/main"
}
}
}
[06:02:18.693] Invocation finished in 5h6m17.343214437s with status FAILED