[23:58:50.356] New invocation is queued and will start shortly
[23:58:51.478] Starting the invocation (attempt 1)
[23:58:51.502] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a1a578a602ab01cb28afa51c834123a1213f9621"
[23:58:51.502] Popped gitiles commit info from properties and tags
[23:58:51.502] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:58:51.503] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:58:51.503] Buildbucket request:
{
"requestId": "8857632156536872880",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a1a578a602ab01cb28afa51c834123a1213f9621",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8857632156536872880"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOS"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:58:52.080] Scheduled build:
{
"id": "8692202094601731233",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 34794,
"createdBy": "project:chromium",
"createTime": "2026-01-19T23:58:51.573413157Z",
"updateTime": "2026-01-19T23:58:51.573413157Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a1a578a602ab01cb28afa51c834123a1213f9621",
"ref": "refs/heads/main"
}
}
}
[23:58:52.080] Task URL: https://cr-buildbucket.appspot.com/build/8692202094601731233
[23:58:52.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:2:0) after 7m2s
[23:58:53.100] Received PubSub notification, asking Buildbucket for the build status
[23:58:53.113] Build status: SCHEDULED
[23:59:01.847] Received PubSub notification, asking Buildbucket for the build status
[23:59:01.862] Build status: STARTED
[00:05:54.094] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:2:0)
[00:05:54.135] Build status: STARTED
[00:05:54.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:5:0) after 4m36s
[00:10:30.154] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:5:0)
[00:10:30.168] Build status: STARTED
[00:10:30.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:6:0) after 5m50s
[00:16:20.237] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:6:0)
[00:16:20.257] Build status: STARTED
[00:16:20.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:7:0) after 4m32s
[00:20:52.433] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:7:0)
[00:20:52.446] Build status: STARTED
[00:20:52.446] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:8:0) after 2m32s
[00:23:24.904] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:8:0)
[00:23:24.924] Build status: STARTED
[00:23:24.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:9:0) after 3m54s
[00:27:19.123] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:9:0)
[00:27:19.271] Build status: STARTED
[00:27:19.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:10:0) after 1m32s
[00:28:51.317] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:10:0)
[00:28:51.411] Build status: STARTED
[00:28:51.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:11:0) after 7m10s
[00:36:01.427] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:11:0)
[00:36:01.447] Build status: STARTED
[00:36:01.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:12:0) after 2m32s
[00:38:33.783] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:12:0)
[00:38:33.806] Build status: STARTED
[00:38:33.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:13:0) after 3m3s
[00:41:36.824] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:13:0)
[00:41:36.837] Build status: STARTED
[00:41:36.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:14:0) after 4m59s
[00:46:35.853] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:14:0)
[00:46:35.871] Build status: STARTED
[00:46:35.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:15:0) after 6m42s
[00:53:17.893] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:15:0)
[00:53:17.916] Build status: STARTED
[00:53:17.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:16:0) after 7m50s
[01:01:07.933] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:16:0)
[01:01:07.947] Build status: STARTED
[01:01:07.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:17:0) after 2m7s
[01:03:14.965] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:17:0)
[01:03:14.980] Build status: STARTED
[01:03:14.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:18:0) after 6m23s
[01:09:38.001] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:18:0)
[01:09:38.015] Build status: STARTED
[01:09:38.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:19:0) after 7m25s
[01:17:03.081] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:19:0)
[01:17:03.097] Build status: STARTED
[01:17:03.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:20:0) after 3m5s
[01:20:08.115] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:20:0)
[01:20:08.142] Build status: STARTED
[01:20:08.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:21:0) after 4m56s
[01:25:04.165] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:21:0)
[01:25:04.192] Build status: STARTED
[01:25:04.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:22:0) after 6m22s
[01:31:26.208] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:22:0)
[01:31:26.224] Build status: STARTED
[01:31:26.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:23:0) after 2m19s
[01:33:45.240] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:23:0)
[01:33:45.296] Build status: STARTED
[01:33:45.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:24:0) after 3m40s
[01:37:25.315] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:24:0)
[01:37:25.328] Build status: STARTED
[01:37:25.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:25:0) after 5m58s
[01:43:23.398] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:25:0)
[01:43:23.419] Build status: STARTED
[01:43:23.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:26:0) after 2m19s
[01:45:42.487] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:26:0)
[01:45:42.502] Build status: STARTED
[01:45:42.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:27:0) after 3m49s
[01:49:31.521] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:27:0)
[01:49:31.535] Build status: STARTED
[01:49:31.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:28:0) after 4m4s
[01:53:35.554] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:28:0)
[01:53:35.570] Build status: STARTED
[01:53:35.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:29:0) after 1m38s
[01:55:13.547] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:29:0)
[01:55:13.564] Build status: STARTED
[01:55:13.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:30:0) after 8m27s
[02:03:40.645] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:30:0)
[02:03:40.696] Build status: STARTED
[02:03:40.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:31:0) after 2m46s
[02:06:26.877] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:31:0)
[02:06:26.896] Build status: STARTED
[02:06:26.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:32:0) after 3m27s
[02:09:55.044] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:32:0)
[02:09:55.057] Build status: STARTED
[02:09:55.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:33:0) after 5m15s
[02:15:10.983] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:33:0)
[02:15:10.997] Build status: STARTED
[02:15:10.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:34:0) after 5m12s
[02:20:23.016] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:34:0)
[02:20:23.035] Build status: STARTED
[02:20:23.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:35:0) after 6m22s
[02:26:45.083] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:35:0)
[02:26:45.097] Build status: STARTED
[02:26:45.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:36:0) after 2m7s
[02:28:52.168] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:36:0)
[02:28:52.184] Build status: STARTED
[02:28:52.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:37:0) after 6m41s
[02:35:33.210] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:37:0)
[02:35:33.279] Build status: STARTED
[02:35:33.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:38:0) after 4m24s
[02:39:57.432] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:38:0)
[02:39:57.501] Build status: STARTED
[02:39:57.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:39:0) after 2m42s
[02:42:39.637] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:39:0)
[02:42:39.695] Build status: STARTED
[02:42:39.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:40:0) after 8m39s
[02:51:18.787] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:40:0)
[02:51:18.803] Build status: STARTED
[02:51:18.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:41:0) after 9m2s
[03:00:21.125] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:41:0)
[03:00:21.217] Build status: STARTED
[03:00:21.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:42:0) after 4m15s
[03:04:36.235] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:42:0)
[03:04:36.251] Build status: STARTED
[03:04:36.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:43:0) after 7m8s
[03:11:44.447] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:43:0)
[03:11:44.474] Build status: STARTED
[03:11:44.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:44:0) after 2m33s
[03:14:17.491] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:44:0)
[03:14:17.512] Build status: STARTED
[03:14:17.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:45:0) after 6m38s
[03:20:55.533] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:45:0)
[03:20:55.545] Build status: STARTED
[03:20:55.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:46:0) after 4m50s
[03:25:45.581] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:46:0)
[03:25:45.594] Build status: STARTED
[03:25:45.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:47:0) after 9m26s
[03:35:11.855] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:47:0)
[03:35:11.992] Build status: STARTED
[03:35:11.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:48:0) after 1m14s
[03:36:26.011] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:48:0)
[03:36:26.058] Build status: STARTED
[03:36:26.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:49:0) after 9m51s
[03:46:17.091] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:49:0)
[03:46:17.118] Build status: STARTED
[03:46:17.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:50:0) after 3m45s
[03:50:02.192] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:50:0)
[03:50:02.240] Build status: STARTED
[03:50:02.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:51:0) after 3m42s
[03:53:44.395] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:51:0)
[03:53:44.413] Build status: STARTED
[03:53:44.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:52:0) after 9m13s
[04:02:57.434] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:52:0)
[04:02:57.459] Build status: STARTED
[04:02:57.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:53:0) after 5m19s
[04:08:16.474] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:53:0)
[04:08:16.491] Build status: STARTED
[04:08:16.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:54:0) after 9m33s
[04:17:49.508] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:54:0)
[04:17:49.524] Build status: STARTED
[04:17:49.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:55:0) after 5m19s
[04:23:08.684] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:55:0)
[04:23:08.697] Build status: STARTED
[04:23:08.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:56:0) after 9m15s
[04:32:23.899] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:56:0)
[04:32:23.915] Build status: STARTED
[04:32:23.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:57:0) after 4m44s
[04:37:07.936] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:57:0)
[04:37:07.958] Build status: STARTED
[04:37:07.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:58:0) after 9m52s
[04:46:59.978] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:58:0)
[04:46:59.997] Build status: STARTED
[04:46:59.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:59:0) after 4m45s
[04:51:45.052] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:59:0)
[04:51:45.085] Build status: STARTED
[04:51:45.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:60:0) after 2m15s
[04:54:00.114] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:60:0)
[04:54:00.127] Build status: STARTED
[04:54:00.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:61:0) after 8m54s
[05:02:54.192] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:61:0)
[05:02:54.290] Build status: STARTED
[05:02:54.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:62:0) after 9m50s
[05:12:44.309] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:62:0)
[05:12:44.324] Build status: STARTED
[05:12:44.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:63:0) after 7m14s
[05:19:58.722] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:63:0)
[05:19:58.735] Build status: STARTED
[05:19:58.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:64:0) after 5m33s
[05:25:31.753] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:64:0)
[05:25:31.768] Build status: STARTED
[05:25:31.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:65:0) after 1m8s
[05:26:39.786] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:65:0)
[05:26:39.805] Build status: STARTED
[05:26:39.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8857632156536872880:66:0) after 9m52s
[05:31:44.909] Received PubSub notification, asking Buildbucket for the build status
[05:31:44.936] Build:
{
"id": "8692202094601731233",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 34794,
"createdBy": "project:chromium",
"createTime": "2026-01-19T23:58:51.573413157Z",
"startTime": "2026-01-19T23:59:01.699926952Z",
"endTime": "2026-01-20T05:31:44.576320748Z",
"updateTime": "2026-01-20T05:31:44.576320748Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a1a578a602ab01cb28afa51c834123a1213f9621",
"ref": "refs/heads/main"
}
}
}
[05:31:44.936] Invocation finished in 5h32m54.592295521s with status FAILED