[12:44:56.897] New invocation is queued and will start shortly
[12:44:58.023] Starting the invocation (attempt 1)
[12:44:58.046] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/0e777ebc67f4ca45254126a5b9f231b843be516d"
[12:44:58.046] Popped gitiles commit info from properties and tags
[12:44:58.046] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[12:44:58.046] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[12:44:58.047] Buildbucket request:
{
"requestId": "8851604557349699536",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0e777ebc67f4ca45254126a5b9f231b843be516d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851604557349699536"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOS"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[12:44:58.792] Scheduled build:
{
"id": "8686174495420048289",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 35324,
"createdBy": "project:chromium",
"createTime": "2026-03-27T12:44:58.102610851Z",
"updateTime": "2026-03-27T12:44:58.102610851Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0e777ebc67f4ca45254126a5b9f231b843be516d",
"ref": "refs/heads/main"
}
}
}
[12:44:58.792] Task URL: https://cr-buildbucket.appspot.com/build/8686174495420048289
[12:44:58.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:2:0) after 1m35s
[12:45:05.936] Received PubSub notification, asking Buildbucket for the build status
[12:45:05.961] Build status: STARTED
[12:45:10.067] Received PubSub notification, asking Buildbucket for the build status
[12:45:10.111] Build status: STARTED
[12:46:33.865] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:2:0)
[12:46:33.882] Build status: STARTED
[12:46:33.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:5:0) after 8m50s
[12:55:23.900] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:5:0)
[12:55:23.917] Build status: STARTED
[12:55:23.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:6:0) after 5m3s
[13:00:26.940] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:6:0)
[13:00:26.969] Build status: STARTED
[13:00:26.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:7:0) after 3m4s
[13:03:30.992] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:7:0)
[13:03:31.041] Build status: STARTED
[13:03:31.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:8:0) after 5m57s
[13:09:28.124] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:8:0)
[13:09:28.305] Build status: STARTED
[13:09:28.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:9:0) after 4m54s
[13:14:22.367] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:9:0)
[13:14:22.383] Build status: STARTED
[13:14:22.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:10:0) after 1m20s
[13:15:42.498] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:10:0)
[13:15:42.545] Build status: STARTED
[13:15:42.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:11:0) after 1m44s
[13:17:26.564] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:11:0)
[13:17:26.628] Build status: STARTED
[13:17:26.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:12:0) after 6m16s
[13:23:42.713] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:12:0)
[13:23:42.737] Build status: STARTED
[13:23:42.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:13:0) after 7m33s
[13:31:15.739] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:13:0)
[13:31:15.763] Build status: STARTED
[13:31:15.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:14:0) after 8m45s
[13:40:00.800] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:14:0)
[13:40:00.825] Build status: STARTED
[13:40:00.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:15:0) after 3m47s
[13:43:47.892] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:15:0)
[13:43:47.910] Build status: STARTED
[13:43:47.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:16:0) after 4m8s
[13:47:55.983] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:16:0)
[13:47:56.018] Build status: STARTED
[13:47:56.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:17:0) after 6m15s
[13:54:11.066] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:17:0)
[13:54:11.084] Build status: STARTED
[13:54:11.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:18:0) after 9m31s
[14:03:42.151] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:18:0)
[14:03:42.171] Build status: STARTED
[14:03:42.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:19:0) after 3m9s
[14:06:51.246] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:19:0)
[14:06:51.343] Build status: STARTED
[14:06:51.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:20:0) after 3m6s
[14:09:57.397] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:20:0)
[14:09:57.460] Build status: STARTED
[14:09:57.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:21:0) after 3m55s
[14:13:52.532] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:21:0)
[14:13:52.555] Build status: STARTED
[14:13:52.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:22:0) after 8m0s
[14:21:52.521] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:22:0)
[14:21:52.536] Build status: STARTED
[14:21:52.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:23:0) after 9m36s
[14:31:28.629] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:23:0)
[14:31:28.648] Build status: STARTED
[14:31:28.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:24:0) after 3m7s
[14:34:35.755] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:24:0)
[14:34:35.793] Build status: STARTED
[14:34:35.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:25:0) after 7m17s
[14:41:52.888] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:25:0)
[14:41:52.946] Build status: STARTED
[14:41:52.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:26:0) after 2m19s
[14:44:12.015] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:26:0)
[14:44:12.041] Build status: STARTED
[14:44:12.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:27:0) after 5m56s
[14:50:08.031] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:27:0)
[14:50:08.050] Build status: STARTED
[14:50:08.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:28:0) after 3m14s
[14:53:22.075] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:28:0)
[14:53:22.099] Build status: STARTED
[14:53:22.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:29:0) after 3m54s
[14:57:16.075] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:29:0)
[14:57:16.106] Build status: STARTED
[14:57:16.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:30:0) after 8m58s
[15:06:14.160] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:30:0)
[15:06:14.178] Build status: STARTED
[15:06:14.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:31:0) after 8m39s
[15:14:53.319] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:31:0)
[15:14:53.354] Build status: STARTED
[15:14:53.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:32:0) after 7m32s
[15:22:25.394] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:32:0)
[15:22:25.422] Build status: STARTED
[15:22:25.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:33:0) after 1m31s
[15:23:56.523] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:33:0)
[15:23:56.544] Build status: STARTED
[15:23:56.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:34:0) after 6m6s
[15:30:02.560] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:34:0)
[15:30:02.630] Build status: STARTED
[15:30:02.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:35:0) after 7m32s
[15:37:34.706] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:35:0)
[15:37:34.732] Build status: STARTED
[15:37:34.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:36:0) after 2m39s
[15:40:13.753] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:36:0)
[15:40:13.768] Build status: STARTED
[15:40:13.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:37:0) after 2m33s
[15:42:46.778] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:37:0)
[15:42:46.796] Build status: STARTED
[15:42:46.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:38:0) after 6m56s
[15:49:42.900] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:38:0)
[15:49:42.917] Build status: STARTED
[15:49:42.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:39:0) after 8m48s
[15:58:30.971] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:39:0)
[15:58:30.987] Build status: STARTED
[15:58:30.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:40:0) after 6m41s
[16:05:12.022] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:40:0)
[16:05:12.051] Build status: STARTED
[16:05:12.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:41:0) after 4m39s
[16:09:51.087] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:41:0)
[16:09:51.108] Build status: STARTED
[16:09:51.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:42:0) after 9m21s
[16:19:12.182] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:42:0)
[16:19:12.202] Build status: STARTED
[16:19:12.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:43:0) after 9m20s
[16:28:32.237] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:43:0)
[16:28:32.256] Build status: STARTED
[16:28:32.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:44:0) after 3m32s
[16:32:04.278] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:44:0)
[16:32:04.299] Build status: STARTED
[16:32:04.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:45:0) after 8m52s
[16:40:56.469] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:45:0)
[16:40:56.486] Build status: STARTED
[16:40:56.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:46:0) after 9m10s
[16:50:06.556] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:46:0)
[16:50:06.724] Build status: STARTED
[16:50:06.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:47:0) after 5m2s
[16:55:08.788] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:47:0)
[16:55:08.819] Build status: STARTED
[16:55:08.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:48:0) after 9m1s
[17:04:09.853] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:48:0)
[17:04:09.871] Build status: STARTED
[17:04:09.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:49:0) after 1m29s
[17:05:38.887] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:49:0)
[17:05:38.911] Build status: STARTED
[17:05:38.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:50:0) after 1m55s
[17:07:33.934] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:50:0)
[17:07:33.985] Build status: STARTED
[17:07:33.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:51:0) after 6m11s
[17:13:45.092] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:51:0)
[17:13:45.119] Build status: STARTED
[17:13:45.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:52:0) after 7m40s
[17:21:25.176] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:52:0)
[17:21:25.195] Build status: STARTED
[17:21:25.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:53:0) after 9m21s
[17:30:46.308] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:53:0)
[17:30:46.329] Build status: STARTED
[17:30:46.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:54:0) after 5m28s
[17:36:14.364] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:54:0)
[17:36:14.393] Build status: STARTED
[17:36:14.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851604557349699536:55:0) after 5m43s
[17:38:48.334] Received PubSub notification, asking Buildbucket for the build status
[17:38:48.352] Build:
{
"id": "8686174495420048289",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 35324,
"createdBy": "project:chromium",
"createTime": "2026-03-27T12:44:58.102610851Z",
"startTime": "2026-03-27T12:45:02.584623802Z",
"endTime": "2026-03-27T17:38:47.853113895Z",
"updateTime": "2026-03-27T17:38:47.853113895Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0e777ebc67f4ca45254126a5b9f231b843be516d",
"ref": "refs/heads/main"
}
}
}
[17:38:48.352] Invocation finished in 4h53m51.473422477s with status FAILED