[02:12:31.721] New invocation is queued and will start shortly
[02:12:32.953] Starting the invocation (attempt 1)
[02:12:33.012] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/b2e0060c790a77ca4bfe6a50426ccc66cb401c6a"
[02:12:33.012] Popped gitiles commit info from properties and tags
[02:12:33.012] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:12:33.012] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:12:33.012] Buildbucket request:
{
"requestId": "8833162564591514752",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b2e0060c790a77ca4bfe6a50426ccc66cb401c6a",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8833162564591514752"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOS"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:12:33.808] Scheduled build:
{
"id": "8667732502501573009",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 38336,
"createdBy": "project:chromium",
"createTime": "2026-10-17T02:12:33.092196307Z",
"updateTime": "2026-10-17T02:12:33.092196307Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b2e0060c790a77ca4bfe6a50426ccc66cb401c6a",
"ref": "refs/heads/main"
}
}
}
[02:12:33.808] Task URL: https://cr-buildbucket.appspot.com/build/8667732502501573009
[02:12:33.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:2:0) after 4m44s
[02:12:34.665] Received PubSub notification, asking Buildbucket for the build status
[02:12:34.680] Build status: SCHEDULED
[02:12:37.739] Received PubSub notification, asking Buildbucket for the build status
[02:12:37.784] Build status: STARTED
[02:17:17.874] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:2:0)
[02:17:17.930] Build status: STARTED
[02:17:17.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:5:0) after 7m29s
[02:24:46.977] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:5:0)
[02:24:47.024] Build status: STARTED
[02:24:47.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:6:0) after 4m49s
[02:29:36.047] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:6:0)
[02:29:36.071] Build status: STARTED
[02:29:36.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:7:0) after 8m29s
[02:38:05.128] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:7:0)
[02:38:05.179] Build status: STARTED
[02:38:05.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:8:0) after 2m12s
[02:40:17.276] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:8:0)
[02:40:17.294] Build status: STARTED
[02:40:17.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:9:0) after 5m25s
[02:46:30.838] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:9:0)
[02:46:30.905] Build status: STARTED
[02:46:30.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:10:0) after 5m44s
[02:52:14.935] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:10:0)
[02:52:14.958] Build status: STARTED
[02:52:14.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:11:0) after 4m19s
[02:56:34.097] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:11:0)
[02:56:34.121] Build status: STARTED
[02:56:34.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:12:0) after 4m27s
[03:01:01.136] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:12:0)
[03:01:01.157] Build status: STARTED
[03:01:01.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:13:0) after 3m44s
[03:04:45.374] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:13:0)
[03:04:45.393] Build status: STARTED
[03:04:45.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:14:0) after 5m25s
[03:10:10.583] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:14:0)
[03:10:10.618] Build status: STARTED
[03:10:10.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:15:0) after 8m38s
[03:18:48.724] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:15:0)
[03:18:48.747] Build status: STARTED
[03:18:48.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:16:0) after 8m24s
[03:27:12.768] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:16:0)
[03:27:12.837] Build status: STARTED
[03:27:12.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:17:0) after 9m44s
[03:36:56.860] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:17:0)
[03:36:56.898] Build status: STARTED
[03:36:56.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:18:0) after 3m12s
[03:40:23.345] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:18:0)
[03:40:23.449] Build status: STARTED
[03:40:23.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:19:0) after 6m16s
[03:46:39.447] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:19:0)
[03:46:39.465] Build status: STARTED
[03:46:39.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:20:0) after 2m3s
[03:48:42.527] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:20:0)
[03:48:42.570] Build status: STARTED
[03:48:42.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:21:0) after 2m12s
[03:50:54.592] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:21:0)
[03:50:54.614] Build status: STARTED
[03:50:54.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:22:0) after 1m26s
[03:52:20.635] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:22:0)
[03:52:20.652] Build status: STARTED
[03:52:20.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:23:0) after 4m8s
[03:56:28.670] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:23:0)
[03:56:28.690] Build status: STARTED
[03:56:28.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:24:0) after 2m42s
[03:59:10.709] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:24:0)
[03:59:10.729] Build status: STARTED
[03:59:10.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:25:0) after 3m19s
[04:02:29.796] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:25:0)
[04:02:29.899] Build status: STARTED
[04:02:29.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:26:0) after 1m34s
[04:04:03.924] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:26:0)
[04:04:03.948] Build status: STARTED
[04:04:03.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:27:0) after 5m22s
[04:09:25.999] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:27:0)
[04:09:26.015] Build status: STARTED
[04:09:26.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:28:0) after 1m42s
[04:11:08.276] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:28:0)
[04:11:08.299] Build status: STARTED
[04:11:08.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:29:0) after 7m59s
[04:19:07.422] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:29:0)
[04:19:07.445] Build status: STARTED
[04:19:07.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:30:0) after 5m11s
[04:24:18.470] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:30:0)
[04:24:18.496] Build status: STARTED
[04:24:18.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:31:0) after 8m44s
[04:33:02.598] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:31:0)
[04:33:02.621] Build status: STARTED
[04:33:02.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:32:0) after 6m21s
[04:39:23.706] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:32:0)
[04:39:23.724] Build status: STARTED
[04:39:23.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:33:0) after 7m48s
[04:47:11.778] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:33:0)
[04:47:11.800] Build status: STARTED
[04:47:11.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:34:0) after 4m27s
[04:51:38.823] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:34:0)
[04:51:38.847] Build status: STARTED
[04:51:38.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:35:0) after 1m46s
[04:53:24.864] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:35:0)
[04:53:24.887] Build status: STARTED
[04:53:24.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:36:0) after 5m11s
[04:58:35.906] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:36:0)
[04:58:35.935] Build status: STARTED
[04:58:35.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:37:0) after 3m40s
[05:02:15.964] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:37:0)
[05:02:15.984] Build status: STARTED
[05:02:15.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:38:0) after 5m24s
[05:07:40.095] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:38:0)
[05:07:40.116] Build status: STARTED
[05:07:40.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:39:0) after 9m20s
[05:17:00.162] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:39:0)
[05:17:00.199] Build status: STARTED
[05:17:00.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:40:0) after 2m15s
[05:19:15.210] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:40:0)
[05:19:15.238] Build status: STARTED
[05:19:15.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:41:0) after 9m9s
[05:28:24.259] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:41:0)
[05:28:24.278] Build status: STARTED
[05:28:24.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:42:0) after 7m52s
[05:36:16.407] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:42:0)
[05:36:16.616] Build status: STARTED
[05:36:16.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:43:0) after 3m44s
[05:40:00.692] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:43:0)
[05:40:00.710] Build status: STARTED
[05:40:00.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:44:0) after 3m24s
[05:43:24.824] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:44:0)
[05:43:24.895] Build status: STARTED
[05:43:24.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:45:0) after 4m3s
[05:47:27.916] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:45:0)
[05:47:27.936] Build status: STARTED
[05:47:27.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:46:0) after 6m55s
[05:54:23.105] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:46:0)
[05:54:23.135] Build status: STARTED
[05:54:23.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:47:0) after 1m57s
[05:56:20.199] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:47:0)
[05:56:20.233] Build status: STARTED
[05:56:20.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:48:0) after 6m33s
[06:02:53.264] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:48:0)
[06:02:53.295] Build status: STARTED
[06:02:53.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:49:0) after 1m13s
[06:04:06.329] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:49:0)
[06:04:06.350] Build status: STARTED
[06:04:06.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:50:0) after 3m4s
[06:07:10.375] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:50:0)
[06:07:10.411] Build status: STARTED
[06:07:10.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:51:0) after 5m7s
[06:12:17.475] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:51:0)
[06:12:17.730] Build status: STARTED
[06:12:17.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:52:0) after 3m16s
[06:15:33.802] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:52:0)
[06:15:33.826] Build status: STARTED
[06:15:33.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:53:0) after 6m8s
[06:21:41.850] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:53:0)
[06:21:41.871] Build status: STARTED
[06:21:41.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:54:0) after 7m54s
[06:29:35.892] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:54:0)
[06:29:35.958] Build status: STARTED
[06:29:35.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:55:0) after 5m2s
[06:34:38.028] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:55:0)
[06:34:38.056] Build status: STARTED
[06:34:38.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:56:0) after 4m12s
[06:38:50.132] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:56:0)
[06:38:50.151] Build status: STARTED
[06:38:50.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:57:0) after 8m25s
[06:47:15.176] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:57:0)
[06:47:15.192] Build status: STARTED
[06:47:15.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:58:0) after 8m31s
[06:55:46.454] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:58:0)
[06:55:46.485] Build status: STARTED
[06:55:46.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:59:0) after 2m44s
[06:58:30.521] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:59:0)
[06:58:30.564] Build status: STARTED
[06:58:30.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:60:0) after 1m43s
[07:00:14.049] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:60:0)
[07:00:14.080] Build status: STARTED
[07:00:14.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:61:0) after 3m40s
[07:03:54.101] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:61:0)
[07:03:54.159] Build status: STARTED
[07:03:54.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:62:0) after 2m14s
[07:06:08.180] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:62:0)
[07:06:08.203] Build status: STARTED
[07:06:08.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:63:0) after 4m29s
[07:10:37.226] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:63:0)
[07:10:37.330] Build status: STARTED
[07:10:37.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833162564591514752:64:0) after 8m14s
[07:14:16.397] Received PubSub notification, asking Buildbucket for the build status
[07:14:16.416] Build:
{
"id": "8667732502501573009",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 38336,
"createdBy": "project:chromium",
"createTime": "2026-10-17T02:12:33.092196307Z",
"startTime": "2026-10-17T02:12:37.483194596Z",
"endTime": "2026-10-17T07:14:16.080614013Z",
"updateTime": "2026-10-17T07:14:16.080614013Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b2e0060c790a77ca4bfe6a50426ccc66cb401c6a",
"ref": "refs/heads/main"
}
}
}
[07:14:16.416] Invocation finished in 5h1m44.701635654s with status FAILED