[03:28:50.484] New invocation is queued and will start shortly
[03:28:51.561] Starting the invocation (attempt 1)
[03:28:51.584] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/71b627b1c0503eae066977e9371277d14977d26f"
[03:28:51.584] Popped gitiles commit info from properties and tags
[03:28:51.584] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:28:51.585] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:28:51.585] Buildbucket request:
{
"requestId": "8833067166442793152",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "71b627b1c0503eae066977e9371277d14977d26f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8833067166442793152"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOS"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:28:52.114] Scheduled build:
{
"id": "8667637104532386017",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 38341,
"createdBy": "project:chromium",
"createTime": "2026-10-18T03:28:51.685822325Z",
"updateTime": "2026-10-18T03:28:51.685822325Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "71b627b1c0503eae066977e9371277d14977d26f",
"ref": "refs/heads/main"
}
}
}
[03:28:52.114] Task URL: https://cr-buildbucket.appspot.com/build/8667637104532386017
[03:28:52.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:2:0) after 4m43s
[03:28:53.143] Received PubSub notification, asking Buildbucket for the build status
[03:28:53.176] Build status: SCHEDULED
[03:29:34.728] Received PubSub notification, asking Buildbucket for the build status
[03:29:34.786] Build status: STARTED
[03:33:35.130] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:2:0)
[03:33:35.160] Build status: STARTED
[03:33:35.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:5:0) after 1m30s
[03:35:05.176] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:5:0)
[03:35:05.205] Build status: STARTED
[03:35:05.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:6:0) after 6m2s
[03:41:07.247] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:6:0)
[03:41:07.278] Build status: STARTED
[03:41:07.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:7:0) after 9m38s
[03:50:45.596] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:7:0)
[03:50:45.619] Build status: STARTED
[03:50:45.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:8:0) after 1m56s
[03:52:41.633] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:8:0)
[03:52:41.688] Build status: STARTED
[03:52:41.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:9:0) after 2m30s
[03:55:11.787] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:9:0)
[03:55:11.852] Build status: STARTED
[03:55:11.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:10:0) after 9m15s
[04:04:26.878] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:10:0)
[04:04:26.911] Build status: STARTED
[04:04:26.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:11:0) after 1m49s
[04:06:16.052] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:11:0)
[04:06:16.070] Build status: STARTED
[04:06:16.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:12:0) after 7m40s
[04:13:56.086] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:12:0)
[04:13:56.106] Build status: STARTED
[04:13:56.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:13:0) after 2m31s
[04:16:27.250] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:13:0)
[04:16:27.276] Build status: STARTED
[04:16:27.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:14:0) after 7m34s
[04:24:01.288] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:14:0)
[04:24:01.304] Build status: STARTED
[04:24:01.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:15:0) after 5m32s
[04:29:33.382] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:15:0)
[04:29:33.423] Build status: STARTED
[04:29:33.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:16:0) after 8m4s
[04:37:37.437] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:16:0)
[04:37:37.456] Build status: STARTED
[04:37:37.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:17:0) after 5m40s
[04:43:17.471] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:17:0)
[04:43:17.495] Build status: STARTED
[04:43:17.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:18:0) after 2m17s
[04:45:34.697] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:18:0)
[04:45:34.761] Build status: STARTED
[04:45:34.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:19:0) after 5m23s
[04:50:57.778] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:19:0)
[04:50:57.818] Build status: STARTED
[04:50:57.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:20:0) after 1m7s
[04:52:05.032] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:20:0)
[04:52:05.054] Build status: STARTED
[04:52:05.054] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:21:0) after 4m39s
[04:56:44.090] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:21:0)
[04:56:44.114] Build status: STARTED
[04:56:44.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:22:0) after 2m47s
[04:59:31.261] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:22:0)
[04:59:31.323] Build status: STARTED
[04:59:31.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:23:0) after 3m44s
[05:03:15.430] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:23:0)
[05:03:15.450] Build status: STARTED
[05:03:15.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:24:0) after 8m56s
[05:12:11.570] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:24:0)
[05:12:11.605] Build status: STARTED
[05:12:11.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:25:0) after 3m29s
[05:15:40.630] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:25:0)
[05:15:40.649] Build status: STARTED
[05:15:40.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:26:0) after 5m10s
[05:20:50.765] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:26:0)
[05:20:50.786] Build status: STARTED
[05:20:50.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:27:0) after 5m34s
[05:26:24.826] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:27:0)
[05:26:24.843] Build status: STARTED
[05:26:24.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:28:0) after 9m10s
[05:35:34.935] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:28:0)
[05:35:34.953] Build status: STARTED
[05:35:34.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:29:0) after 7m15s
[05:42:50.034] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:29:0)
[05:42:50.059] Build status: STARTED
[05:42:50.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:30:0) after 4m9s
[05:46:59.201] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:30:0)
[05:46:59.218] Build status: STARTED
[05:46:59.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:31:0) after 9m21s
[05:56:20.239] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:31:0)
[05:56:20.263] Build status: STARTED
[05:56:20.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:32:0) after 4m47s
[06:01:07.280] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:32:0)
[06:01:07.320] Build status: STARTED
[06:01:07.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:33:0) after 6m26s
[06:07:33.343] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:33:0)
[06:07:33.371] Build status: STARTED
[06:07:33.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:34:0) after 9m16s
[06:16:49.464] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:34:0)
[06:16:49.483] Build status: STARTED
[06:16:49.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:35:0) after 1m55s
[06:18:44.482] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:35:0)
[06:18:44.526] Build status: STARTED
[06:18:44.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:36:0) after 3m45s
[06:22:30.057] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:36:0)
[06:22:30.083] Build status: STARTED
[06:22:30.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:37:0) after 4m53s
[06:27:23.101] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:37:0)
[06:27:23.120] Build status: STARTED
[06:27:23.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:38:0) after 6m55s
[06:34:18.233] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:38:0)
[06:34:18.287] Build status: STARTED
[06:34:18.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:39:0) after 8m2s
[06:42:20.374] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:39:0)
[06:42:20.489] Build status: STARTED
[06:42:20.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:40:0) after 2m12s
[06:44:32.606] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:40:0)
[06:44:32.629] Build status: STARTED
[06:44:32.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:41:0) after 2m20s
[06:46:52.652] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:41:0)
[06:46:52.686] Build status: STARTED
[06:46:52.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:42:0) after 5m50s
[06:52:42.703] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:42:0)
[06:52:42.721] Build status: STARTED
[06:52:42.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:43:0) after 5m17s
[06:57:59.859] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:43:0)
[06:57:59.877] Build status: STARTED
[06:57:59.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:44:0) after 3m16s
[07:01:15.890] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:44:0)
[07:01:15.921] Build status: STARTED
[07:01:15.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:45:0) after 4m30s
[07:05:46.111] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:45:0)
[07:05:46.133] Build status: STARTED
[07:05:46.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:46:0) after 6m12s
[07:11:58.198] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:46:0)
[07:11:58.214] Build status: STARTED
[07:11:58.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:47:0) after 9m26s
[07:21:24.309] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:47:0)
[07:21:24.333] Build status: STARTED
[07:21:24.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:48:0) after 8m37s
[07:30:01.717] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:48:0)
[07:30:01.881] Build status: STARTED
[07:30:01.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:49:0) after 9m2s
[07:39:04.059] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:49:0)
[07:39:04.183] Build status: STARTED
[07:39:04.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:50:0) after 2m37s
[07:41:41.398] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:50:0)
[07:41:41.415] Build status: STARTED
[07:41:41.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:51:0) after 3m9s
[07:44:50.694] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:51:0)
[07:44:50.716] Build status: STARTED
[07:44:50.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:52:0) after 9m3s
[07:53:53.748] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:52:0)
[07:53:53.766] Build status: STARTED
[07:53:53.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:53:0) after 9m40s
[08:03:33.934] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:53:0)
[08:03:33.969] Build status: STARTED
[08:03:33.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:54:0) after 6m37s
[08:10:11.118] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:54:0)
[08:10:11.134] Build status: STARTED
[08:10:11.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:55:0) after 2m3s
[08:12:14.265] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:55:0)
[08:12:14.285] Build status: STARTED
[08:12:14.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:56:0) after 4m45s
[08:16:59.271] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:56:0)
[08:16:59.310] Build status: STARTED
[08:16:59.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:57:0) after 1m48s
[08:18:47.326] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:57:0)
[08:18:47.342] Build status: STARTED
[08:18:47.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:58:0) after 6m18s
[08:25:05.359] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:58:0)
[08:25:05.424] Build status: STARTED
[08:25:05.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8833067166442793152:59:0) after 8m11s
[08:31:23.411] Received PubSub notification, asking Buildbucket for the build status
[08:31:23.434] Build:
{
"id": "8667637104532386017",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 38341,
"createdBy": "project:chromium",
"createTime": "2026-10-18T03:28:51.685822325Z",
"startTime": "2026-10-18T03:29:34.572341502Z",
"endTime": "2026-10-18T08:31:05.603102425Z",
"updateTime": "2026-10-18T08:31:05.603102425Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "71b627b1c0503eae066977e9371277d14977d26f",
"ref": "refs/heads/main"
}
}
}
[08:31:23.434] Invocation finished in 5h2m32.954590741s with status FAILED