[13:16:28.511] New invocation is queued and will start shortly
[13:16:32.770] Starting the invocation (attempt 1)
[13:16:32.960] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/78313eb309a50a21e6dac6d52ac4c04046c50226"
[13:16:32.960] Popped gitiles commit info from properties and tags
[13:16:32.960] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:16:32.960] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:16:32.961] Buildbucket request:
{
"requestId": "8851330782940088016",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "78313eb309a50a21e6dac6d52ac4c04046c50226",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851330782940088016"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOS"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:16:33.572] Scheduled build:
{
"id": "8685900717479252129",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 35340,
"createdBy": "project:chromium",
"createTime": "2026-03-30T13:16:33.093869947Z",
"updateTime": "2026-03-30T13:16:33.093869947Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "78313eb309a50a21e6dac6d52ac4c04046c50226",
"ref": "refs/heads/main"
}
}
}
[13:16:33.572] Task URL: https://cr-buildbucket.appspot.com/build/8685900717479252129
[13:16:33.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:2:0) after 1m50s
[13:16:34.531] Received PubSub notification, asking Buildbucket for the build status
[13:16:34.593] Build status: SCHEDULED
[13:16:38.406] Received PubSub notification, asking Buildbucket for the build status
[13:16:38.422] Build status: STARTED
[13:18:23.591] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:2:0)
[13:18:23.612] Build status: STARTED
[13:18:23.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:5:0) after 7m14s
[13:25:37.707] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:5:0)
[13:25:37.785] Build status: STARTED
[13:25:37.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:6:0) after 5m22s
[13:30:59.810] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:6:0)
[13:30:59.872] Build status: STARTED
[13:30:59.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:7:0) after 3m59s
[13:34:58.943] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:7:0)
[13:34:59.014] Build status: STARTED
[13:34:59.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:8:0) after 9m4s
[13:44:03.039] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:8:0)
[13:44:03.069] Build status: STARTED
[13:44:03.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:9:0) after 2m16s
[13:46:19.213] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:9:0)
[13:46:19.229] Build status: STARTED
[13:46:19.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:10:0) after 9m33s
[13:55:52.299] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:10:0)
[13:55:52.316] Build status: STARTED
[13:55:52.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:11:0) after 2m36s
[13:58:28.339] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:11:0)
[13:58:28.365] Build status: STARTED
[13:58:28.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:12:0) after 3m23s
[14:01:51.438] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:12:0)
[14:01:51.457] Build status: STARTED
[14:01:51.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:13:0) after 8m14s
[14:10:05.480] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:13:0)
[14:10:05.501] Build status: STARTED
[14:10:05.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:14:0) after 4m41s
[14:14:46.641] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:14:0)
[14:14:46.659] Build status: STARTED
[14:14:46.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:15:0) after 6m49s
[14:21:35.676] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:15:0)
[14:21:35.696] Build status: STARTED
[14:21:35.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:16:0) after 8m33s
[14:30:08.778] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:16:0)
[14:30:08.865] Build status: STARTED
[14:30:08.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:17:0) after 7m30s
[14:37:38.913] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:17:0)
[14:37:38.954] Build status: STARTED
[14:37:38.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:18:0) after 6m6s
[14:43:45.110] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:18:0)
[14:43:45.127] Build status: STARTED
[14:43:45.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:19:0) after 6m6s
[14:49:51.232] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:19:0)
[14:49:51.251] Build status: STARTED
[14:49:51.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:20:0) after 7m58s
[14:57:49.271] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:20:0)
[14:57:49.306] Build status: STARTED
[14:57:49.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:21:0) after 2m54s
[15:00:43.387] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:21:0)
[15:00:43.404] Build status: STARTED
[15:00:43.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:22:0) after 1m53s
[15:02:36.515] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:22:0)
[15:02:36.530] Build status: STARTED
[15:02:36.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:23:0) after 3m11s
[15:05:47.503] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:23:0)
[15:05:47.537] Build status: STARTED
[15:05:47.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:24:0) after 2m26s
[15:08:13.577] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:24:0)
[15:08:13.604] Build status: STARTED
[15:08:13.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:25:0) after 3m32s
[15:11:45.662] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:25:0)
[15:11:45.679] Build status: STARTED
[15:11:45.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:26:0) after 2m18s
[15:14:03.758] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:26:0)
[15:14:03.779] Build status: STARTED
[15:14:03.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:27:0) after 2m2s
[15:16:05.858] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:27:0)
[15:16:05.878] Build status: STARTED
[15:16:05.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:28:0) after 3m32s
[15:19:37.896] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:28:0)
[15:19:37.915] Build status: STARTED
[15:19:37.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:29:0) after 9m23s
[15:29:01.234] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:29:0)
[15:29:01.251] Build status: STARTED
[15:29:01.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:30:0) after 6m1s
[15:35:02.355] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:30:0)
[15:35:02.373] Build status: STARTED
[15:35:02.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:31:0) after 1m46s
[15:36:48.412] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:31:0)
[15:36:48.437] Build status: STARTED
[15:36:48.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:32:0) after 5m11s
[15:41:59.454] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:32:0)
[15:41:59.476] Build status: STARTED
[15:41:59.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:33:0) after 1m2s
[15:43:01.531] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:33:0)
[15:43:01.551] Build status: STARTED
[15:43:01.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:34:0) after 1m35s
[15:44:36.607] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:34:0)
[15:44:36.625] Build status: STARTED
[15:44:36.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:35:0) after 8m27s
[15:53:03.616] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:35:0)
[15:53:03.637] Build status: STARTED
[15:53:03.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:36:0) after 8m18s
[16:01:21.701] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:36:0)
[16:01:21.734] Build status: STARTED
[16:01:21.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:37:0) after 2m49s
[16:04:10.770] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:37:0)
[16:04:10.789] Build status: STARTED
[16:04:10.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:38:0) after 3m13s
[16:07:23.831] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:38:0)
[16:07:23.849] Build status: STARTED
[16:07:23.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:39:0) after 2m42s
[16:10:05.871] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:39:0)
[16:10:05.888] Build status: STARTED
[16:10:05.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:40:0) after 5m9s
[16:15:14.909] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:40:0)
[16:15:14.952] Build status: STARTED
[16:15:14.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:41:0) after 8m36s
[16:23:50.971] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:41:0)
[16:23:50.992] Build status: STARTED
[16:23:50.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:42:0) after 9m49s
[16:33:40.086] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:42:0)
[16:33:40.129] Build status: STARTED
[16:33:40.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:43:0) after 9m43s
[16:43:23.166] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:43:0)
[16:43:23.187] Build status: STARTED
[16:43:23.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:44:0) after 4m39s
[16:48:02.318] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:44:0)
[16:48:02.342] Build status: STARTED
[16:48:02.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:45:0) after 7m23s
[16:55:25.510] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:45:0)
[16:55:25.526] Build status: STARTED
[16:55:25.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:46:0) after 1m42s
[16:57:07.581] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:46:0)
[16:57:07.595] Build status: STARTED
[16:57:07.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:47:0) after 5m16s
[17:02:23.675] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:47:0)
[17:02:23.694] Build status: STARTED
[17:02:23.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:48:0) after 7m6s
[17:09:29.732] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:48:0)
[17:09:29.777] Build status: STARTED
[17:09:29.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:49:0) after 7m37s
[17:17:06.842] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:49:0)
[17:17:06.872] Build status: STARTED
[17:17:06.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:50:0) after 1m35s
[17:18:41.935] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:50:0)
[17:18:41.952] Build status: STARTED
[17:18:41.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:51:0) after 1m32s
[17:20:13.928] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:51:0)
[17:20:13.953] Build status: STARTED
[17:20:13.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:52:0) after 8m34s
[17:28:48.031] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:52:0)
[17:28:48.062] Build status: STARTED
[17:28:48.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:53:0) after 7m39s
[17:36:27.186] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:53:0)
[17:36:27.203] Build status: STARTED
[17:36:27.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:54:0) after 7m47s
[17:44:14.372] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:54:0)
[17:44:14.389] Build status: STARTED
[17:44:14.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:55:0) after 6m19s
[17:50:33.406] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:55:0)
[17:50:33.427] Build status: STARTED
[17:50:33.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:56:0) after 3m12s
[17:53:45.584] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:56:0)
[17:53:45.692] Build status: STARTED
[17:53:45.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:57:0) after 4m20s
[17:58:05.766] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:57:0)
[17:58:05.788] Build status: STARTED
[17:58:05.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:58:0) after 7m38s
[18:05:43.817] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:58:0)
[18:05:43.904] Build status: STARTED
[18:05:43.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:59:0) after 4m25s
[18:10:08.992] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:59:0)
[18:10:09.009] Build status: STARTED
[18:10:09.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:60:0) after 9m21s
[18:19:30.041] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:60:0)
[18:19:30.070] Build status: STARTED
[18:19:30.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:61:0) after 5m18s
[18:24:48.188] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:61:0)
[18:24:48.209] Build status: STARTED
[18:24:48.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8851330782940088016:62:0) after 7m47s
[18:29:50.156] Received PubSub notification, asking Buildbucket for the build status
[18:29:50.178] Build:
{
"id": "8685900717479252129",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 35340,
"createdBy": "project:chromium",
"createTime": "2026-03-30T13:16:33.093869947Z",
"startTime": "2026-03-30T13:16:37.707049385Z",
"endTime": "2026-03-30T18:29:49.843470766Z",
"updateTime": "2026-03-30T18:29:49.843470766Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "78313eb309a50a21e6dac6d52ac4c04046c50226",
"ref": "refs/heads/main"
}
}
}
[18:29:50.178] Invocation finished in 5h13m21.676393855s with status FAILED