[21:57:52.405] New invocation is queued and will start shortly
[21:57:53.543] Starting the invocation (attempt 1)
[21:57:53.570] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f2a4a5f3d1f1790e9255a1898c0c33672a6db130"
[21:57:53.570] Popped gitiles commit info from properties and tags
[21:57:53.570] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:57:53.570] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:57:53.570] Buildbucket request:
{
"requestId": "8851660367268802288",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f2a4a5f3d1f1790e9255a1898c0c33672a6db130",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851660367268802288"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:57:54.037] Scheduled build:
{
"id": "8686230305329271825",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 41130,
"createdBy": "project:chromium",
"createTime": "2026-03-26T21:57:53.625946967Z",
"updateTime": "2026-03-26T21:57:53.625946967Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f2a4a5f3d1f1790e9255a1898c0c33672a6db130",
"ref": "refs/heads/main"
}
}
}
[21:57:54.037] Task URL: https://cr-buildbucket.appspot.com/build/8686230305329271825
[21:57:54.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:2:0) after 4m55s
[21:57:54.981] Received PubSub notification, asking Buildbucket for the build status
[21:57:55.008] Build status: SCHEDULED
[21:58:31.015] Received PubSub notification, asking Buildbucket for the build status
[21:58:31.033] Build status: STARTED
[22:02:49.152] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:2:0)
[22:02:49.173] Build status: STARTED
[22:02:49.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:5:0) after 7m8s
[22:09:57.467] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:5:0)
[22:09:57.489] Build status: STARTED
[22:09:57.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:6:0) after 1m14s
[22:11:11.603] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:6:0)
[22:11:11.629] Build status: STARTED
[22:11:11.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:7:0) after 4m25s
[22:15:36.635] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:7:0)
[22:15:36.653] Build status: STARTED
[22:15:36.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:8:0) after 9m32s
[22:25:08.858] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:8:0)
[22:25:08.874] Build status: STARTED
[22:25:08.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:9:0) after 9m7s
[22:34:16.009] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:9:0)
[22:34:16.023] Build status: STARTED
[22:34:16.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:10:0) after 7m6s
[22:41:22.230] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:10:0)
[22:41:22.248] Build status: STARTED
[22:41:22.248] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:11:0) after 2m45s
[22:44:07.598] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:11:0)
[22:44:07.619] Build status: STARTED
[22:44:07.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:12:0) after 8m6s
[22:52:13.654] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:12:0)
[22:52:13.673] Build status: STARTED
[22:52:13.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:13:0) after 1m30s
[22:53:43.763] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:13:0)
[22:53:43.780] Build status: STARTED
[22:53:43.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:14:0) after 1m35s
[22:55:19.001] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:14:0)
[22:55:19.032] Build status: STARTED
[22:55:19.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:15:0) after 7m48s
[23:03:07.050] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:15:0)
[23:03:07.071] Build status: STARTED
[23:03:07.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:16:0) after 5m14s
[23:08:21.175] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:16:0)
[23:08:21.203] Build status: STARTED
[23:08:21.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:17:0) after 7m30s
[23:15:51.260] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:17:0)
[23:15:51.291] Build status: STARTED
[23:15:51.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:18:0) after 6m55s
[23:22:46.469] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:18:0)
[23:22:46.519] Build status: STARTED
[23:22:46.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:19:0) after 8m44s
[23:31:30.532] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:19:0)
[23:31:30.549] Build status: STARTED
[23:31:30.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:20:0) after 7m31s
[23:39:01.604] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:20:0)
[23:39:01.626] Build status: STARTED
[23:39:01.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:21:0) after 7m47s
[23:46:48.695] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:21:0)
[23:46:48.714] Build status: STARTED
[23:46:48.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:22:0) after 1m9s
[23:47:57.862] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:22:0)
[23:47:57.885] Build status: STARTED
[23:47:57.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:23:0) after 8m12s
[23:56:09.920] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:23:0)
[23:56:10.069] Build status: STARTED
[23:56:10.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:24:0) after 8m11s
[00:04:21.135] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:24:0)
[00:04:21.199] Build status: STARTED
[00:04:21.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:25:0) after 9m16s
[00:13:37.261] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:25:0)
[00:13:37.277] Build status: STARTED
[00:13:37.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:26:0) after 9m44s
[00:23:21.344] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:26:0)
[00:23:21.359] Build status: STARTED
[00:23:21.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:27:0) after 3m0s
[00:26:21.350] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:27:0)
[00:26:21.369] Build status: STARTED
[00:26:21.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:28:0) after 7m29s
[00:33:50.358] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:28:0)
[00:33:50.377] Build status: STARTED
[00:33:50.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:29:0) after 9m14s
[00:43:04.390] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:29:0)
[00:43:04.406] Build status: STARTED
[00:43:04.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:30:0) after 3m39s
[00:46:43.375] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:30:0)
[00:46:43.401] Build status: STARTED
[00:46:43.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:31:0) after 7m59s
[00:54:42.529] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:31:0)
[00:54:42.555] Build status: STARTED
[00:54:42.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:32:0) after 7m31s
[01:02:13.716] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:32:0)
[01:02:13.735] Build status: STARTED
[01:02:13.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:33:0) after 1m25s
[01:03:38.826] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:33:0)
[01:03:38.848] Build status: STARTED
[01:03:38.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:34:0) after 4m57s
[01:08:35.914] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:34:0)
[01:08:35.936] Build status: STARTED
[01:08:35.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:35:0) after 3m37s
[01:12:13.014] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:35:0)
[01:12:13.068] Build status: STARTED
[01:12:13.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:36:0) after 2m54s
[01:15:07.136] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:36:0)
[01:15:07.156] Build status: STARTED
[01:15:07.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:37:0) after 5m54s
[01:21:01.220] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:37:0)
[01:21:01.243] Build status: STARTED
[01:21:01.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8851660367268802288:38:0) after 9m57s
[01:24:38.726] Received PubSub notification, asking Buildbucket for the build status
[01:24:38.743] Build:
{
"id": "8686230305329271825",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 41130,
"createdBy": "project:chromium",
"createTime": "2026-03-26T21:57:53.625946967Z",
"startTime": "2026-03-26T21:58:30.844143128Z",
"endTime": "2026-03-27T01:24:38.401615496Z",
"updateTime": "2026-03-27T01:24:38.401615496Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f2a4a5f3d1f1790e9255a1898c0c33672a6db130",
"ref": "refs/heads/main"
}
}
}
[01:24:38.743] Invocation finished in 3h26m46.351026503s with status FAILED