[22:10:36.460] New invocation is queued and will start shortly
[22:10:37.708] Starting the invocation (attempt 1)
[22:10:37.747] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f2bfb2e7beaaccbf64279b98d1b2efb2cb304051"
[22:10:37.747] Popped gitiles commit info from properties and tags
[22:10:37.747] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:10:37.747] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:10:37.747] Buildbucket request:
{
"requestId": "8849213447998293488",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f2bfb2e7beaaccbf64279b98d1b2efb2cb304051",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8849213447998293488"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:10:38.501] Scheduled build:
{
"id": "8683783385920937665",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 41282,
"createdBy": "project:chromium",
"createTime": "2026-04-22T22:10:37.819408506Z",
"updateTime": "2026-04-22T22:10:37.819408506Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f2bfb2e7beaaccbf64279b98d1b2efb2cb304051",
"ref": "refs/heads/main"
}
},
"canary": true
}
[22:10:38.501] Task URL: https://cr-buildbucket.appspot.com/build/8683783385920937665
[22:10:38.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:2:0) after 5m38s
[22:10:39.189] Received PubSub notification, asking Buildbucket for the build status
[22:10:39.213] Build status: SCHEDULED
[22:10:42.216] Received PubSub notification, asking Buildbucket for the build status
[22:10:42.294] Build status: STARTED
[22:16:16.633] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:2:0)
[22:16:16.848] Build status: STARTED
[22:16:16.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:5:0) after 3m12s
[22:19:28.877] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:5:0)
[22:19:28.901] Build status: STARTED
[22:19:28.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:6:0) after 1m54s
[22:21:22.935] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:6:0)
[22:21:22.953] Build status: STARTED
[22:21:22.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:7:0) after 4m26s
[22:25:49.024] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:7:0)
[22:25:49.065] Build status: STARTED
[22:25:49.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:8:0) after 7m36s
[22:33:25.061] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:8:0)
[22:33:25.104] Build status: STARTED
[22:33:25.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:9:0) after 6m0s
[22:39:25.235] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:9:0)
[22:39:25.269] Build status: STARTED
[22:39:25.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:10:0) after 2m21s
[22:41:46.353] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:10:0)
[22:41:46.382] Build status: STARTED
[22:41:46.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:11:0) after 2m1s
[22:43:47.389] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:11:0)
[22:43:47.407] Build status: STARTED
[22:43:47.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:12:0) after 4m39s
[22:48:26.522] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:12:0)
[22:48:26.661] Build status: STARTED
[22:48:26.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:13:0) after 3m37s
[22:52:03.757] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:13:0)
[22:52:03.774] Build status: STARTED
[22:52:03.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:14:0) after 2m16s
[22:54:19.839] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:14:0)
[22:54:19.861] Build status: STARTED
[22:54:19.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:15:0) after 6m27s
[23:00:46.927] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:15:0)
[23:00:46.983] Build status: STARTED
[23:00:46.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:16:0) after 8m9s
[23:08:56.008] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:16:0)
[23:08:56.039] Build status: STARTED
[23:08:56.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:17:0) after 8m0s
[23:16:56.060] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:17:0)
[23:16:56.077] Build status: STARTED
[23:16:56.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:18:0) after 7m1s
[23:23:57.198] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:18:0)
[23:23:57.213] Build status: STARTED
[23:23:57.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:19:0) after 4m40s
[23:28:37.228] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:19:0)
[23:28:37.243] Build status: STARTED
[23:28:37.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:20:0) after 7m10s
[23:35:47.431] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:20:0)
[23:35:50.066] Build status: STARTED
[23:35:50.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:21:0) after 4m36s
[23:40:26.103] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:21:0)
[23:40:26.120] Build status: STARTED
[23:40:26.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:22:0) after 8m10s
[23:48:36.180] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:22:0)
[23:48:36.201] Build status: STARTED
[23:48:36.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:23:0) after 7m56s
[23:56:32.361] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:23:0)
[23:56:32.381] Build status: STARTED
[23:56:32.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:24:0) after 9m44s
[00:06:16.401] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:24:0)
[00:06:16.414] Build status: STARTED
[00:06:16.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:25:0) after 3m32s
[00:09:48.414] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:25:0)
[00:09:48.435] Build status: STARTED
[00:09:48.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:26:0) after 5m43s
[00:15:31.491] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:26:0)
[00:15:31.508] Build status: STARTED
[00:15:31.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:27:0) after 2m28s
[00:17:59.576] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:27:0)
[00:17:59.600] Build status: STARTED
[00:17:59.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:28:0) after 6m55s
[00:24:54.660] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:28:0)
[00:24:54.677] Build status: STARTED
[00:24:54.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:29:0) after 1m51s
[00:26:45.749] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:29:0)
[00:26:45.778] Build status: STARTED
[00:26:45.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:30:0) after 1m23s
[00:28:08.798] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:30:0)
[00:28:08.820] Build status: STARTED
[00:28:08.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:31:0) after 6m15s
[00:34:23.837] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:31:0)
[00:34:23.862] Build status: STARTED
[00:34:23.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:32:0) after 4m52s
[00:39:16.003] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:32:0)
[00:39:16.022] Build status: STARTED
[00:39:16.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:33:0) after 7m9s
[00:46:25.039] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:33:0)
[00:46:25.057] Build status: STARTED
[00:46:25.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:34:0) after 9m18s
[00:55:43.112] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:34:0)
[00:55:43.136] Build status: STARTED
[00:55:43.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:35:0) after 2m33s
[00:58:16.215] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:35:0)
[00:58:16.234] Build status: STARTED
[00:58:16.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:36:0) after 5m34s
[01:03:50.240] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:36:0)
[01:03:50.275] Build status: STARTED
[01:03:50.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:37:0) after 8m21s
[01:12:11.387] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:37:0)
[01:12:11.437] Build status: STARTED
[01:12:11.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:38:0) after 6m58s
[01:19:09.581] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:38:0)
[01:19:09.650] Build status: STARTED
[01:19:09.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:39:0) after 9m13s
[01:28:22.919] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:39:0)
[01:28:22.986] Build status: STARTED
[01:28:22.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:40:0) after 9m10s
[01:37:33.036] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:40:0)
[01:37:33.062] Build status: STARTED
[01:37:33.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:41:0) after 1m0s
[01:38:33.235] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:41:0)
[01:38:33.255] Build status: STARTED
[01:38:33.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:42:0) after 9m46s
[01:48:19.276] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:42:0)
[01:48:19.299] Build status: STARTED
[01:48:19.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:43:0) after 5m14s
[01:53:33.314] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:43:0)
[01:53:33.331] Build status: STARTED
[01:53:33.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:44:0) after 2m42s
[01:56:15.352] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:44:0)
[01:56:15.408] Build status: STARTED
[01:56:15.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:45:0) after 8m15s
[02:04:30.478] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:45:0)
[02:04:30.493] Build status: STARTED
[02:04:30.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:46:0) after 5m26s
[02:09:56.549] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:46:0)
[02:09:56.574] Build status: STARTED
[02:09:56.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:47:0) after 9m45s
[02:19:41.590] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:47:0)
[02:19:41.607] Build status: STARTED
[02:19:41.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:48:0) after 5m59s
[02:25:40.767] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:48:0)
[02:25:40.795] Build status: STARTED
[02:25:40.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:49:0) after 4m35s
[02:30:15.815] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:49:0)
[02:30:15.833] Build status: STARTED
[02:30:15.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:50:0) after 5m14s
[02:35:29.896] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:50:0)
[02:35:29.915] Build status: STARTED
[02:35:29.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:51:0) after 6m8s
[02:41:37.914] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:51:0)
[02:41:37.935] Build status: STARTED
[02:41:37.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:52:0) after 1m33s
[02:43:11.094] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:52:0)
[02:43:11.121] Build status: STARTED
[02:43:11.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:53:0) after 5m32s
[02:48:43.198] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:53:0)
[02:48:43.215] Build status: STARTED
[02:48:43.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:54:0) after 2m44s
[02:51:27.232] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:54:0)
[02:51:27.251] Build status: STARTED
[02:51:27.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8849213447998293488:55:0) after 5m32s
[02:53:57.671] Received PubSub notification, asking Buildbucket for the build status
[02:53:57.689] Build:
{
"id": "8683783385920937665",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 41282,
"createdBy": "project:chromium",
"createTime": "2026-04-22T22:10:37.819408506Z",
"startTime": "2026-04-22T22:10:41.965131450Z",
"endTime": "2026-04-23T02:53:57.262053801Z",
"updateTime": "2026-04-23T02:53:57.262053801Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f2bfb2e7beaaccbf64279b98d1b2efb2cb304051",
"ref": "refs/heads/main"
}
},
"canary": true
}
[02:53:57.689] Invocation finished in 4h43m21.234299389s with status FAILED