[16:59:58.057] New invocation is queued and will start shortly
[16:59:59.132] Starting the invocation (attempt 1)
[16:59:59.161] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f3374975170b00ca25dd2796e9993c2915bd9507"
[16:59:59.161] Popped gitiles commit info from properties and tags
[16:59:59.161] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:59:59.162] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:59:59.162] Buildbucket request:
{
"requestId": "8835462252885134688",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f3374975170b00ca25dd2796e9993c2915bd9507",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8835462252885134688"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:59:59.985] Scheduled build:
{
"id": "8670032190998143377",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 43516,
"createdBy": "project:chromium",
"createTime": "2026-09-21T16:59:59.237247955Z",
"updateTime": "2026-09-21T16:59:59.237247955Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f3374975170b00ca25dd2796e9993c2915bd9507",
"ref": "refs/heads/main"
}
},
"canary": true
}
[16:59:59.985] Task URL: https://cr-buildbucket.appspot.com/build/8670032190998143377
[16:59:59.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:2:0) after 2m58s
[17:00:08.216] Received PubSub notification, asking Buildbucket for the build status
[17:00:08.253] Build status: SCHEDULED
[17:00:23.438] Received PubSub notification, asking Buildbucket for the build status
[17:00:23.456] Build status: STARTED
[17:02:58.068] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:2:0)
[17:02:58.093] Build status: STARTED
[17:02:58.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:5:0) after 7m59s
[17:10:57.079] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:5:0)
[17:10:57.165] Build status: STARTED
[17:10:57.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:6:0) after 6m7s
[17:17:04.285] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:6:0)
[17:17:04.657] Build status: STARTED
[17:17:04.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:7:0) after 1m49s
[17:18:53.679] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:7:0)
[17:18:53.693] Build status: STARTED
[17:18:53.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:8:0) after 4m25s
[17:23:18.714] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:8:0)
[17:23:18.779] Build status: STARTED
[17:23:18.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:9:0) after 1m17s
[17:24:35.798] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:9:0)
[17:24:35.881] Build status: STARTED
[17:24:35.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:10:0) after 7m38s
[17:32:13.915] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:10:0)
[17:32:13.932] Build status: STARTED
[17:32:13.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:11:0) after 7m56s
[17:40:09.951] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:11:0)
[17:40:09.980] Build status: STARTED
[17:40:09.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:12:0) after 6m16s
[17:46:26.005] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:12:0)
[17:46:26.026] Build status: STARTED
[17:46:26.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:13:0) after 5m21s
[17:51:47.050] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:13:0)
[17:51:47.067] Build status: STARTED
[17:51:47.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:14:0) after 1m17s
[17:53:04.162] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:14:0)
[17:53:04.223] Build status: STARTED
[17:53:04.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:15:0) after 2m17s
[17:55:21.475] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:15:0)
[17:55:21.503] Build status: STARTED
[17:55:21.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:16:0) after 6m45s
[18:02:06.569] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:16:0)
[18:02:06.592] Build status: STARTED
[18:02:06.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:17:0) after 5m4s
[18:07:10.644] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:17:0)
[18:07:10.668] Build status: STARTED
[18:07:10.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:18:0) after 8m2s
[18:15:12.746] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:18:0)
[18:15:12.765] Build status: STARTED
[18:15:12.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:19:0) after 5m50s
[18:21:02.910] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:19:0)
[18:21:02.938] Build status: STARTED
[18:21:02.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:20:0) after 6m18s
[18:27:20.962] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:20:0)
[18:27:20.991] Build status: STARTED
[18:27:20.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:21:0) after 8m3s
[18:35:24.011] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:21:0)
[18:35:24.039] Build status: STARTED
[18:35:24.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:22:0) after 1m44s
[18:37:08.058] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:22:0)
[18:37:08.090] Build status: STARTED
[18:37:08.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:23:0) after 9m44s
[18:46:52.118] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:23:0)
[18:46:52.148] Build status: STARTED
[18:46:52.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:24:0) after 1m55s
[18:48:47.265] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:24:0)
[18:48:47.288] Build status: STARTED
[18:48:47.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:25:0) after 3m3s
[18:51:50.313] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:25:0)
[18:51:50.334] Build status: STARTED
[18:51:50.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:26:0) after 2m46s
[18:54:36.366] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:26:0)
[18:54:36.391] Build status: STARTED
[18:54:36.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:27:0) after 3m45s
[18:58:21.375] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:27:0)
[18:58:21.399] Build status: STARTED
[18:58:21.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:28:0) after 8m4s
[19:06:25.448] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:28:0)
[19:06:25.473] Build status: STARTED
[19:06:25.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:29:0) after 1m27s
[19:07:52.490] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:29:0)
[19:07:52.509] Build status: STARTED
[19:07:52.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:30:0) after 4m54s
[19:12:46.531] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:30:0)
[19:12:46.553] Build status: STARTED
[19:12:46.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:31:0) after 7m22s
[19:20:08.573] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:31:0)
[19:20:08.648] Build status: STARTED
[19:20:08.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:32:0) after 7m0s
[19:27:08.669] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:32:0)
[19:27:08.687] Build status: STARTED
[19:27:08.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:33:0) after 8m46s
[19:35:54.770] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:33:0)
[19:35:54.790] Build status: STARTED
[19:35:54.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:34:0) after 3m42s
[19:39:36.809] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:34:0)
[19:39:36.864] Build status: STARTED
[19:39:36.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:35:0) after 3m40s
[19:43:16.884] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:35:0)
[19:43:17.023] Build status: STARTED
[19:43:17.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:36:0) after 2m42s
[19:45:59.147] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:36:0)
[19:45:59.168] Build status: STARTED
[19:45:59.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:37:0) after 7m50s
[19:53:49.208] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:37:0)
[19:53:49.226] Build status: STARTED
[19:53:49.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:38:0) after 6m15s
[20:00:04.273] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:38:0)
[20:00:04.295] Build status: STARTED
[20:00:04.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:39:0) after 5m11s
[20:05:15.378] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:39:0)
[20:05:15.398] Build status: STARTED
[20:05:15.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:40:0) after 2m43s
[20:07:58.528] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:40:0)
[20:07:58.550] Build status: STARTED
[20:07:58.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:41:0) after 8m35s
[20:16:33.615] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:41:0)
[20:16:33.655] Build status: STARTED
[20:16:33.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:42:0) after 7m3s
[20:23:36.765] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:42:0)
[20:23:36.869] Build status: STARTED
[20:23:36.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:43:0) after 8m42s
[20:32:18.942] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:43:0)
[20:32:18.960] Build status: STARTED
[20:32:18.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:44:0) after 5m56s
[20:38:14.980] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:44:0)
[20:38:15.004] Build status: STARTED
[20:38:15.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:45:0) after 1m53s
[20:40:08.033] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:45:0)
[20:40:08.084] Build status: STARTED
[20:40:08.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:46:0) after 1m2s
[20:41:10.180] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:46:0)
[20:41:10.198] Build status: STARTED
[20:41:10.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:47:0) after 5m44s
[20:46:54.204] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:47:0)
[20:46:54.222] Build status: STARTED
[20:46:54.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:48:0) after 1m35s
[20:48:29.241] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:48:0)
[20:48:29.271] Build status: STARTED
[20:48:29.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:49:0) after 3m31s
[20:52:00.265] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:49:0)
[20:52:00.283] Build status: STARTED
[20:52:00.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:50:0) after 2m17s
[20:54:17.330] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:50:0)
[20:54:17.349] Build status: STARTED
[20:54:17.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:51:0) after 9m55s
[21:04:12.426] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:51:0)
[21:04:12.447] Build status: STARTED
[21:04:12.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:52:0) after 3m34s
[21:07:46.477] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:52:0)
[21:07:46.500] Build status: STARTED
[21:07:46.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:53:0) after 4m53s
[21:12:39.502] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:53:0)
[21:12:39.519] Build status: STARTED
[21:12:39.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:54:0) after 8m40s
[21:21:19.550] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:54:0)
[21:21:19.576] Build status: STARTED
[21:21:19.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:55:0) after 7m50s
[21:29:09.611] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:55:0)
[21:29:09.635] Build status: STARTED
[21:29:09.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:56:0) after 7m46s
[21:36:55.658] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:56:0)
[21:36:55.683] Build status: STARTED
[21:36:55.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:57:0) after 4m59s
[21:41:54.706] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:57:0)
[21:41:54.729] Build status: STARTED
[21:41:54.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:58:0) after 5m57s
[21:47:51.722] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:58:0)
[21:47:51.741] Build status: STARTED
[21:47:51.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:59:0) after 2m4s
[21:49:55.757] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:59:0)
[21:49:55.781] Build status: STARTED
[21:49:55.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:60:0) after 3m46s
[21:53:41.800] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:60:0)
[21:53:41.865] Build status: STARTED
[21:53:41.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8835462252885134688:61:0) after 8m39s
[21:55:41.463] Received PubSub notification, asking Buildbucket for the build status
[21:55:41.493] Build:
{
"id": "8670032190998143377",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 43516,
"createdBy": "project:chromium",
"createTime": "2026-09-21T16:59:59.237247955Z",
"startTime": "2026-09-21T17:00:14.458819847Z",
"endTime": "2026-09-21T21:55:40.988063425Z",
"updateTime": "2026-09-21T21:55:40.988063425Z",
"status": "SUCCESS",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f3374975170b00ca25dd2796e9993c2915bd9507",
"ref": "refs/heads/main"
}
},
"canary": true
}
[21:55:41.493] Invocation finished in 4h55m43.439826414s with status SUCCEEDED