[02:16:38.961] New invocation is queued and will start shortly
[02:16:40.090] Starting the invocation (attempt 1)
[02:16:40.121] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/b9b1dccfbff550ef8ec887bd1b23278b78143ccb"
[02:16:40.121] Popped gitiles commit info from properties and tags
[02:16:40.121] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:16:40.121] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:16:40.121] Buildbucket request:
{
"requestId": "8875742879558688912",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b9b1dccfbff550ef8ec887bd1b23278b78143ccb",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8875742879558688912"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:16:40.673] Scheduled build:
{
"id": "8710312817625689201",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38749,
"createdBy": "project:chromium",
"createTime": "2025-07-04T02:16:40.174966351Z",
"updateTime": "2025-07-04T02:16:40.174966351Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b9b1dccfbff550ef8ec887bd1b23278b78143ccb",
"ref": "refs/heads/main"
}
}
}
[02:16:40.673] Task URL: https://cr-buildbucket.appspot.com/build/8710312817625689201
[02:16:40.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:2:0) after 9m1s
[02:16:41.769] Received PubSub notification, asking Buildbucket for the build status
[02:16:41.793] Build status: SCHEDULED
[02:16:43.888] Received PubSub notification, asking Buildbucket for the build status
[02:16:43.910] Build status: STARTED
[02:25:41.764] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:2:0)
[02:25:41.795] Build status: STARTED
[02:25:41.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:5:0) after 3m52s
[02:29:34.139] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:5:0)
[02:29:34.160] Build status: STARTED
[02:29:34.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:6:0) after 1m1s
[02:30:35.323] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:6:0)
[02:30:35.389] Build status: STARTED
[02:30:35.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:7:0) after 4m47s
[02:35:22.478] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:7:0)
[02:35:22.522] Build status: STARTED
[02:35:22.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:8:0) after 9m38s
[02:45:00.728] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:8:0)
[02:45:00.787] Build status: STARTED
[02:45:00.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:9:0) after 3m25s
[02:48:25.842] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:9:0)
[02:48:25.858] Build status: STARTED
[02:48:25.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:10:0) after 5m30s
[02:53:55.884] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:10:0)
[02:53:55.909] Build status: STARTED
[02:53:55.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:11:0) after 9m11s
[03:03:06.983] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:11:0)
[03:03:07.007] Build status: STARTED
[03:03:07.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:12:0) after 3m25s
[03:06:32.082] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:12:0)
[03:06:32.133] Build status: STARTED
[03:06:32.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:13:0) after 3m14s
[03:09:46.247] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:13:0)
[03:09:46.270] Build status: STARTED
[03:09:46.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:14:0) after 8m5s
[03:17:51.528] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:14:0)
[03:17:51.556] Build status: STARTED
[03:17:51.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:15:0) after 3m59s
[03:21:50.573] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:15:0)
[03:21:50.594] Build status: STARTED
[03:21:50.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:16:0) after 1m10s
[03:23:00.768] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:16:0)
[03:23:00.879] Build status: STARTED
[03:23:00.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:17:0) after 8m50s
[03:31:51.016] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:17:0)
[03:31:51.036] Build status: STARTED
[03:31:51.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:18:0) after 4m16s
[03:36:07.058] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:18:0)
[03:36:07.085] Build status: STARTED
[03:36:07.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:19:0) after 7m1s
[03:43:08.103] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:19:0)
[03:43:08.130] Build status: STARTED
[03:43:08.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:20:0) after 2m44s
[03:45:52.276] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:20:0)
[03:45:52.354] Build status: STARTED
[03:45:52.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:21:0) after 5m17s
[03:51:09.377] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:21:0)
[03:51:09.401] Build status: STARTED
[03:51:09.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:22:0) after 5m58s
[03:57:07.426] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:22:0)
[03:57:07.455] Build status: STARTED
[03:57:07.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:23:0) after 6m4s
[04:03:11.477] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:23:0)
[04:03:11.498] Build status: STARTED
[04:03:11.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:24:0) after 5m57s
[04:09:09.062] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:24:0)
[04:09:09.082] Build status: STARTED
[04:09:09.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:25:0) after 8m13s
[04:17:22.123] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:25:0)
[04:17:22.154] Build status: STARTED
[04:17:22.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:26:0) after 5m46s
[04:23:08.148] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:26:0)
[04:23:08.178] Build status: STARTED
[04:23:08.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:27:0) after 9m46s
[04:32:54.307] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:27:0)
[04:32:54.378] Build status: STARTED
[04:32:54.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:28:0) after 2m43s
[04:35:37.471] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:28:0)
[04:35:37.494] Build status: STARTED
[04:35:37.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:29:0) after 7m54s
[04:43:31.582] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:29:0)
[04:43:31.604] Build status: STARTED
[04:43:31.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:30:0) after 6m51s
[04:50:22.627] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:30:0)
[04:50:22.649] Build status: STARTED
[04:50:22.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:31:0) after 7m19s
[04:57:41.894] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:31:0)
[04:57:41.930] Build status: STARTED
[04:57:41.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:32:0) after 7m56s
[05:05:38.156] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:32:0)
[05:05:38.185] Build status: STARTED
[05:05:38.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:33:0) after 1m31s
[05:07:09.214] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:33:0)
[05:07:09.239] Build status: STARTED
[05:07:09.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:34:0) after 6m32s
[05:13:41.260] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:34:0)
[05:13:41.282] Build status: STARTED
[05:13:41.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:35:0) after 2m23s
[05:16:04.306] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:35:0)
[05:16:04.337] Build status: STARTED
[05:16:04.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:36:0) after 7m19s
[05:23:23.804] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:36:0)
[05:23:23.831] Build status: STARTED
[05:23:23.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:37:0) after 8m8s
[05:31:31.855] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:37:0)
[05:31:31.899] Build status: STARTED
[05:31:31.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:38:0) after 1m21s
[05:32:52.908] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:38:0)
[05:32:52.940] Build status: STARTED
[05:32:52.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:39:0) after 1m7s
[05:33:59.954] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:39:0)
[05:33:59.981] Build status: STARTED
[05:33:59.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:40:0) after 1m22s
[05:35:22.101] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:40:0)
[05:35:22.132] Build status: STARTED
[05:35:22.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:41:0) after 4m57s
[05:40:19.179] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:41:0)
[05:40:19.200] Build status: STARTED
[05:40:19.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:42:0) after 7m3s
[05:47:22.227] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:42:0)
[05:47:22.248] Build status: STARTED
[05:47:22.248] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:43:0) after 6m54s
[05:54:16.317] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:43:0)
[05:54:16.335] Build status: STARTED
[05:54:16.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:44:0) after 4m3s
[05:58:19.392] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:44:0)
[05:58:19.407] Build status: STARTED
[05:58:19.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:45:0) after 5m22s
[06:03:41.655] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:45:0)
[06:03:41.682] Build status: STARTED
[06:03:41.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8875742879558688912:46:0) after 5m23s
[06:05:27.603] Received PubSub notification, asking Buildbucket for the build status
[06:05:27.739] Build:
{
"id": "8710312817625689201",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38749,
"createdBy": "project:chromium",
"createTime": "2025-07-04T02:16:40.174966351Z",
"startTime": "2025-07-04T02:16:43.686058160Z",
"endTime": "2025-07-04T06:05:25.275782392Z",
"updateTime": "2025-07-04T06:05:25.275782392Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b9b1dccfbff550ef8ec887bd1b23278b78143ccb",
"ref": "refs/heads/main"
}
}
}
[06:05:27.739] Invocation finished in 3h48m48.792240576s with status FAILED