[20:54:00.486] New invocation is queued and will start shortly
[20:54:01.527] Starting the invocation (attempt 1)
[20:54:01.556] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9ba54cde863d0261072475e3e4b3cdbc9c448728"
[20:54:01.556] Popped gitiles commit info from properties and tags
[20:54:01.556] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:54:01.556] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:54:01.556] Buildbucket request:
{
"requestId": "8876487954123106272",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9ba54cde863d0261072475e3e4b3cdbc9c448728",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8876487954123106272"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:54:02.355] Scheduled build:
{
"id": "8711057892120312881",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38644,
"createdBy": "project:chromium",
"createTime": "2025-06-25T20:54:01.764400792Z",
"updateTime": "2025-06-25T20:54:01.764400792Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9ba54cde863d0261072475e3e4b3cdbc9c448728",
"ref": "refs/heads/main"
}
}
}
[20:54:02.355] Task URL: https://cr-buildbucket.appspot.com/build/8711057892120312881
[20:54:02.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:2:0) after 5m29s
[20:54:03.314] Received PubSub notification, asking Buildbucket for the build status
[20:54:03.339] Build status: SCHEDULED
[20:54:05.906] Received PubSub notification, asking Buildbucket for the build status
[20:54:05.940] Build status: STARTED
[20:59:31.425] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:2:0)
[20:59:31.455] Build status: STARTED
[20:59:31.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:5:0) after 7m32s
[21:07:03.515] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:5:0)
[21:07:03.534] Build status: STARTED
[21:07:03.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:6:0) after 6m37s
[21:13:40.559] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:6:0)
[21:13:40.585] Build status: STARTED
[21:13:40.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:7:0) after 2m55s
[21:16:35.773] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:7:0)
[21:16:35.792] Build status: STARTED
[21:16:35.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:8:0) after 8m55s
[21:25:30.918] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:8:0)
[21:25:30.935] Build status: STARTED
[21:25:30.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:9:0) after 3m10s
[21:28:40.958] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:9:0)
[21:28:41.017] Build status: STARTED
[21:28:41.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:10:0) after 8m26s
[21:37:07.036] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:10:0)
[21:37:07.056] Build status: STARTED
[21:37:07.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:11:0) after 3m45s
[21:40:52.177] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:11:0)
[21:40:52.191] Build status: STARTED
[21:40:52.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:12:0) after 5m35s
[21:46:27.289] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:12:0)
[21:46:27.307] Build status: STARTED
[21:46:27.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:13:0) after 6m35s
[21:53:02.346] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:13:0)
[21:53:02.368] Build status: STARTED
[21:53:02.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:14:0) after 1m46s
[21:54:48.404] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:14:0)
[21:54:48.426] Build status: STARTED
[21:54:48.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:15:0) after 3m5s
[21:57:53.445] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:15:0)
[21:57:53.467] Build status: STARTED
[21:57:53.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:16:0) after 3m53s
[22:01:46.468] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:16:0)
[22:01:46.520] Build status: STARTED
[22:01:46.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:17:0) after 1m54s
[22:03:40.587] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:17:0)
[22:03:40.608] Build status: STARTED
[22:03:40.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:18:0) after 1m16s
[22:04:56.634] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:18:0)
[22:04:56.653] Build status: STARTED
[22:04:56.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:19:0) after 4m50s
[22:09:46.656] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:19:0)
[22:09:46.712] Build status: STARTED
[22:09:46.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:20:0) after 5m2s
[22:14:48.731] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:20:0)
[22:14:48.750] Build status: STARTED
[22:14:48.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:21:0) after 5m11s
[22:19:59.768] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:21:0)
[22:19:59.784] Build status: STARTED
[22:19:59.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:22:0) after 1m48s
[22:21:47.767] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:22:0)
[22:21:47.789] Build status: STARTED
[22:21:47.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:23:0) after 3m45s
[22:25:32.815] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:23:0)
[22:25:32.836] Build status: STARTED
[22:25:32.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:24:0) after 7m26s
[22:32:58.956] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:24:0)
[22:32:58.981] Build status: STARTED
[22:32:58.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:25:0) after 7m50s
[22:40:49.008] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:25:0)
[22:40:49.032] Build status: STARTED
[22:40:49.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:26:0) after 3m59s
[22:44:48.116] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:26:0)
[22:44:48.133] Build status: STARTED
[22:44:48.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:27:0) after 6m38s
[22:51:26.181] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:27:0)
[22:51:26.202] Build status: STARTED
[22:51:26.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:28:0) after 7m30s
[22:58:56.228] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:28:0)
[22:58:56.248] Build status: STARTED
[22:58:56.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:29:0) after 9m19s
[23:08:15.280] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:29:0)
[23:08:15.352] Build status: STARTED
[23:08:15.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:30:0) after 8m25s
[23:16:40.527] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:30:0)
[23:16:40.759] Build status: STARTED
[23:16:40.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:31:0) after 1m46s
[23:18:26.785] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:31:0)
[23:18:26.800] Build status: STARTED
[23:18:26.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:32:0) after 2m28s
[23:20:54.775] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:32:0)
[23:20:54.790] Build status: STARTED
[23:20:54.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:33:0) after 4m30s
[23:25:24.825] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:33:0)
[23:25:24.858] Build status: STARTED
[23:25:24.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:34:0) after 7m52s
[23:33:16.928] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:34:0)
[23:33:16.944] Build status: STARTED
[23:33:16.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:35:0) after 1m24s
[23:34:41.020] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:35:0)
[23:34:41.044] Build status: STARTED
[23:34:41.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:36:0) after 4m43s
[23:39:24.063] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:36:0)
[23:39:24.083] Build status: STARTED
[23:39:24.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:37:0) after 3m11s
[23:42:35.256] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:37:0)
[23:42:35.344] Build status: STARTED
[23:42:35.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:38:0) after 8m12s
[23:50:47.371] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:38:0)
[23:50:47.388] Build status: STARTED
[23:50:47.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:39:0) after 3m49s
[23:54:36.442] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:39:0)
[23:54:36.464] Build status: STARTED
[23:54:36.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:40:0) after 1m20s
[23:55:56.539] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:40:0)
[23:55:56.555] Build status: STARTED
[23:55:56.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:41:0) after 8m41s
[00:04:37.547] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:41:0)
[00:04:37.561] Build status: STARTED
[00:04:37.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:42:0) after 7m24s
[00:12:01.769] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:42:0)
[00:12:01.787] Build status: STARTED
[00:12:01.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:43:0) after 9m48s
[00:21:49.853] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:43:0)
[00:21:49.917] Build status: STARTED
[00:21:49.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:44:0) after 5m44s
[00:27:34.063] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:44:0)
[00:27:34.086] Build status: STARTED
[00:27:34.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:45:0) after 8m53s
[00:36:27.113] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:45:0)
[00:36:27.138] Build status: STARTED
[00:36:27.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876487954123106272:46:0) after 7m40s
[00:42:45.687] Received PubSub notification, asking Buildbucket for the build status
[00:42:45.706] Build:
{
"id": "8711057892120312881",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38644,
"createdBy": "project:chromium",
"createTime": "2025-06-25T20:54:01.764400792Z",
"startTime": "2025-06-25T20:54:05.682936614Z",
"endTime": "2025-06-26T00:42:41.626572187Z",
"updateTime": "2025-06-26T00:42:41.626572187Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9ba54cde863d0261072475e3e4b3cdbc9c448728",
"ref": "refs/heads/main"
}
}
}
[00:42:45.706] Invocation finished in 3h48m45.23517359s with status FAILED