[07:17:25.444] New invocation is queued and will start shortly
[07:17:26.597] Starting the invocation (attempt 1)
[07:17:26.630] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/20b8f9e878117ff749effb968c65263a18f5d365"
[07:17:26.630] Popped gitiles commit info from properties and tags
[07:17:26.630] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[07:17:26.630] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[07:17:26.630] Buildbucket request:
{
"requestId": "8876901717001074960",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "20b8f9e878117ff749effb968c65263a18f5d365",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8876901717001074960"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[07:17:27.409] Scheduled build:
{
"id": "8711471655053134865",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38615,
"createdBy": "project:chromium",
"createTime": "2025-06-21T07:17:26.682521802Z",
"updateTime": "2025-06-21T07:17:26.682521802Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "20b8f9e878117ff749effb968c65263a18f5d365",
"ref": "refs/heads/main"
}
}
}
[07:17:27.409] Task URL: https://cr-buildbucket.appspot.com/build/8711471655053134865
[07:17:27.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:2:0) after 3m45s
[07:17:27.621] Received PubSub notification, asking Buildbucket for the build status
[07:17:27.642] Build status: SCHEDULED
[07:17:30.894] Received PubSub notification, asking Buildbucket for the build status
[07:17:30.923] Build status: STARTED
[07:21:12.432] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:2:0)
[07:21:12.453] Build status: STARTED
[07:21:12.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:5:0) after 5m43s
[07:26:55.474] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:5:0)
[07:26:55.499] Build status: STARTED
[07:26:55.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:6:0) after 6m32s
[07:33:27.522] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:6:0)
[07:33:27.548] Build status: STARTED
[07:33:27.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:7:0) after 3m38s
[07:37:05.566] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:7:0)
[07:37:05.597] Build status: STARTED
[07:37:05.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:8:0) after 4m6s
[07:41:11.614] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:8:0)
[07:41:11.724] Build status: STARTED
[07:41:11.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:9:0) after 1m56s
[07:43:07.741] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:9:0)
[07:43:07.770] Build status: STARTED
[07:43:07.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:10:0) after 7m33s
[07:50:40.836] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:10:0)
[07:50:40.858] Build status: STARTED
[07:50:40.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:11:0) after 2m31s
[07:53:11.874] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:11:0)
[07:53:11.892] Build status: STARTED
[07:53:11.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:12:0) after 9m6s
[08:02:18.028] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:12:0)
[08:02:18.045] Build status: STARTED
[08:02:18.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:13:0) after 4m21s
[08:06:39.119] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:13:0)
[08:06:39.216] Build status: STARTED
[08:06:39.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:14:0) after 1m23s
[08:08:02.282] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:14:0)
[08:08:02.297] Build status: STARTED
[08:08:02.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:15:0) after 3m54s
[08:11:56.493] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:15:0)
[08:11:56.515] Build status: STARTED
[08:11:56.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:16:0) after 5m55s
[08:17:51.531] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:16:0)
[08:17:51.548] Build status: STARTED
[08:17:51.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:17:0) after 2m18s
[08:20:09.570] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:17:0)
[08:20:09.594] Build status: STARTED
[08:20:09.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:18:0) after 8m3s
[08:28:12.582] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:18:0)
[08:28:12.598] Build status: STARTED
[08:28:12.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:19:0) after 7m24s
[08:35:36.707] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:19:0)
[08:35:36.748] Build status: STARTED
[08:35:36.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:20:0) after 6m7s
[08:41:43.882] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:20:0)
[08:41:43.899] Build status: STARTED
[08:41:43.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:21:0) after 2m58s
[08:44:41.920] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:21:0)
[08:44:41.948] Build status: STARTED
[08:44:41.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:22:0) after 9m1s
[08:53:43.091] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:22:0)
[08:53:43.113] Build status: STARTED
[08:53:43.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:23:0) after 2m46s
[08:56:29.354] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:23:0)
[08:56:29.381] Build status: STARTED
[08:56:29.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:24:0) after 8m49s
[09:05:18.405] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:24:0)
[09:05:18.422] Build status: STARTED
[09:05:18.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:25:0) after 8m17s
[09:13:35.723] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:25:0)
[09:13:35.748] Build status: STARTED
[09:13:35.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:26:0) after 1m53s
[09:15:28.771] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:26:0)
[09:15:28.794] Build status: STARTED
[09:15:28.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:27:0) after 7m16s
[09:22:44.811] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:27:0)
[09:22:44.866] Build status: STARTED
[09:22:44.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:28:0) after 5m9s
[09:27:54.034] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:28:0)
[09:27:54.056] Build status: STARTED
[09:27:54.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:29:0) after 2m0s
[09:29:54.081] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:29:0)
[09:29:54.101] Build status: STARTED
[09:29:54.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:30:0) after 1m25s
[09:31:19.241] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:30:0)
[09:31:19.265] Build status: STARTED
[09:31:19.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:31:0) after 5m11s
[09:36:30.397] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:31:0)
[09:36:30.685] Build status: STARTED
[09:36:30.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:32:0) after 3m17s
[09:39:47.711] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:32:0)
[09:39:47.735] Build status: STARTED
[09:39:47.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:33:0) after 4m42s
[09:44:29.927] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:33:0)
[09:44:29.944] Build status: STARTED
[09:44:29.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:34:0) after 6m42s
[09:51:12.048] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:34:0)
[09:51:12.069] Build status: STARTED
[09:51:12.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:35:0) after 2m11s
[09:53:23.086] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:35:0)
[09:53:23.149] Build status: STARTED
[09:53:23.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:36:0) after 6m8s
[09:59:31.271] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:36:0)
[09:59:31.358] Build status: STARTED
[09:59:31.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:37:0) after 3m55s
[10:03:26.383] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:37:0)
[10:03:26.402] Build status: STARTED
[10:03:26.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:38:0) after 6m24s
[10:09:50.474] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:38:0)
[10:09:50.491] Build status: STARTED
[10:09:50.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:39:0) after 4m48s
[10:14:38.498] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:39:0)
[10:14:38.517] Build status: STARTED
[10:14:38.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:40:0) after 2m1s
[10:16:39.567] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:40:0)
[10:16:39.584] Build status: STARTED
[10:16:39.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:41:0) after 8m59s
[10:25:38.802] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:41:0)
[10:25:38.819] Build status: STARTED
[10:25:38.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:42:0) after 5m8s
[10:30:47.007] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:42:0)
[10:30:47.026] Build status: STARTED
[10:30:47.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:43:0) after 5m51s
[10:36:38.127] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:43:0)
[10:36:38.144] Build status: STARTED
[10:36:38.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:44:0) after 4m10s
[10:40:48.545] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:44:0)
[10:40:48.570] Build status: STARTED
[10:40:48.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:45:0) after 3m29s
[10:44:17.564] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:45:0)
[10:44:17.586] Build status: STARTED
[10:44:17.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:46:0) after 3m26s
[10:47:43.575] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:46:0)
[10:47:43.602] Build status: STARTED
[10:47:43.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:47:0) after 4m44s
[10:52:27.890] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:47:0)
[10:52:27.911] Build status: STARTED
[10:52:27.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:48:0) after 4m23s
[10:56:50.977] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:48:0)
[10:56:51.005] Build status: STARTED
[10:56:51.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:49:0) after 5m6s
[11:01:57.030] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:49:0)
[11:01:57.100] Build status: STARTED
[11:01:57.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876901717001074960:50:0) after 7m11s
[11:03:26.608] Received PubSub notification, asking Buildbucket for the build status
[11:03:26.625] Build:
{
"id": "8711471655053134865",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38615,
"createdBy": "project:chromium",
"createTime": "2025-06-21T07:17:26.682521802Z",
"startTime": "2025-06-21T07:17:30.591189026Z",
"endTime": "2025-06-21T11:03:26.311489574Z",
"updateTime": "2025-06-21T11:03:26.311489574Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "20b8f9e878117ff749effb968c65263a18f5d365",
"ref": "refs/heads/main"
}
}
}
[11:03:26.625] Invocation finished in 3h46m1.183783926s with status FAILED