[02:37:48.595] New invocation is queued and will start shortly
[02:37:49.924] Starting the invocation (attempt 1)
[02:37:49.950] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/45f069c1aa8d37d09c0f985cc19632146a4d71f0"
[02:37:49.951] Popped gitiles commit info from properties and tags
[02:37:49.951] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:37:49.951] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:37:49.951] Buildbucket request:
{
"requestId": "8878550054208688544",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "45f069c1aa8d37d09c0f985cc19632146a4d71f0",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8878550054208688544"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:37:50.433] Scheduled build:
{
"id": "8713119992062960113",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38421,
"createdBy": "project:chromium",
"createTime": "2025-06-03T02:37:50.011450536Z",
"updateTime": "2025-06-03T02:37:50.011450536Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "45f069c1aa8d37d09c0f985cc19632146a4d71f0",
"ref": "refs/heads/main"
}
}
}
[02:37:50.433] Task URL: https://cr-buildbucket.appspot.com/build/8713119992062960113
[02:37:50.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:2:0) after 9m42s
[02:38:26.768] Received PubSub notification, asking Buildbucket for the build status
[02:38:26.789] Build status: STARTED
[02:38:29.462] Received PubSub notification, asking Buildbucket for the build status
[02:38:29.490] Build status: STARTED
[02:47:32.443] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:2:0)
[02:47:32.492] Build status: STARTED
[02:47:32.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:5:0) after 2m40s
[02:50:12.519] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:5:0)
[02:50:12.538] Build status: STARTED
[02:50:12.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:6:0) after 9m55s
[03:00:07.557] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:6:0)
[03:00:07.581] Build status: STARTED
[03:00:07.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:7:0) after 8m5s
[03:08:12.697] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:7:0)
[03:08:12.724] Build status: STARTED
[03:08:12.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:8:0) after 6m19s
[03:14:31.852] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:8:0)
[03:14:31.931] Build status: STARTED
[03:14:31.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:9:0) after 1m47s
[03:16:19.071] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:9:0)
[03:16:21.037] Build status: STARTED
[03:16:21.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:10:0) after 8m14s
[03:24:35.060] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:10:0)
[03:24:35.087] Build status: STARTED
[03:24:35.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:11:0) after 2m44s
[03:27:19.132] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:11:0)
[03:27:19.156] Build status: STARTED
[03:27:19.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:12:0) after 9m7s
[03:36:26.199] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:12:0)
[03:36:26.225] Build status: STARTED
[03:36:26.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:13:0) after 3m49s
[03:40:15.312] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:13:0)
[03:40:15.396] Build status: STARTED
[03:40:15.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:14:0) after 6m20s
[03:46:35.428] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:14:0)
[03:46:35.452] Build status: STARTED
[03:46:35.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:15:0) after 5m50s
[03:52:25.477] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:15:0)
[03:52:25.509] Build status: STARTED
[03:52:25.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:16:0) after 6m12s
[03:58:37.532] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:16:0)
[03:58:37.556] Build status: STARTED
[03:58:37.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:17:0) after 3m12s
[04:01:49.550] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:17:0)
[04:01:49.574] Build status: STARTED
[04:01:49.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:18:0) after 5m34s
[04:07:23.605] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:18:0)
[04:07:23.623] Build status: STARTED
[04:07:23.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:19:0) after 2m30s
[04:09:53.696] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:19:0)
[04:09:53.776] Build status: STARTED
[04:09:53.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:20:0) after 6m23s
[04:16:16.775] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:20:0)
[04:16:16.810] Build status: STARTED
[04:16:16.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:21:0) after 8m42s
[04:24:58.869] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:21:0)
[04:24:58.883] Build status: STARTED
[04:24:58.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:22:0) after 2m36s
[04:27:34.980] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:22:0)
[04:27:34.995] Build status: STARTED
[04:27:34.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:23:0) after 1m6s
[04:28:40.965] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:23:0)
[04:28:41.020] Build status: STARTED
[04:28:41.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:24:0) after 5m5s
[04:33:46.043] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:24:0)
[04:33:46.063] Build status: STARTED
[04:33:46.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:25:0) after 4m10s
[04:37:56.066] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:25:0)
[04:37:56.093] Build status: STARTED
[04:37:56.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:26:0) after 7m4s
[04:45:00.111] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:26:0)
[04:45:00.136] Build status: STARTED
[04:45:00.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:27:0) after 5m29s
[04:50:29.120] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:27:0)
[04:50:29.137] Build status: STARTED
[04:50:29.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:28:0) after 9m17s
[04:59:46.205] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:28:0)
[04:59:46.223] Build status: STARTED
[04:59:46.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:29:0) after 3m35s
[05:03:21.244] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:29:0)
[05:03:21.276] Build status: STARTED
[05:03:21.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:30:0) after 8m40s
[05:12:01.402] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:30:0)
[05:12:01.430] Build status: STARTED
[05:12:01.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:31:0) after 7m15s
[05:19:16.440] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:31:0)
[05:19:16.458] Build status: STARTED
[05:19:16.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:32:0) after 7m26s
[05:26:42.504] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:32:0)
[05:26:42.563] Build status: STARTED
[05:26:42.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:33:0) after 9m38s
[05:36:20.635] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:33:0)
[05:36:20.659] Build status: STARTED
[05:36:20.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:34:0) after 3m38s
[05:39:58.675] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:34:0)
[05:39:58.688] Build status: STARTED
[05:39:58.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:35:0) after 4m30s
[05:44:28.805] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:35:0)
[05:44:28.821] Build status: STARTED
[05:44:28.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:36:0) after 5m42s
[05:50:10.989] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:36:0)
[05:50:11.362] Build status: STARTED
[05:50:11.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:37:0) after 5m10s
[05:55:21.378] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:37:0)
[05:55:21.404] Build status: STARTED
[05:55:21.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:38:0) after 6m15s
[06:01:36.427] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:38:0)
[06:01:36.443] Build status: STARTED
[06:01:36.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:39:0) after 1m4s
[06:02:40.466] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:39:0)
[06:02:40.482] Build status: STARTED
[06:02:40.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:40:0) after 6m37s
[06:09:17.488] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:40:0)
[06:09:17.507] Build status: STARTED
[06:09:17.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:41:0) after 9m51s
[06:19:08.560] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:41:0)
[06:19:08.618] Build status: STARTED
[06:19:08.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:42:0) after 5m36s
[06:24:44.691] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:42:0)
[06:24:44.715] Build status: STARTED
[06:24:44.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8878550054208688544:43:0) after 6m8s
[06:25:46.463] Received PubSub notification, asking Buildbucket for the build status
[06:25:46.479] Build:
{
"id": "8713119992062960113",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38421,
"createdBy": "project:chromium",
"createTime": "2025-06-03T02:37:50.011450536Z",
"startTime": "2025-06-03T02:37:53.597904344Z",
"endTime": "2025-06-03T06:25:46.209217479Z",
"updateTime": "2025-06-03T06:25:46.209217479Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "45f069c1aa8d37d09c0f985cc19632146a4d71f0",
"ref": "refs/heads/main"
}
}
}
[06:25:46.479] Invocation finished in 3h47m57.89762677s with status FAILED