[22:25:26.262] New invocation is queued and will start shortly
[22:25:27.335] Starting the invocation (attempt 1)
[22:25:27.359] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/ad93092d1522988e5fd369bae5d28be82cb7a117"
[22:25:27.360] Popped gitiles commit info from properties and tags
[22:25:27.360] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:25:27.362] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:25:27.362] Buildbucket request:
{
"requestId": "8876029217034958560",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ad93092d1522988e5fd369bae5d28be82cb7a117",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8876029217034958560"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:25:27.827] Scheduled build:
{
"id": "8710599155164725297",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38729,
"createdBy": "project:chromium",
"createTime": "2025-06-30T22:25:27.417499495Z",
"updateTime": "2025-06-30T22:25:27.417499495Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ad93092d1522988e5fd369bae5d28be82cb7a117",
"ref": "refs/heads/main"
}
}
}
[22:25:27.827] Task URL: https://cr-buildbucket.appspot.com/build/8710599155164725297
[22:25:27.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:2:0) after 1m48s
[22:25:28.817] Received PubSub notification, asking Buildbucket for the build status
[22:25:28.842] Build status: SCHEDULED
[22:25:31.227] Received PubSub notification, asking Buildbucket for the build status
[22:25:31.251] Build status: STARTED
[22:27:15.857] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:2:0)
[22:27:15.889] Build status: STARTED
[22:27:15.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:5:0) after 7m7s
[22:34:22.898] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:5:0)
[22:34:22.921] Build status: STARTED
[22:34:22.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:6:0) after 3m4s
[22:37:26.999] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:6:0)
[22:37:27.019] Build status: STARTED
[22:37:27.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:7:0) after 4m50s
[22:42:17.030] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:7:0)
[22:42:17.049] Build status: STARTED
[22:42:17.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:8:0) after 9m28s
[22:51:45.047] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:8:0)
[22:51:45.071] Build status: STARTED
[22:51:45.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:9:0) after 5m28s
[22:57:13.096] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:9:0)
[22:57:13.111] Build status: STARTED
[22:57:13.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:10:0) after 8m20s
[23:05:33.209] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:10:0)
[23:05:33.235] Build status: STARTED
[23:05:33.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:11:0) after 4m37s
[23:10:10.273] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:11:0)
[23:10:10.299] Build status: STARTED
[23:10:10.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:12:0) after 1m2s
[23:11:12.400] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:12:0)
[23:11:12.430] Build status: STARTED
[23:11:12.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:13:0) after 2m15s
[23:13:27.419] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:13:0)
[23:13:27.432] Build status: STARTED
[23:13:27.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:14:0) after 3m19s
[23:16:46.448] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:14:0)
[23:16:46.475] Build status: STARTED
[23:16:46.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:15:0) after 3m13s
[23:19:59.522] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:15:0)
[23:19:59.548] Build status: STARTED
[23:19:59.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:16:0) after 2m50s
[23:22:49.615] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:16:0)
[23:22:49.636] Build status: STARTED
[23:22:49.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:17:0) after 6m55s
[23:29:44.676] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:17:0)
[23:29:44.717] Build status: STARTED
[23:29:44.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:18:0) after 4m39s
[23:34:23.734] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:18:0)
[23:34:23.760] Build status: STARTED
[23:34:23.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:19:0) after 4m31s
[23:38:54.788] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:19:0)
[23:38:54.805] Build status: STARTED
[23:38:54.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:20:0) after 6m50s
[23:45:44.864] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:20:0)
[23:45:44.919] Build status: STARTED
[23:45:44.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:21:0) after 3m7s
[23:48:51.989] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:21:0)
[23:48:52.006] Build status: STARTED
[23:48:52.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:22:0) after 3m42s
[23:52:34.165] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:22:0)
[23:52:34.243] Build status: STARTED
[23:52:34.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:23:0) after 4m47s
[23:57:21.265] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:23:0)
[23:57:21.289] Build status: STARTED
[23:57:21.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:24:0) after 2m24s
[23:59:45.311] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:24:0)
[23:59:45.339] Build status: STARTED
[23:59:45.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:25:0) after 8m42s
[00:08:27.434] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:25:0)
[00:08:27.453] Build status: STARTED
[00:08:27.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:26:0) after 2m32s
[00:10:59.435] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:26:0)
[00:10:59.453] Build status: STARTED
[00:10:59.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:27:0) after 8m9s
[00:19:08.556] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:27:0)
[00:19:08.573] Build status: STARTED
[00:19:08.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:28:0) after 6m51s
[00:25:59.714] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:28:0)
[00:25:59.734] Build status: STARTED
[00:25:59.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:29:0) after 1m37s
[00:27:36.810] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:29:0)
[00:27:36.837] Build status: STARTED
[00:27:36.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:30:0) after 6m45s
[00:34:21.867] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:30:0)
[00:34:21.888] Build status: STARTED
[00:34:21.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:31:0) after 8m47s
[00:43:08.963] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:31:0)
[00:43:08.997] Build status: STARTED
[00:43:08.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:32:0) after 3m44s
[00:46:52.968] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:32:0)
[00:46:52.986] Build status: STARTED
[00:46:52.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:33:0) after 2m44s
[00:49:37.098] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:33:0)
[00:49:37.119] Build status: STARTED
[00:49:37.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:34:0) after 3m53s
[00:53:30.199] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:34:0)
[00:53:30.227] Build status: STARTED
[00:53:30.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:35:0) after 8m3s
[01:01:33.255] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:35:0)
[01:01:33.288] Build status: STARTED
[01:01:33.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:36:0) after 4m51s
[01:06:24.320] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:36:0)
[01:06:24.340] Build status: STARTED
[01:06:24.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:37:0) after 2m11s
[01:08:35.354] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:37:0)
[01:08:35.374] Build status: STARTED
[01:08:35.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:38:0) after 4m50s
[01:13:25.432] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:38:0)
[01:13:25.450] Build status: STARTED
[01:13:25.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:39:0) after 8m58s
[01:22:23.458] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:39:0)
[01:22:23.485] Build status: STARTED
[01:22:23.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:40:0) after 2m47s
[01:25:10.504] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:40:0)
[01:25:10.526] Build status: STARTED
[01:25:10.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:41:0) after 1m47s
[01:26:57.571] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:41:0)
[01:26:57.595] Build status: STARTED
[01:26:57.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:42:0) after 1m34s
[01:28:31.818] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:42:0)
[01:28:31.842] Build status: STARTED
[01:28:31.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:43:0) after 2m59s
[01:31:31.010] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:43:0)
[01:31:31.034] Build status: STARTED
[01:31:31.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:44:0) after 4m20s
[01:35:51.066] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:44:0)
[01:35:51.082] Build status: STARTED
[01:35:51.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:45:0) after 2m47s
[01:38:38.144] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:45:0)
[01:38:38.161] Build status: STARTED
[01:38:38.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:46:0) after 8m51s
[01:47:29.571] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:46:0)
[01:47:29.607] Build status: STARTED
[01:47:29.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:47:0) after 7m56s
[01:55:26.161] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:47:0)
[01:55:26.178] Build status: STARTED
[01:55:26.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:48:0) after 4m46s
[02:00:12.206] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:48:0)
[02:00:12.224] Build status: STARTED
[02:00:12.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:49:0) after 1m53s
[02:02:05.331] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:49:0)
[02:02:05.359] Build status: STARTED
[02:02:05.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:50:0) after 7m23s
[02:09:29.317] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:50:0)
[02:09:29.337] Build status: STARTED
[02:09:29.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8876029217034958560:51:0) after 4m57s
[02:11:47.555] Received PubSub notification, asking Buildbucket for the build status
[02:11:47.618] Build:
{
"id": "8710599155164725297",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 38729,
"createdBy": "project:chromium",
"createTime": "2025-06-30T22:25:27.417499495Z",
"startTime": "2025-06-30T22:25:31.029612751Z",
"endTime": "2025-07-01T02:11:47.257141303Z",
"updateTime": "2025-07-01T02:11:47.257141303Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ad93092d1522988e5fd369bae5d28be82cb7a117",
"ref": "refs/heads/main"
}
}
}
[02:11:47.618] Invocation finished in 3h46m21.367439204s with status FAILED