[07:25:32.635] New invocation is queued and will start shortly
[07:25:33.884] Starting the invocation (attempt 1)
[07:25:33.916] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2a2511edfbc6058f707066e3ffd03d80366d45e8"
[07:25:33.916] Popped gitiles commit info from properties and tags
[07:25:33.916] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[07:25:33.918] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[07:25:33.918] Buildbucket request:
{
"requestId": "8952277882200798016",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2a2511edfbc6058f707066e3ffd03d80366d45e8",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8952277882200798016"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[07:25:34.397] Scheduled build:
{
"id": "8786847820128975313",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29063,
"createdBy": "project:chromium",
"createTime": "2023-03-12T07:25:33.980620689Z",
"updateTime": "2023-03-12T07:25:33.980620689Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2a2511edfbc6058f707066e3ffd03d80366d45e8",
"ref": "refs/heads/main"
}
}
}
[07:25:34.397] Task URL: https://cr-buildbucket.appspot.com/build/8786847820128975313
[07:25:34.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:2:0) after 7m3s
[07:28:01.504] Received PubSub notification, asking Buildbucket for the build status
[07:28:01.526] Build status: STARTED
[07:32:37.489] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:2:0)
[07:32:37.564] Build status: STARTED
[07:32:37.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:4:0) after 7m44s
[07:40:21.749] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:4:0)
[07:40:21.769] Build status: STARTED
[07:40:21.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:5:0) after 4m13s
[07:44:35.333] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:5:0)
[07:44:35.362] Build status: STARTED
[07:44:35.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:6:0) after 7m46s
[07:52:21.758] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:6:0)
[07:52:21.780] Build status: STARTED
[07:52:21.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:7:0) after 7m11s
[07:59:32.839] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:7:0)
[07:59:32.892] Build status: STARTED
[07:59:32.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:8:0) after 4m47s
[08:04:20.063] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:8:0)
[08:04:20.097] Build status: STARTED
[08:04:20.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:9:0) after 6m25s
[08:10:45.113] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:9:0)
[08:10:45.151] Build status: STARTED
[08:10:45.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:10:0) after 8m18s
[08:19:03.246] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:10:0)
[08:19:03.266] Build status: STARTED
[08:19:03.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:11:0) after 7m43s
[08:26:46.290] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:11:0)
[08:26:46.310] Build status: STARTED
[08:26:46.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:12:0) after 7m43s
[08:34:29.591] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:12:0)
[08:34:29.616] Build status: STARTED
[08:34:29.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:13:0) after 8m22s
[08:42:52.332] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:13:0)
[08:42:52.367] Build status: STARTED
[08:42:52.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:14:0) after 9m49s
[08:52:41.548] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:14:0)
[08:52:41.565] Build status: STARTED
[08:52:41.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:15:0) after 7m30s
[09:00:11.628] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:15:0)
[09:00:11.650] Build status: STARTED
[09:00:11.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:16:0) after 2m51s
[09:03:02.877] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:16:0)
[09:03:02.957] Build status: STARTED
[09:03:02.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:17:0) after 9m49s
[09:12:52.100] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:17:0)
[09:12:52.143] Build status: STARTED
[09:12:52.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:18:0) after 8m55s
[09:21:47.162] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:18:0)
[09:21:47.184] Build status: STARTED
[09:21:47.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:19:0) after 9m46s
[09:31:33.172] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:19:0)
[09:31:33.195] Build status: STARTED
[09:31:33.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:20:0) after 7m8s
[09:38:41.211] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:20:0)
[09:38:41.232] Build status: STARTED
[09:38:41.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:21:0) after 6m57s
[09:45:38.251] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:21:0)
[09:45:38.273] Build status: STARTED
[09:45:38.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:22:0) after 8m20s
[09:53:58.361] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:22:0)
[09:53:58.386] Build status: STARTED
[09:53:58.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:23:0) after 8m59s
[10:02:57.410] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:23:0)
[10:02:57.562] Build status: STARTED
[10:02:57.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:24:0) after 1m3s
[10:04:00.584] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:24:0)
[10:04:00.610] Build status: STARTED
[10:04:00.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:25:0) after 9m18s
[10:13:18.629] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:25:0)
[10:13:18.655] Build status: STARTED
[10:13:18.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:26:0) after 4m42s
[10:18:00.703] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:26:0)
[10:18:00.729] Build status: STARTED
[10:18:00.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:27:0) after 1m40s
[10:19:41.063] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:27:0)
[10:19:41.084] Build status: STARTED
[10:19:41.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:28:0) after 7m14s
[10:26:55.228] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:28:0)
[10:26:55.247] Build status: STARTED
[10:26:55.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:29:0) after 3m52s
[10:30:47.432] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:29:0)
[10:30:47.452] Build status: STARTED
[10:30:47.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:30:0) after 3m52s
[10:34:39.473] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:30:0)
[10:34:39.493] Build status: STARTED
[10:34:39.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:31:0) after 6m22s
[10:41:01.671] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:31:0)
[10:41:01.707] Build status: STARTED
[10:41:01.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:32:0) after 5m26s
[10:46:27.828] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:32:0)
[10:46:27.852] Build status: STARTED
[10:46:27.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:33:0) after 8m45s
[10:55:12.869] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:33:0)
[10:55:12.891] Build status: STARTED
[10:55:12.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:34:0) after 1m58s
[10:57:10.875] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:34:0)
[10:57:10.896] Build status: STARTED
[10:57:10.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:35:0) after 1m54s
[10:59:05.158] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:35:0)
[10:59:05.183] Build status: STARTED
[10:59:05.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:36:0) after 5m37s
[11:04:42.322] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:36:0)
[11:04:42.350] Build status: STARTED
[11:04:42.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:37:0) after 7m57s
[11:12:39.385] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:37:0)
[11:12:39.410] Build status: STARTED
[11:12:39.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:38:0) after 5m5s
[11:17:45.423] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:38:0)
[11:17:45.445] Build status: STARTED
[11:17:45.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:39:0) after 3m30s
[11:21:15.732] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:39:0)
[11:21:15.795] Build status: STARTED
[11:21:15.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:40:0) after 4m23s
[11:25:39.007] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:40:0)
[11:25:39.026] Build status: STARTED
[11:25:39.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:41:0) after 9m43s
[11:35:22.046] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:41:0)
[11:35:22.070] Build status: STARTED
[11:35:22.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:42:0) after 9m48s
[11:45:10.685] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:42:0)
[11:45:10.706] Build status: STARTED
[11:45:10.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:43:0) after 5m18s
[11:50:28.726] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:43:0)
[11:50:28.746] Build status: STARTED
[11:50:28.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:44:0) after 5m19s
[11:55:47.765] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:44:0)
[11:55:47.783] Build status: STARTED
[11:55:47.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:45:0) after 2m49s
[11:58:36.831] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:45:0)
[11:58:36.852] Build status: STARTED
[11:58:36.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:46:0) after 9m31s
[12:08:08.136] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:46:0)
[12:08:08.160] Build status: STARTED
[12:08:08.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:47:0) after 7m42s
[12:15:50.976] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:47:0)
[12:15:51.109] Build status: STARTED
[12:15:51.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:48:0) after 6m51s
[12:22:42.235] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:48:0)
[12:22:42.259] Build status: STARTED
[12:22:42.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:49:0) after 2m3s
[12:24:45.277] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:49:0)
[12:24:45.300] Build status: STARTED
[12:24:45.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:50:0) after 7m6s
[12:31:51.509] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:50:0)
[12:31:51.529] Build status: STARTED
[12:31:51.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:51:0) after 4m59s
[12:36:50.579] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:51:0)
[12:36:50.709] Build status: STARTED
[12:36:50.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952277882200798016:52:0) after 3m34s
[12:40:16.177] Received PubSub notification, asking Buildbucket for the build status
[12:40:16.199] Build:
{
"id": "8786847820128975313",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29063,
"createdBy": "project:chromium",
"createTime": "2023-03-12T07:25:33.980620689Z",
"startTime": "2023-03-12T07:28:00.872776Z",
"endTime": "2023-03-12T12:40:15.842754458Z",
"updateTime": "2023-03-12T12:40:15.842754458Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2a2511edfbc6058f707066e3ffd03d80366d45e8",
"ref": "refs/heads/main"
}
}
}
[12:40:16.199] Invocation finished in 5h14m43.578788951s with status FAILED