[12:05:16.186] New invocation is queued and will start shortly
[12:05:17.354] Starting the invocation (attempt 1)
[12:05:17.441] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/5e03822d92fb0093d35cc634fbe41b97f8dda502"
[12:05:17.441] Popped gitiles commit info from properties and tags
[12:05:17.441] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[12:05:17.441] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[12:05:17.441] Buildbucket request:
{
"requestId": "8972010422048041168",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5e03822d92fb0093d35cc634fbe41b97f8dda502",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8972010422048041168"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[12:05:18.069] Scheduled build:
{
"id": "8806580359952435793",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 25735,
"createdBy": "project:chromium",
"createTime": "2022-08-06T12:05:17.553326985Z",
"updateTime": "2022-08-06T12:05:17.553326985Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5e03822d92fb0093d35cc634fbe41b97f8dda502",
"ref": "refs/heads/main"
}
}
}
[12:05:18.069] Task URL: https://cr-buildbucket.appspot.com/build/8806580359952435793
[12:05:18.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:2:0) after 1m21s
[12:06:39.135] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:2:0)
[12:06:39.156] Build status: SCHEDULED
[12:06:39.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:3:0) after 7m15s
[12:08:02.318] Received PubSub notification, asking Buildbucket for the build status
[12:08:02.350] Build status: STARTED
[12:13:54.210] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:3:0)
[12:13:54.232] Build status: STARTED
[12:13:54.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:5:0) after 8m46s
[12:22:40.264] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:5:0)
[12:22:40.297] Build status: STARTED
[12:22:40.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:6:0) after 6m9s
[12:28:49.314] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:6:0)
[12:28:49.335] Build status: STARTED
[12:28:49.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:7:0) after 1m1s
[12:29:50.356] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:7:0)
[12:29:50.393] Build status: STARTED
[12:29:50.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:8:0) after 4m41s
[12:34:31.411] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:8:0)
[12:34:31.446] Build status: STARTED
[12:34:31.446] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:9:0) after 3m10s
[12:37:41.665] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:9:0)
[12:37:41.686] Build status: STARTED
[12:37:41.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:10:0) after 1m46s
[12:39:27.705] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:10:0)
[12:39:27.737] Build status: STARTED
[12:39:27.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:11:0) after 5m9s
[12:44:36.757] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:11:0)
[12:44:36.779] Build status: STARTED
[12:44:36.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:12:0) after 4m31s
[12:49:07.899] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:12:0)
[12:49:07.923] Build status: STARTED
[12:49:07.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:13:0) after 8m22s
[12:57:29.954] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:13:0)
[12:57:29.975] Build status: STARTED
[12:57:29.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:14:0) after 6m18s
[13:03:47.994] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:14:0)
[13:03:48.028] Build status: STARTED
[13:03:48.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:15:0) after 2m44s
[13:06:32.055] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:15:0)
[13:06:32.086] Build status: STARTED
[13:06:32.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:16:0) after 8m20s
[13:14:52.111] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:16:0)
[13:14:52.132] Build status: STARTED
[13:14:52.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:17:0) after 2m23s
[13:17:15.187] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:17:0)
[13:17:15.245] Build status: STARTED
[13:17:15.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:18:0) after 2m12s
[13:19:27.315] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:18:0)
[13:19:27.339] Build status: STARTED
[13:19:27.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:19:0) after 2m33s
[13:22:00.368] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:19:0)
[13:22:00.389] Build status: STARTED
[13:22:00.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:20:0) after 1m49s
[13:23:49.411] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:20:0)
[13:23:49.431] Build status: STARTED
[13:23:49.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:21:0) after 7m44s
[13:31:33.464] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:21:0)
[13:31:33.545] Build status: STARTED
[13:31:33.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:22:0) after 3m56s
[13:35:29.571] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:22:0)
[13:35:29.597] Build status: STARTED
[13:35:29.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:23:0) after 8m59s
[13:44:28.648] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:23:0)
[13:44:28.686] Build status: STARTED
[13:44:28.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:24:0) after 6m21s
[13:50:49.879] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:24:0)
[13:50:49.902] Build status: STARTED
[13:50:49.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:25:0) after 8m21s
[13:59:10.982] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:25:0)
[13:59:11.015] Build status: STARTED
[13:59:11.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:26:0) after 1m34s
[14:00:45.139] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:26:0)
[14:00:45.177] Build status: STARTED
[14:00:45.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:27:0) after 4m37s
[14:05:22.208] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:27:0)
[14:05:22.239] Build status: STARTED
[14:05:22.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:28:0) after 2m35s
[14:07:57.264] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:28:0)
[14:07:57.293] Build status: STARTED
[14:07:57.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:29:0) after 4m18s
[14:12:15.313] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:29:0)
[14:12:15.448] Build status: STARTED
[14:12:15.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:30:0) after 5m39s
[14:17:54.471] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:30:0)
[14:17:54.492] Build status: STARTED
[14:17:54.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:31:0) after 7m20s
[14:25:14.657] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:31:0)
[14:25:14.688] Build status: STARTED
[14:25:14.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:32:0) after 6m56s
[14:32:10.709] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:32:0)
[14:32:10.729] Build status: STARTED
[14:32:10.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:33:0) after 2m12s
[14:34:22.784] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:33:0)
[14:34:22.817] Build status: STARTED
[14:34:22.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:34:0) after 1m13s
[14:35:35.838] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:34:0)
[14:35:35.858] Build status: STARTED
[14:35:35.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:35:0) after 6m31s
[14:42:06.934] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:35:0)
[14:42:06.966] Build status: STARTED
[14:42:06.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:36:0) after 9m47s
[14:51:53.986] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:36:0)
[14:51:54.009] Build status: STARTED
[14:51:54.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:37:0) after 5m38s
[14:57:32.133] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:37:0)
[14:57:32.165] Build status: STARTED
[14:57:32.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:38:0) after 7m29s
[15:05:01.186] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:38:0)
[15:05:01.209] Build status: STARTED
[15:05:01.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:39:0) after 7m39s
[15:12:40.226] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:39:0)
[15:12:40.277] Build status: STARTED
[15:12:40.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:40:0) after 7m56s
[15:20:36.299] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:40:0)
[15:20:36.336] Build status: STARTED
[15:20:36.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:41:0) after 9m27s
[15:30:03.380] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:41:0)
[15:30:03.412] Build status: STARTED
[15:30:03.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:42:0) after 7m54s
[15:37:57.435] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:42:0)
[15:37:57.464] Build status: STARTED
[15:37:57.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:43:0) after 5m1s
[15:42:58.484] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:43:0)
[15:42:58.510] Build status: STARTED
[15:42:58.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:44:0) after 4m30s
[15:47:28.531] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:44:0)
[15:47:28.552] Build status: STARTED
[15:47:28.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:45:0) after 4m2s
[15:51:30.665] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:45:0)
[15:51:30.702] Build status: STARTED
[15:51:30.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:46:0) after 1m54s
[15:53:24.723] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:46:0)
[15:53:24.746] Build status: STARTED
[15:53:24.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:47:0) after 7m33s
[16:00:57.800] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:47:0)
[16:00:57.855] Build status: STARTED
[16:00:57.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:48:0) after 4m0s
[16:04:57.876] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:48:0)
[16:04:57.941] Build status: STARTED
[16:04:57.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:49:0) after 8m46s
[16:13:44.065] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:49:0)
[16:13:44.088] Build status: STARTED
[16:13:44.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:50:0) after 1m56s
[16:15:40.074] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:50:0)
[16:15:40.106] Build status: STARTED
[16:15:40.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:51:0) after 9m16s
[16:24:56.355] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:51:0)
[16:24:56.443] Build status: STARTED
[16:24:56.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:52:0) after 4m22s
[16:29:18.465] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:52:0)
[16:29:18.495] Build status: STARTED
[16:29:18.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:53:0) after 1m43s
[16:31:01.532] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:53:0)
[16:31:01.561] Build status: STARTED
[16:31:01.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:54:0) after 6m32s
[16:37:33.582] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:54:0)
[16:37:33.604] Build status: STARTED
[16:37:33.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:55:0) after 6m16s
[16:43:49.647] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:55:0)
[16:43:49.670] Build status: STARTED
[16:43:49.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:56:0) after 4m21s
[16:48:10.824] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:56:0)
[16:48:10.890] Build status: STARTED
[16:48:10.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:57:0) after 3m5s
[16:51:15.910] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:57:0)
[16:51:15.929] Build status: STARTED
[16:51:15.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8972010422048041168:58:0) after 6m2s
[16:53:39.680] Received PubSub notification, asking Buildbucket for the build status
[16:53:39.701] Build:
{
"id": "8806580359952435793",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 25735,
"createdBy": "project:chromium",
"createTime": "2022-08-06T12:05:17.553326985Z",
"startTime": "2022-08-06T12:08:01.658288Z",
"endTime": "2022-08-06T16:53:39.306863898Z",
"updateTime": "2022-08-06T16:53:39.306863898Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5e03822d92fb0093d35cc634fbe41b97f8dda502",
"ref": "refs/heads/main"
}
}
}
[16:53:39.701] Invocation finished in 4h48m23.529595155s with status FAILED