[19:00:00.837] New invocation is queued and will start shortly
[19:00:02.650] Starting the invocation (attempt 1)
[19:00:02.717] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/be07900f43c57999d6c79d0e8c09e08024997ce3"
[19:00:02.717] Popped gitiles commit info from properties and tags
[19:00:02.717] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:00:02.717] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:00:02.717] Buildbucket request:
{
"requestId": "8979413279855650736",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "be07900f43c57999d6c79d0e8c09e08024997ce3",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8979413279855650736"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:00:03.399] Scheduled build:
{
"id": "8813983217111676241",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 24602,
"createdBy": "project:chromium",
"createTime": "2022-05-16T19:00:02.812503050Z",
"updateTime": "2022-05-16T19:00:02.812503050Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "be07900f43c57999d6c79d0e8c09e08024997ce3",
"ref": "refs/heads/main"
}
}
}
[19:00:03.399] Task URL: https://cr-buildbucket.appspot.com/build/8813983217111676241
[19:00:03.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:2:0) after 6m47s
[19:02:07.089] Received PubSub notification, asking Buildbucket for the build status
[19:02:07.129] Build status: STARTED
[19:06:50.417] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:2:0)
[19:06:50.438] Build status: STARTED
[19:06:50.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:4:0) after 3m13s
[19:10:03.498] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:4:0)
[19:10:03.525] Build status: STARTED
[19:10:03.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:5:0) after 6m51s
[19:16:54.595] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:5:0)
[19:16:54.633] Build status: STARTED
[19:16:54.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:6:0) after 2m49s
[19:19:43.653] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:6:0)
[19:19:43.675] Build status: STARTED
[19:19:43.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:7:0) after 4m56s
[19:24:39.695] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:7:0)
[19:24:39.726] Build status: STARTED
[19:24:39.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:8:0) after 7m25s
[19:32:04.915] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:8:0)
[19:32:04.970] Build status: STARTED
[19:32:04.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:9:0) after 4m19s
[19:36:24.150] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:9:0)
[19:36:24.181] Build status: STARTED
[19:36:24.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:10:0) after 8m49s
[19:45:13.727] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:10:0)
[19:45:13.748] Build status: STARTED
[19:45:13.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:11:0) after 6m40s
[19:51:53.890] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:11:0)
[19:51:53.935] Build status: STARTED
[19:51:53.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:12:0) after 6m29s
[19:58:23.260] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:12:0)
[19:58:23.280] Build status: STARTED
[19:58:23.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:13:0) after 2m7s
[20:00:30.742] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:13:0)
[20:00:30.770] Build status: STARTED
[20:00:30.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:14:0) after 4m27s
[20:04:57.881] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:14:0)
[20:04:57.909] Build status: STARTED
[20:04:57.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:15:0) after 4m3s
[20:09:00.978] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:15:0)
[20:09:00.998] Build status: STARTED
[20:09:00.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:16:0) after 5m51s
[20:14:52.241] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:16:0)
[20:14:52.265] Build status: STARTED
[20:14:52.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:17:0) after 9m57s
[20:24:49.358] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:17:0)
[20:24:49.400] Build status: STARTED
[20:24:49.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:18:0) after 4m57s
[20:29:46.509] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:18:0)
[20:29:46.529] Build status: STARTED
[20:29:46.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:19:0) after 4m13s
[20:33:59.973] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:19:0)
[20:33:59.998] Build status: STARTED
[20:33:59.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:20:0) after 6m15s
[20:40:15.043] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:20:0)
[20:40:15.073] Build status: STARTED
[20:40:15.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:21:0) after 8m36s
[20:48:51.091] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:21:0)
[20:48:51.163] Build status: STARTED
[20:48:51.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:22:0) after 1m43s
[20:50:34.248] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:22:0)
[20:50:34.271] Build status: STARTED
[20:50:34.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:23:0) after 6m8s
[20:56:42.355] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:23:0)
[20:56:42.376] Build status: STARTED
[20:56:42.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:24:0) after 7m48s
[21:04:30.432] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:24:0)
[21:04:30.461] Build status: STARTED
[21:04:30.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:25:0) after 8m5s
[21:12:35.456] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:25:0)
[21:12:35.493] Build status: STARTED
[21:12:35.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:26:0) after 7m56s
[21:20:31.517] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:26:0)
[21:20:31.541] Build status: STARTED
[21:20:31.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:27:0) after 9m21s
[21:29:52.838] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:27:0)
[21:29:52.862] Build status: STARTED
[21:29:52.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:28:0) after 3m24s
[21:33:17.039] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:28:0)
[21:33:17.075] Build status: STARTED
[21:33:17.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:29:0) after 4m21s
[21:37:38.608] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:29:0)
[21:37:38.629] Build status: STARTED
[21:37:38.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:30:0) after 8m33s
[21:46:11.657] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:30:0)
[21:46:11.686] Build status: STARTED
[21:46:11.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:31:0) after 8m47s
[21:54:59.082] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:31:0)
[21:54:59.108] Build status: STARTED
[21:54:59.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:32:0) after 1m0s
[21:55:59.126] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:32:0)
[21:55:59.187] Build status: STARTED
[21:55:59.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:33:0) after 1m1s
[21:57:00.211] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:33:0)
[21:57:00.236] Build status: STARTED
[21:57:00.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:34:0) after 8m37s
[22:05:37.417] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:34:0)
[22:05:37.445] Build status: STARTED
[22:05:37.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:35:0) after 1m55s
[22:07:34.119] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:35:0)
[22:07:34.150] Build status: STARTED
[22:07:34.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:36:0) after 9m19s
[22:16:53.341] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:36:0)
[22:16:53.370] Build status: STARTED
[22:16:53.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:37:0) after 8m11s
[22:25:04.627] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:37:0)
[22:25:04.653] Build status: STARTED
[22:25:04.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:38:0) after 9m14s
[22:34:18.827] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:38:0)
[22:34:18.850] Build status: STARTED
[22:34:18.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:39:0) after 5m9s
[22:39:27.968] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:39:0)
[22:39:27.993] Build status: STARTED
[22:39:27.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:40:0) after 6m43s
[22:46:11.034] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:40:0)
[22:46:11.088] Build status: STARTED
[22:46:11.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:41:0) after 3m49s
[22:50:00.786] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:41:0)
[22:50:00.824] Build status: STARTED
[22:50:00.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:42:0) after 2m18s
[22:52:18.847] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:42:0)
[22:52:18.917] Build status: STARTED
[22:52:18.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:43:0) after 6m57s
[22:59:16.227] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:43:0)
[22:59:16.368] Build status: STARTED
[22:59:16.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:44:0) after 3m6s
[23:02:22.612] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:44:0)
[23:02:22.635] Build status: STARTED
[23:02:22.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:45:0) after 4m18s
[23:06:40.614] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:45:0)
[23:06:40.648] Build status: STARTED
[23:06:40.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:46:0) after 9m40s
[23:16:20.741] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:46:0)
[23:16:20.779] Build status: STARTED
[23:16:20.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:47:0) after 3m50s
[23:22:17.527] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:47:0)
[23:22:17.548] Build status: STARTED
[23:22:17.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:48:0) after 2m36s
[23:24:53.572] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:48:0)
[23:24:53.596] Build status: STARTED
[23:24:53.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:49:0) after 2m49s
[23:27:42.619] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:49:0)
[23:27:42.642] Build status: STARTED
[23:27:42.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:50:0) after 2m14s
[23:29:57.175] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:50:0)
[23:29:57.194] Build status: STARTED
[23:29:57.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:51:0) after 1m15s
[23:31:12.196] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:51:0)
[23:31:12.216] Build status: STARTED
[23:31:12.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:52:0) after 4m0s
[23:35:12.276] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:52:0)
[23:35:12.302] Build status: STARTED
[23:35:12.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:53:0) after 2m19s
[23:37:31.331] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:53:0)
[23:37:31.378] Build status: STARTED
[23:37:31.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:54:0) after 5m15s
[23:42:46.400] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:54:0)
[23:42:46.424] Build status: STARTED
[23:42:46.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:55:0) after 3m25s
[23:46:11.450] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:55:0)
[23:46:11.539] Build status: STARTED
[23:46:11.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:56:0) after 5m18s
[23:51:29.610] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:56:0)
[23:51:29.756] Build status: STARTED
[23:51:29.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:57:0) after 9m41s
[00:01:11.090] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:57:0)
[00:01:11.116] Build status: STARTED
[00:01:11.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:58:0) after 6m37s
[00:07:48.166] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:58:0)
[00:07:48.244] Build status: STARTED
[00:07:48.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:59:0) after 8m54s
[00:16:42.348] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:59:0)
[00:16:42.372] Build status: STARTED
[00:16:42.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:60:0) after 5m39s
[00:22:21.375] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:60:0)
[00:22:21.399] Build status: STARTED
[00:22:21.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:61:0) after 6m42s
[00:29:03.413] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:61:0)
[00:29:03.438] Build status: STARTED
[00:29:03.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:62:0) after 9m45s
[00:38:48.572] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:62:0)
[00:38:48.643] Build status: STARTED
[00:38:48.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8979413279855650736:63:0) after 9m35s
[00:41:01.952] Received PubSub notification, asking Buildbucket for the build status
[00:41:01.972] Build:
{
"id": "8813983217111676241",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 24602,
"createdBy": "project:chromium",
"createTime": "2022-05-16T19:00:02.812503050Z",
"startTime": "2022-05-16T19:02:06.437128Z",
"endTime": "2022-05-17T00:41:01.515638381Z",
"updateTime": "2022-05-17T00:41:01.515638381Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "be07900f43c57999d6c79d0e8c09e08024997ce3",
"ref": "refs/heads/main"
}
}
}
[00:41:01.972] Invocation finished in 5h41m1.15994238s with status FAILED