[05:31:06.271] New invocation is queued and will start shortly
[05:31:07.341] Starting the invocation (attempt 1)
[05:31:07.371] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/154e3437e2317e3b196ed43e76fe6ba7268333a4"
[05:31:07.371] Popped gitiles commit info from properties and tags
[05:31:07.371] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:31:07.371] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:31:07.371] Buildbucket request:
{
"requestId": "8953372245693530736",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "154e3437e2317e3b196ed43e76fe6ba7268333a4",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8953372245693530736"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[05:31:08.080] Scheduled build:
{
"id": "8787942183608176225",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29007,
"createdBy": "project:chromium",
"createTime": "2023-02-28T05:31:07.637640939Z",
"updateTime": "2023-02-28T05:31:07.637640939Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "154e3437e2317e3b196ed43e76fe6ba7268333a4",
"ref": "refs/heads/main"
}
}
}
[05:31:08.080] Task URL: https://cr-buildbucket.appspot.com/build/8787942183608176225
[05:31:08.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:2:0) after 2m53s
[05:33:39.672] Received PubSub notification, asking Buildbucket for the build status
[05:33:39.693] Build status: STARTED
[05:34:01.162] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:2:0)
[05:34:01.185] Build status: STARTED
[05:34:01.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:4:0) after 6m10s
[05:40:11.311] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:4:0)
[05:40:11.400] Build status: STARTED
[05:40:11.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:5:0) after 4m1s
[05:44:12.518] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:5:0)
[05:44:12.550] Build status: STARTED
[05:44:12.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:6:0) after 8m59s
[05:53:11.580] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:6:0)
[05:53:11.599] Build status: STARTED
[05:53:11.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:7:0) after 1m38s
[05:54:49.733] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:7:0)
[05:54:49.755] Build status: STARTED
[05:54:49.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:8:0) after 7m46s
[06:02:35.801] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:8:0)
[06:02:35.824] Build status: STARTED
[06:02:35.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:9:0) after 5m19s
[06:07:54.801] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:9:0)
[06:07:54.841] Build status: STARTED
[06:07:54.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:10:0) after 9m53s
[06:17:47.964] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:10:0)
[06:17:47.999] Build status: STARTED
[06:17:47.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:11:0) after 1m52s
[06:19:40.456] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:11:0)
[06:19:40.477] Build status: STARTED
[06:19:40.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:12:0) after 8m27s
[06:28:07.578] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:12:0)
[06:28:07.600] Build status: STARTED
[06:28:07.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:13:0) after 4m9s
[06:32:16.672] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:13:0)
[06:32:16.692] Build status: STARTED
[06:32:16.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:14:0) after 6m1s
[06:38:17.724] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:14:0)
[06:38:17.750] Build status: STARTED
[06:38:17.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:15:0) after 6m39s
[06:44:56.830] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:15:0)
[06:44:56.849] Build status: STARTED
[06:44:56.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:16:0) after 6m15s
[06:51:12.097] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:16:0)
[06:51:12.117] Build status: STARTED
[06:51:12.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:17:0) after 1m33s
[06:52:45.138] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:17:0)
[06:52:45.165] Build status: STARTED
[06:52:45.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:18:0) after 9m32s
[07:02:17.376] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:18:0)
[07:02:17.402] Build status: STARTED
[07:02:17.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:19:0) after 2m27s
[07:04:44.452] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:19:0)
[07:04:44.495] Build status: STARTED
[07:04:44.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:20:0) after 5m30s
[07:10:14.681] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:20:0)
[07:10:14.706] Build status: STARTED
[07:10:14.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:21:0) after 8m9s
[07:18:23.763] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:21:0)
[07:18:23.788] Build status: STARTED
[07:18:23.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:22:0) after 8m25s
[07:26:48.815] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:22:0)
[07:26:48.835] Build status: STARTED
[07:26:48.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:23:0) after 9m35s
[07:36:23.917] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:23:0)
[07:36:23.939] Build status: STARTED
[07:36:23.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:24:0) after 6m26s
[07:42:50.387] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:24:0)
[07:42:50.407] Build status: STARTED
[07:42:50.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:25:0) after 3m0s
[07:45:50.426] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:25:0)
[07:45:50.465] Build status: STARTED
[07:45:50.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:26:0) after 2m37s
[07:48:27.574] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:26:0)
[07:48:27.599] Build status: STARTED
[07:48:27.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:27:0) after 9m4s
[07:57:31.875] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:27:0)
[07:57:31.898] Build status: STARTED
[07:57:31.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:28:0) after 8m51s
[08:06:22.929] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:28:0)
[08:06:22.952] Build status: STARTED
[08:06:22.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:29:0) after 4m37s
[08:10:59.979] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:29:0)
[08:11:00.004] Build status: STARTED
[08:11:00.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:30:0) after 5m49s
[08:16:49.231] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:30:0)
[08:16:49.255] Build status: STARTED
[08:16:49.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:31:0) after 3m12s
[08:20:01.308] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:31:0)
[08:20:01.327] Build status: STARTED
[08:20:01.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:32:0) after 3m41s
[08:23:42.360] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:32:0)
[08:23:42.379] Build status: STARTED
[08:23:42.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:33:0) after 7m37s
[08:31:19.496] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:33:0)
[08:31:19.517] Build status: STARTED
[08:31:19.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:34:0) after 3m47s
[08:35:06.692] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:34:0)
[08:35:06.717] Build status: STARTED
[08:35:06.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:35:0) after 7m28s
[08:42:34.764] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:35:0)
[08:42:34.789] Build status: STARTED
[08:42:34.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:36:0) after 9m24s
[08:51:58.805] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:36:0)
[08:51:58.826] Build status: STARTED
[08:51:58.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:37:0) after 9m14s
[09:01:12.942] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:37:0)
[09:01:12.975] Build status: STARTED
[09:01:12.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:38:0) after 8m46s
[09:09:58.996] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:38:0)
[09:09:59.019] Build status: STARTED
[09:09:59.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:39:0) after 4m40s
[09:14:39.188] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:39:0)
[09:14:39.212] Build status: STARTED
[09:14:39.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:40:0) after 8m40s
[09:23:19.340] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:40:0)
[09:23:19.366] Build status: STARTED
[09:23:19.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:41:0) after 4m33s
[09:27:52.466] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:41:0)
[09:27:52.487] Build status: STARTED
[09:27:52.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:42:0) after 5m31s
[09:33:23.509] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:42:0)
[09:33:23.531] Build status: STARTED
[09:33:23.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:43:0) after 9m13s
[09:42:37.305] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:43:0)
[09:42:37.325] Build status: STARTED
[09:42:37.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:44:0) after 3m42s
[09:46:19.389] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:44:0)
[09:46:19.412] Build status: STARTED
[09:46:19.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:45:0) after 6m32s
[09:52:51.474] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:45:0)
[09:52:51.499] Build status: STARTED
[09:52:51.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:46:0) after 9m16s
[10:02:07.493] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:46:0)
[10:02:07.516] Build status: STARTED
[10:02:07.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:47:0) after 8m43s
[10:10:50.521] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:47:0)
[10:10:50.551] Build status: STARTED
[10:10:50.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:48:0) after 4m38s
[10:15:28.851] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:48:0)
[10:15:28.874] Build status: STARTED
[10:15:28.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:49:0) after 2m0s
[10:17:28.895] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:49:0)
[10:17:28.918] Build status: STARTED
[10:17:28.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:50:0) after 7m49s
[10:25:18.222] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:50:0)
[10:25:18.254] Build status: STARTED
[10:25:18.254] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:51:0) after 9m5s
[10:34:23.568] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:51:0)
[10:34:23.592] Build status: STARTED
[10:34:23.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:52:0) after 8m34s
[10:42:57.617] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:52:0)
[10:42:57.640] Build status: STARTED
[10:42:57.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953372245693530736:53:0) after 5m34s
[10:48:20.139] Received PubSub notification, asking Buildbucket for the build status
[10:48:20.201] Build:
{
"id": "8787942183608176225",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29007,
"createdBy": "project:chromium",
"createTime": "2023-02-28T05:31:07.637640939Z",
"startTime": "2023-02-28T05:33:39.003675Z",
"endTime": "2023-02-28T10:48:19.826703085Z",
"updateTime": "2023-02-28T10:48:19.826703085Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "154e3437e2317e3b196ed43e76fe6ba7268333a4",
"ref": "refs/heads/main"
}
}
}
[10:48:20.201] Invocation finished in 5h17m13.935953844s with status FAILED