[17:23:32.195] New invocation is queued and will start shortly
[17:23:33.335] Starting the invocation (attempt 1)
[17:23:33.367] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e463cd35b3e353646311580234254160de7935dd"
[17:23:33.368] Popped gitiles commit info from properties and tags
[17:23:33.368] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[17:23:33.369] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[17:23:33.369] Buildbucket request:
{
"requestId": "8951787274921592736",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e463cd35b3e353646311580234254160de7935dd",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8951787274921592736"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[17:23:34.276] Scheduled build:
{
"id": "8786357212886457777",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29088,
"createdBy": "project:chromium",
"createTime": "2023-03-17T17:23:33.507848851Z",
"updateTime": "2023-03-17T17:23:33.507848851Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e463cd35b3e353646311580234254160de7935dd",
"ref": "refs/heads/main"
}
}
}
[17:23:34.276] Task URL: https://cr-buildbucket.appspot.com/build/8786357212886457777
[17:23:34.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:2:0) after 5m36s
[17:25:29.913] Received PubSub notification, asking Buildbucket for the build status
[17:25:29.963] Build status: STARTED
[17:29:10.380] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:2:0)
[17:29:10.410] Build status: STARTED
[17:29:10.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:4:0) after 1m41s
[17:30:51.471] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:4:0)
[17:30:51.501] Build status: STARTED
[17:30:51.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:5:0) after 7m55s
[17:38:46.884] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:5:0)
[17:38:46.911] Build status: STARTED
[17:38:46.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:6:0) after 6m33s
[17:45:20.037] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:6:0)
[17:45:20.058] Build status: STARTED
[17:45:20.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:7:0) after 9m29s
[17:54:49.105] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:7:0)
[17:54:49.128] Build status: STARTED
[17:54:49.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:8:0) after 1m44s
[17:56:33.699] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:8:0)
[17:56:33.721] Build status: STARTED
[17:56:33.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:9:0) after 6m31s
[18:03:04.815] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:9:0)
[18:03:04.858] Build status: STARTED
[18:03:04.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:10:0) after 7m0s
[18:10:05.256] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:10:0)
[18:10:05.297] Build status: STARTED
[18:10:05.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:11:0) after 6m2s
[18:16:07.478] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:11:0)
[18:16:07.497] Build status: STARTED
[18:16:07.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:12:0) after 4m40s
[18:20:47.747] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:12:0)
[18:20:47.776] Build status: STARTED
[18:20:47.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:13:0) after 3m48s
[18:24:35.898] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:13:0)
[18:24:35.927] Build status: STARTED
[18:24:35.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:14:0) after 1m40s
[18:26:15.950] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:14:0)
[18:26:15.977] Build status: STARTED
[18:26:15.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:15:0) after 9m24s
[18:35:40.174] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:15:0)
[18:35:40.196] Build status: STARTED
[18:35:40.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:16:0) after 8m34s
[18:44:14.904] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:16:0)
[18:44:14.921] Build status: STARTED
[18:44:14.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:17:0) after 4m23s
[18:48:38.112] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:17:0)
[18:48:38.204] Build status: STARTED
[18:48:38.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:18:0) after 5m6s
[18:53:44.232] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:18:0)
[18:53:44.270] Build status: STARTED
[18:53:44.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:19:0) after 5m24s
[18:59:08.290] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:19:0)
[18:59:08.310] Build status: STARTED
[18:59:08.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:20:0) after 5m47s
[19:04:55.615] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:20:0)
[19:04:55.639] Build status: STARTED
[19:04:55.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:21:0) after 8m27s
[19:13:23.325] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:21:0)
[19:13:23.345] Build status: STARTED
[19:13:23.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:22:0) after 8m12s
[19:21:35.695] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:22:0)
[19:21:35.714] Build status: STARTED
[19:21:35.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:23:0) after 8m14s
[19:29:50.142] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:23:0)
[19:29:50.170] Build status: STARTED
[19:29:50.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:24:0) after 8m32s
[19:38:22.207] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:24:0)
[19:38:22.317] Build status: STARTED
[19:38:22.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:25:0) after 2m21s
[19:40:43.433] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:25:0)
[19:40:43.457] Build status: STARTED
[19:40:43.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:26:0) after 5m52s
[19:46:35.657] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:26:0)
[19:46:35.683] Build status: STARTED
[19:46:35.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:27:0) after 1m7s
[19:47:42.815] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:27:0)
[19:47:42.844] Build status: STARTED
[19:47:42.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:28:0) after 5m28s
[19:53:11.505] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:28:0)
[19:53:11.526] Build status: STARTED
[19:53:11.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:29:0) after 2m31s
[19:55:42.555] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:29:0)
[19:55:42.578] Build status: STARTED
[19:55:42.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:30:0) after 5m25s
[20:01:07.927] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:30:0)
[20:01:07.950] Build status: STARTED
[20:01:07.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:31:0) after 3m59s
[20:05:07.584] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:31:0)
[20:05:07.603] Build status: STARTED
[20:05:07.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:32:0) after 8m39s
[20:13:46.813] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:32:0)
[20:13:46.836] Build status: STARTED
[20:13:46.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:33:0) after 9m24s
[20:23:11.213] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:33:0)
[20:23:11.236] Build status: STARTED
[20:23:11.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:34:0) after 7m1s
[20:30:12.423] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:34:0)
[20:30:12.443] Build status: STARTED
[20:30:12.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:35:0) after 4m18s
[20:34:30.479] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:35:0)
[20:34:30.508] Build status: STARTED
[20:34:30.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:36:0) after 5m17s
[20:39:48.000] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:36:0)
[20:39:48.026] Build status: STARTED
[20:39:48.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:37:0) after 6m59s
[20:46:47.467] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:37:0)
[20:46:47.490] Build status: STARTED
[20:46:47.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:38:0) after 6m24s
[20:53:11.516] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:38:0)
[20:53:11.542] Build status: STARTED
[20:53:11.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:39:0) after 8m48s
[21:02:00.023] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:39:0)
[21:02:00.051] Build status: STARTED
[21:02:00.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:40:0) after 6m35s
[21:08:35.081] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:40:0)
[21:08:35.105] Build status: STARTED
[21:08:35.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:41:0) after 5m28s
[21:14:03.210] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:41:0)
[21:14:03.349] Build status: STARTED
[21:14:03.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:42:0) after 4m2s
[21:18:05.695] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:42:0)
[21:18:05.720] Build status: STARTED
[21:18:05.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:43:0) after 9m15s
[21:27:20.890] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:43:0)
[21:27:20.912] Build status: STARTED
[21:27:20.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:44:0) after 9m49s
[21:37:09.892] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:44:0)
[21:37:09.912] Build status: STARTED
[21:37:09.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:45:0) after 5m10s
[21:42:20.062] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:45:0)
[21:42:20.088] Build status: STARTED
[21:42:20.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:46:0) after 3m24s
[21:45:44.152] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:46:0)
[21:45:44.228] Build status: STARTED
[21:45:44.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:47:0) after 3m13s
[21:48:57.320] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:47:0)
[21:48:57.352] Build status: STARTED
[21:48:57.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:48:0) after 6m1s
[21:54:58.449] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:48:0)
[21:54:58.477] Build status: STARTED
[21:54:58.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:49:0) after 4m5s
[21:59:03.507] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:49:0)
[21:59:03.534] Build status: STARTED
[21:59:03.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:50:0) after 7m57s
[22:07:00.654] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:50:0)
[22:07:00.674] Build status: STARTED
[22:07:00.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:51:0) after 9m43s
[22:16:43.718] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:51:0)
[22:16:43.745] Build status: STARTED
[22:16:43.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:52:0) after 1m57s
[22:18:40.971] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:52:0)
[22:18:40.996] Build status: STARTED
[22:18:40.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:53:0) after 1m48s
[22:20:29.089] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:53:0)
[22:20:29.109] Build status: STARTED
[22:20:29.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:54:0) after 4m29s
[22:24:58.243] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:54:0)
[22:24:58.264] Build status: STARTED
[22:24:58.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:55:0) after 7m7s
[22:32:05.456] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:55:0)
[22:32:05.480] Build status: STARTED
[22:32:05.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:56:0) after 2m4s
[22:34:09.780] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:56:0)
[22:34:09.818] Build status: STARTED
[22:34:09.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:57:0) after 1m15s
[22:35:25.298] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:57:0)
[22:35:25.319] Build status: STARTED
[22:35:25.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:58:0) after 1m36s
[22:37:01.340] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:58:0)
[22:37:01.365] Build status: STARTED
[22:37:01.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8951787274921592736:59:0) after 5m28s
[22:37:07.981] Received PubSub notification, asking Buildbucket for the build status
[22:37:08.000] Build:
{
"id": "8786357212886457777",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29088,
"createdBy": "project:chromium",
"createTime": "2023-03-17T17:23:33.507848851Z",
"startTime": "2023-03-17T17:25:29.225715Z",
"endTime": "2023-03-17T22:37:07.584403454Z",
"updateTime": "2023-03-17T22:37:07.584403454Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e463cd35b3e353646311580234254160de7935dd",
"ref": "refs/heads/main"
}
}
}
[22:37:08.000] Invocation finished in 5h13m35.817699693s with status FAILED