[19:16:36.791] New invocation is queued and will start shortly
[19:16:38.324] Starting the invocation (attempt 1)
[19:16:38.350] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9a12cc2ff08a1c73ba3735346feaa9fea7717569"
[19:16:38.350] Popped gitiles commit info from properties and tags
[19:16:38.350] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:16:38.351] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:16:38.351] Buildbucket request:
{
"requestId": "8942720464115324784",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9a12cc2ff08a1c73ba3735346feaa9fea7717569",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8942720464115324784"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:16:38.756] Scheduled build:
{
"id": "8777290401764584001",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29820,
"createdBy": "project:chromium",
"createTime": "2023-06-25T19:16:38.406941521Z",
"updateTime": "2023-06-25T19:16:38.406941521Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9a12cc2ff08a1c73ba3735346feaa9fea7717569",
"ref": "refs/heads/main"
}
}
}
[19:16:38.756] Task URL: https://cr-buildbucket.appspot.com/build/8777290401764584001
[19:16:38.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:2:0) after 8m36s
[19:20:02.972] Received PubSub notification, asking Buildbucket for the build status
[19:20:03.054] Build status: STARTED
[19:25:14.978] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:2:0)
[19:25:14.997] Build status: STARTED
[19:25:14.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:4:0) after 6m35s
[19:31:50.212] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:4:0)
[19:31:50.231] Build status: STARTED
[19:31:50.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:5:0) after 8m0s
[19:39:50.252] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:5:0)
[19:39:50.284] Build status: STARTED
[19:39:50.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:6:0) after 1m36s
[19:41:26.303] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:6:0)
[19:41:26.337] Build status: STARTED
[19:41:26.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:7:0) after 8m8s
[19:49:35.247] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:7:0)
[19:49:35.268] Build status: STARTED
[19:49:35.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:8:0) after 1m46s
[19:51:21.283] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:8:0)
[19:51:21.304] Build status: STARTED
[19:51:21.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:9:0) after 8m59s
[20:00:20.342] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:9:0)
[20:00:20.367] Build status: STARTED
[20:00:20.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:10:0) after 8m0s
[20:08:20.552] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:10:0)
[20:08:20.572] Build status: STARTED
[20:08:20.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:11:0) after 5m35s
[20:13:55.609] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:11:0)
[20:13:55.631] Build status: STARTED
[20:13:55.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:12:0) after 4m8s
[20:18:03.659] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:12:0)
[20:18:03.677] Build status: STARTED
[20:18:03.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:13:0) after 6m37s
[20:24:40.782] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:13:0)
[20:24:40.810] Build status: STARTED
[20:24:40.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:14:0) after 8m42s
[20:33:22.954] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:14:0)
[20:33:22.971] Build status: STARTED
[20:33:22.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:15:0) after 8m42s
[20:42:05.142] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:15:0)
[20:42:05.163] Build status: STARTED
[20:42:05.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:16:0) after 7m28s
[20:49:33.481] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:16:0)
[20:49:33.504] Build status: STARTED
[20:49:33.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:17:0) after 6m7s
[20:55:40.529] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:17:0)
[20:55:40.551] Build status: STARTED
[20:55:40.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:18:0) after 6m54s
[21:02:34.638] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:18:0)
[21:02:34.666] Build status: STARTED
[21:02:34.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:19:0) after 6m9s
[21:08:43.666] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:19:0)
[21:08:43.682] Build status: STARTED
[21:08:43.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:20:0) after 1m54s
[21:10:37.710] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:20:0)
[21:10:37.727] Build status: STARTED
[21:10:37.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:21:0) after 9m27s
[21:20:04.967] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:21:0)
[21:20:04.983] Build status: STARTED
[21:20:04.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:22:0) after 9m41s
[21:29:46.054] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:22:0)
[21:29:46.074] Build status: STARTED
[21:29:46.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:23:0) after 1m15s
[21:31:01.129] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:23:0)
[21:31:01.155] Build status: STARTED
[21:31:01.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:24:0) after 9m6s
[21:40:07.173] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:24:0)
[21:40:07.193] Build status: STARTED
[21:40:07.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:25:0) after 4m38s
[21:44:45.210] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:25:0)
[21:44:45.231] Build status: STARTED
[21:44:45.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:26:0) after 1m18s
[21:46:03.251] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:26:0)
[21:46:03.269] Build status: STARTED
[21:46:03.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:27:0) after 4m51s
[21:50:54.388] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:27:0)
[21:50:54.409] Build status: STARTED
[21:50:54.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:28:0) after 5m21s
[21:56:15.426] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:28:0)
[21:56:15.451] Build status: STARTED
[21:56:15.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:29:0) after 1m17s
[21:57:32.559] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:29:0)
[21:57:32.592] Build status: STARTED
[21:57:32.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:30:0) after 4m9s
[22:01:41.710] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:30:0)
[22:01:41.773] Build status: STARTED
[22:01:41.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:31:0) after 7m43s
[22:09:24.972] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:31:0)
[22:09:24.989] Build status: STARTED
[22:09:24.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:32:0) after 5m1s
[22:14:26.073] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:32:0)
[22:14:26.093] Build status: STARTED
[22:14:26.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:33:0) after 3m32s
[22:17:58.188] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:33:0)
[22:17:58.209] Build status: STARTED
[22:17:58.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:34:0) after 3m20s
[22:21:18.226] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:34:0)
[22:21:18.279] Build status: STARTED
[22:21:18.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:35:0) after 1m42s
[22:23:00.312] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:35:0)
[22:23:00.355] Build status: STARTED
[22:23:00.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:36:0) after 9m9s
[22:32:09.383] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:36:0)
[22:32:09.594] Build status: STARTED
[22:32:09.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:37:0) after 4m44s
[22:36:53.758] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:37:0)
[22:36:53.777] Build status: STARTED
[22:36:53.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:38:0) after 6m18s
[22:43:11.890] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:38:0)
[22:43:12.175] Build status: STARTED
[22:43:12.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:39:0) after 5m28s
[22:48:40.294] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:39:0)
[22:48:40.325] Build status: STARTED
[22:48:40.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:40:0) after 9m38s
[22:58:18.362] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:40:0)
[22:58:18.382] Build status: STARTED
[22:58:18.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:41:0) after 2m49s
[23:01:07.433] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:41:0)
[23:01:07.450] Build status: STARTED
[23:01:07.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:42:0) after 3m19s
[23:04:26.499] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:42:0)
[23:04:26.521] Build status: STARTED
[23:04:26.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:43:0) after 2m27s
[23:06:53.522] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:43:0)
[23:06:53.545] Build status: STARTED
[23:06:53.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:44:0) after 6m44s
[23:13:37.762] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:44:0)
[23:13:37.778] Build status: STARTED
[23:13:37.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:45:0) after 3m39s
[23:17:16.857] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:45:0)
[23:17:16.879] Build status: STARTED
[23:17:16.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:46:0) after 1m34s
[23:18:51.010] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:46:0)
[23:18:51.027] Build status: STARTED
[23:18:51.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:47:0) after 5m19s
[23:24:10.121] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:47:0)
[23:24:10.222] Build status: STARTED
[23:24:10.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:48:0) after 7m11s
[23:31:21.216] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:48:0)
[23:31:21.243] Build status: STARTED
[23:31:21.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:49:0) after 3m49s
[23:35:10.418] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:49:0)
[23:35:10.448] Build status: STARTED
[23:35:10.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:50:0) after 3m37s
[23:38:47.465] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:50:0)
[23:38:47.496] Build status: STARTED
[23:38:47.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:51:0) after 3m25s
[23:42:12.640] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:51:0)
[23:42:12.658] Build status: STARTED
[23:42:12.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:52:0) after 8m51s
[23:51:03.693] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:52:0)
[23:51:03.713] Build status: STARTED
[23:51:03.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:53:0) after 8m20s
[23:59:23.752] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:53:0)
[23:59:23.787] Build status: STARTED
[23:59:23.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:54:0) after 4m3s
[00:03:26.879] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:54:0)
[00:03:26.910] Build status: STARTED
[00:03:26.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:55:0) after 4m40s
[00:08:07.081] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:55:0)
[00:08:07.135] Build status: STARTED
[00:08:07.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:56:0) after 9m48s
[00:17:55.226] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:56:0)
[00:17:55.245] Build status: STARTED
[00:17:55.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:57:0) after 8m19s
[00:26:14.260] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:57:0)
[00:26:14.285] Build status: STARTED
[00:26:14.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:58:0) after 4m24s
[00:30:38.545] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:58:0)
[00:30:38.560] Build status: STARTED
[00:30:38.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:59:0) after 5m49s
[00:36:27.624] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:59:0)
[00:36:27.677] Build status: STARTED
[00:36:27.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:60:0) after 4m40s
[00:41:07.807] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:60:0)
[00:41:07.832] Build status: STARTED
[00:41:07.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942720464115324784:61:0) after 8m6s
[00:42:20.675] Received PubSub notification, asking Buildbucket for the build status
[00:42:20.691] Build:
{
"id": "8777290401764584001",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29820,
"createdBy": "project:chromium",
"createTime": "2023-06-25T19:16:38.406941521Z",
"startTime": "2023-06-25T19:20:02.444609Z",
"endTime": "2023-06-26T00:42:18.037364601Z",
"updateTime": "2023-06-26T00:42:18.037364601Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9a12cc2ff08a1c73ba3735346feaa9fea7717569",
"ref": "refs/heads/main"
}
}
}
[00:42:20.691] Invocation finished in 5h25m43.910436295s with status FAILED