[11:29:42.729] New invocation is queued and will start shortly
[11:29:43.825] Starting the invocation (attempt 1)
[11:29:43.854] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c1c8f76b3b53f0134c9fe31c9dfc07bf998596da"
[11:29:43.854] Popped gitiles commit info from properties and tags
[11:29:43.854] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[11:29:43.854] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[11:29:43.854] Buildbucket request:
{
"requestId": "8942296854151686208",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c1c8f76b3b53f0134c9fe31c9dfc07bf998596da",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8942296854151686208"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[11:29:44.282] Scheduled build:
{
"id": "8776866792259694657",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29843,
"createdBy": "project:chromium",
"createTime": "2023-06-30T11:29:43.911759638Z",
"updateTime": "2023-06-30T11:29:43.911759638Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c1c8f76b3b53f0134c9fe31c9dfc07bf998596da",
"ref": "refs/heads/main"
}
},
"canary": true
}
[11:29:44.282] Task URL: https://cr-buildbucket.appspot.com/build/8776866792259694657
[11:29:44.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:2:0) after 8m29s
[11:33:10.817] Received PubSub notification, asking Buildbucket for the build status
[11:33:10.839] Build status: STARTED
[11:38:13.301] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:2:0)
[11:38:13.329] Build status: STARTED
[11:38:13.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:4:0) after 1m22s
[11:39:35.449] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:4:0)
[11:39:35.525] Build status: STARTED
[11:39:35.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:5:0) after 4m48s
[11:44:23.565] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:5:0)
[11:44:23.589] Build status: STARTED
[11:44:23.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:6:0) after 7m33s
[11:51:56.609] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:6:0)
[11:51:56.637] Build status: STARTED
[11:51:56.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:7:0) after 8m59s
[12:00:55.653] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:7:0)
[12:00:55.669] Build status: STARTED
[12:00:55.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:8:0) after 5m8s
[12:06:03.721] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:8:0)
[12:06:03.738] Build status: STARTED
[12:06:03.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:9:0) after 4m42s
[12:10:45.902] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:9:0)
[12:10:45.923] Build status: STARTED
[12:10:45.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:10:0) after 9m1s
[12:19:47.137] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:10:0)
[12:19:47.171] Build status: STARTED
[12:19:47.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:11:0) after 8m1s
[12:27:48.158] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:11:0)
[12:27:48.215] Build status: STARTED
[12:27:48.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:12:0) after 9m37s
[12:37:25.278] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:12:0)
[12:37:25.304] Build status: STARTED
[12:37:25.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:13:0) after 4m33s
[12:41:58.502] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:13:0)
[12:41:58.539] Build status: STARTED
[12:41:58.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:14:0) after 9m4s
[12:51:02.575] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:14:0)
[12:51:02.598] Build status: STARTED
[12:51:02.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:15:0) after 7m52s
[12:58:54.714] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:15:0)
[12:58:54.779] Build status: STARTED
[12:58:54.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:16:0) after 1m44s
[13:00:38.833] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:16:0)
[13:00:38.857] Build status: STARTED
[13:00:38.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:17:0) after 1m42s
[13:02:21.099] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:17:0)
[13:02:21.125] Build status: STARTED
[13:02:21.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:18:0) after 6m1s
[13:08:22.242] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:18:0)
[13:08:22.263] Build status: STARTED
[13:08:22.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:19:0) after 6m36s
[13:14:58.381] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:19:0)
[13:14:58.401] Build status: STARTED
[13:14:58.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:20:0) after 4m25s
[13:19:23.388] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:20:0)
[13:19:23.408] Build status: STARTED
[13:19:23.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:21:0) after 7m28s
[13:26:51.749] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:21:0)
[13:26:51.765] Build status: STARTED
[13:26:51.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:22:0) after 9m49s
[13:36:40.953] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:22:0)
[13:36:40.991] Build status: STARTED
[13:36:40.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:23:0) after 9m16s
[13:45:57.015] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:23:0)
[13:45:57.035] Build status: STARTED
[13:45:57.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:24:0) after 6m27s
[13:52:24.059] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:24:0)
[13:52:24.079] Build status: STARTED
[13:52:24.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:25:0) after 2m54s
[13:55:18.320] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:25:0)
[13:55:18.339] Build status: STARTED
[13:55:18.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:26:0) after 5m21s
[14:00:39.361] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:26:0)
[14:00:39.383] Build status: STARTED
[14:00:39.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:27:0) after 5m54s
[14:06:33.519] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:27:0)
[14:06:33.538] Build status: STARTED
[14:06:33.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:28:0) after 1m54s
[14:08:27.711] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:28:0)
[14:08:27.738] Build status: STARTED
[14:08:27.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:29:0) after 5m7s
[14:13:34.987] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:29:0)
[14:13:35.004] Build status: STARTED
[14:13:35.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:30:0) after 3m6s
[14:16:41.166] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:30:0)
[14:16:41.193] Build status: STARTED
[14:16:41.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:31:0) after 2m18s
[14:18:59.513] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:31:0)
[14:18:59.535] Build status: STARTED
[14:18:59.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:32:0) after 9m8s
[14:28:07.578] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:32:0)
[14:28:07.595] Build status: STARTED
[14:28:07.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:33:0) after 8m12s
[14:36:19.687] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:33:0)
[14:36:19.748] Build status: STARTED
[14:36:19.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:34:0) after 2m5s
[14:38:24.912] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:34:0)
[14:38:24.996] Build status: STARTED
[14:38:24.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:35:0) after 8m46s
[14:47:11.177] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:35:0)
[14:47:11.203] Build status: STARTED
[14:47:11.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:36:0) after 7m43s
[14:54:54.242] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:36:0)
[14:54:54.277] Build status: STARTED
[14:54:54.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:37:0) after 4m20s
[14:59:14.486] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:37:0)
[14:59:14.504] Build status: STARTED
[14:59:14.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:38:0) after 3m39s
[15:02:53.780] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:38:0)
[15:02:53.798] Build status: STARTED
[15:02:53.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:39:0) after 4m45s
[15:07:38.948] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:39:0)
[15:07:39.332] Build status: STARTED
[15:07:39.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:40:0) after 4m22s
[15:12:01.583] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:40:0)
[15:12:01.604] Build status: STARTED
[15:12:01.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:41:0) after 1m16s
[15:13:17.630] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:41:0)
[15:13:17.914] Build status: STARTED
[15:13:17.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:42:0) after 5m28s
[15:18:46.237] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:42:0)
[15:18:46.274] Build status: STARTED
[15:18:46.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:43:0) after 9m20s
[15:28:06.537] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:43:0)
[15:28:06.559] Build status: STARTED
[15:28:06.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:44:0) after 6m11s
[15:34:18.153] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:44:0)
[15:34:18.196] Build status: STARTED
[15:34:18.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:45:0) after 9m57s
[15:44:15.239] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:45:0)
[15:44:15.263] Build status: STARTED
[15:44:15.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:46:0) after 2m27s
[15:46:42.516] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:46:0)
[15:46:42.595] Build status: STARTED
[15:46:42.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:47:0) after 9m47s
[15:56:29.642] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:47:0)
[15:56:29.661] Build status: STARTED
[15:56:29.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:48:0) after 1m3s
[15:57:32.770] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:48:0)
[15:57:32.789] Build status: STARTED
[15:57:32.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:49:0) after 3m13s
[16:00:45.845] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:49:0)
[16:00:45.868] Build status: STARTED
[16:00:45.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:50:0) after 6m25s
[16:07:10.907] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:50:0)
[16:07:10.927] Build status: STARTED
[16:07:10.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:51:0) after 6m24s
[16:13:35.094] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:51:0)
[16:13:35.112] Build status: STARTED
[16:13:35.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:52:0) after 2m24s
[16:15:59.328] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:52:0)
[16:15:59.386] Build status: STARTED
[16:15:59.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:53:0) after 2m48s
[16:18:47.450] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:53:0)
[16:18:47.469] Build status: STARTED
[16:18:47.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:54:0) after 3m21s
[16:22:08.601] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:54:0)
[16:22:08.622] Build status: STARTED
[16:22:08.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:55:0) after 1m47s
[16:23:55.827] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:55:0)
[16:23:55.848] Build status: STARTED
[16:23:55.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:56:0) after 8m5s
[16:32:00.885] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:56:0)
[16:32:00.922] Build status: STARTED
[16:32:00.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:57:0) after 9m25s
[16:41:26.061] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:57:0)
[16:41:26.117] Build status: STARTED
[16:41:26.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:58:0) after 2m26s
[16:43:52.133] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:58:0)
[16:43:52.164] Build status: STARTED
[16:43:52.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:59:0) after 2m55s
[16:46:47.201] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:59:0)
[16:46:47.261] Build status: STARTED
[16:46:47.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:60:0) after 1m40s
[16:48:27.282] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:60:0)
[16:48:27.304] Build status: STARTED
[16:48:27.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:61:0) after 7m16s
[16:55:43.675] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:61:0)
[16:55:43.696] Build status: STARTED
[16:55:43.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:62:0) after 4m38s
[17:00:21.725] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:62:0)
[17:00:21.748] Build status: STARTED
[17:00:21.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:63:0) after 4m12s
[17:04:34.554] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:63:0)
[17:04:34.574] Build status: STARTED
[17:04:34.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942296854151686208:64:0) after 4m41s
[17:07:43.194] Received PubSub notification, asking Buildbucket for the build status
[17:07:43.233] Build:
{
"id": "8776866792259694657",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29843,
"createdBy": "project:chromium",
"createTime": "2023-06-30T11:29:43.911759638Z",
"startTime": "2023-06-30T11:33:10.039441Z",
"endTime": "2023-06-30T17:07:42.958917937Z",
"updateTime": "2023-06-30T17:07:42.958917937Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c1c8f76b3b53f0134c9fe31c9dfc07bf998596da",
"ref": "refs/heads/main"
}
},
"canary": true
}
[17:07:43.233] Invocation finished in 5h38m0.510176408s with status FAILED