[17:40:18.225] New invocation is queued and will start shortly
[17:40:19.285] Starting the invocation (attempt 1)
[17:40:19.321] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/bbef38e55c96470ada53549a674c5bd0f13ad3c8"
[17:40:19.321] Popped gitiles commit info from properties and tags
[17:40:19.321] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[17:40:19.321] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[17:40:19.321] Buildbucket request:
{
"requestId": "8943632493041692256",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bbef38e55c96470ada53549a674c5bd0f13ad3c8",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8943632493041692256"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[17:40:20.250] Scheduled build:
{
"id": "8778202431131327841",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29738,
"createdBy": "project:chromium",
"createTime": "2023-06-15T17:40:19.423577812Z",
"updateTime": "2023-06-15T17:40:19.423577812Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bbef38e55c96470ada53549a674c5bd0f13ad3c8",
"ref": "refs/heads/main"
}
},
"canary": true
}
[17:40:20.250] Task URL: https://cr-buildbucket.appspot.com/build/8778202431131327841
[17:40:20.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:2:0) after 8m17s
[17:44:46.970] Received PubSub notification, asking Buildbucket for the build status
[17:44:46.993] Build status: STARTED
[17:48:37.385] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:2:0)
[17:48:37.402] Build status: STARTED
[17:48:37.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:4:0) after 5m4s
[17:53:41.425] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:4:0)
[17:53:41.454] Build status: STARTED
[17:53:41.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:5:0) after 1m46s
[17:55:27.728] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:5:0)
[17:55:27.787] Build status: STARTED
[17:55:27.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:6:0) after 7m14s
[18:02:42.149] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:6:0)
[18:02:42.170] Build status: STARTED
[18:02:42.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:7:0) after 4m9s
[18:06:51.191] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:7:0)
[18:06:51.218] Build status: STARTED
[18:06:51.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:8:0) after 1m11s
[18:08:02.318] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:8:0)
[18:08:02.475] Build status: STARTED
[18:08:02.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:9:0) after 4m52s
[18:12:54.591] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:9:0)
[18:12:54.614] Build status: STARTED
[18:12:54.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:10:0) after 9m21s
[18:22:15.684] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:10:0)
[18:22:15.712] Build status: STARTED
[18:22:15.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:11:0) after 1m26s
[18:23:41.852] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:11:0)
[18:23:41.902] Build status: STARTED
[18:23:41.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:12:0) after 6m14s
[18:29:55.924] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:12:0)
[18:29:55.941] Build status: STARTED
[18:29:55.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:13:0) after 5m24s
[18:35:20.190] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:13:0)
[18:35:20.207] Build status: STARTED
[18:35:20.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:14:0) after 1m23s
[18:36:43.683] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:14:0)
[18:36:43.703] Build status: STARTED
[18:36:43.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:15:0) after 3m1s
[18:39:44.891] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:15:0)
[18:39:44.922] Build status: STARTED
[18:39:44.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:16:0) after 8m16s
[18:48:01.236] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:16:0)
[18:48:01.304] Build status: STARTED
[18:48:01.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:17:0) after 3m12s
[18:51:13.836] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:17:0)
[18:51:13.860] Build status: STARTED
[18:51:13.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:18:0) after 8m28s
[18:59:42.206] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:18:0)
[18:59:42.231] Build status: STARTED
[18:59:42.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:19:0) after 8m53s
[19:08:35.370] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:19:0)
[19:08:35.389] Build status: STARTED
[19:08:35.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:20:0) after 9m13s
[19:17:48.607] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:20:0)
[19:17:48.630] Build status: STARTED
[19:17:48.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:21:0) after 9m20s
[19:27:08.667] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:21:0)
[19:27:08.685] Build status: STARTED
[19:27:08.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:22:0) after 2m23s
[19:29:31.714] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:22:0)
[19:29:31.733] Build status: STARTED
[19:29:31.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:23:0) after 8m26s
[19:37:57.776] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:23:0)
[19:37:57.793] Build status: STARTED
[19:37:57.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:24:0) after 5m45s
[19:43:43.165] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:24:0)
[19:43:43.190] Build status: STARTED
[19:43:43.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:25:0) after 4m29s
[19:48:12.424] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:25:0)
[19:48:12.462] Build status: STARTED
[19:48:12.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:26:0) after 9m5s
[19:57:17.485] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:26:0)
[19:57:17.510] Build status: STARTED
[19:57:17.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:27:0) after 7m57s
[20:05:14.580] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:27:0)
[20:05:14.638] Build status: STARTED
[20:05:14.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:28:0) after 3m37s
[20:08:51.811] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:28:0)
[20:08:51.838] Build status: STARTED
[20:08:51.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:29:0) after 6m46s
[20:15:38.227] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:29:0)
[20:15:38.248] Build status: STARTED
[20:15:38.248] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:30:0) after 8m43s
[20:24:22.224] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:30:0)
[20:24:22.243] Build status: STARTED
[20:24:22.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:31:0) after 9m9s
[20:33:31.263] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:31:0)
[20:33:31.282] Build status: STARTED
[20:33:31.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:32:0) after 1m54s
[20:35:25.451] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:32:0)
[20:35:25.488] Build status: STARTED
[20:35:25.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:33:0) after 6m1s
[20:41:26.610] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:33:0)
[20:41:26.626] Build status: STARTED
[20:41:26.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:34:0) after 5m23s
[20:46:49.757] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:34:0)
[20:46:49.775] Build status: STARTED
[20:46:49.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:35:0) after 7m43s
[20:54:32.852] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:35:0)
[20:54:32.872] Build status: STARTED
[20:54:32.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:36:0) after 4m55s
[20:59:28.098] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:36:0)
[20:59:28.125] Build status: STARTED
[20:59:28.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:37:0) after 4m55s
[21:04:23.153] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:37:0)
[21:04:23.174] Build status: STARTED
[21:04:23.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:38:0) after 1m7s
[21:05:30.181] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:38:0)
[21:05:30.217] Build status: STARTED
[21:05:30.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:39:0) after 3m15s
[21:08:45.280] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:39:0)
[21:08:45.309] Build status: STARTED
[21:08:45.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:40:0) after 9m49s
[21:18:34.346] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:40:0)
[21:18:34.366] Build status: STARTED
[21:18:34.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:41:0) after 1m13s
[21:19:47.392] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:41:0)
[21:19:47.417] Build status: STARTED
[21:19:47.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:42:0) after 5m18s
[21:25:05.543] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:42:0)
[21:25:05.567] Build status: STARTED
[21:25:05.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:43:0) after 1m16s
[21:26:21.800] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:43:0)
[21:26:21.823] Build status: STARTED
[21:26:21.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:44:0) after 5m31s
[21:31:53.590] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:44:0)
[21:31:53.611] Build status: STARTED
[21:31:53.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:45:0) after 1m24s
[21:33:17.622] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:45:0)
[21:33:17.648] Build status: STARTED
[21:33:17.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:46:0) after 8m21s
[21:41:38.687] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:46:0)
[21:41:38.713] Build status: STARTED
[21:41:38.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:47:0) after 3m38s
[21:45:16.762] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:47:0)
[21:45:16.780] Build status: STARTED
[21:45:16.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:48:0) after 8m36s
[21:53:52.818] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:48:0)
[21:53:52.877] Build status: STARTED
[21:53:52.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:49:0) after 1m50s
[21:55:42.934] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:49:0)
[21:55:42.959] Build status: STARTED
[21:55:42.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:50:0) after 4m38s
[22:00:21.085] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:50:0)
[22:00:21.125] Build status: STARTED
[22:00:21.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:51:0) after 3m57s
[22:04:18.152] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:51:0)
[22:04:18.186] Build status: STARTED
[22:04:18.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:52:0) after 7m45s
[22:12:03.379] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:52:0)
[22:12:03.403] Build status: STARTED
[22:12:03.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:53:0) after 1m58s
[22:14:01.710] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:53:0)
[22:14:01.732] Build status: STARTED
[22:14:01.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:54:0) after 3m36s
[22:17:37.775] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:54:0)
[22:17:37.819] Build status: STARTED
[22:17:37.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:55:0) after 4m7s
[22:21:45.029] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:55:0)
[22:21:45.054] Build status: STARTED
[22:21:45.054] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:56:0) after 6m33s
[22:28:18.125] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:56:0)
[22:28:18.143] Build status: STARTED
[22:28:18.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:57:0) after 9m35s
[22:37:53.233] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:57:0)
[22:37:53.252] Build status: STARTED
[22:37:53.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:58:0) after 1m57s
[22:39:50.279] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:58:0)
[22:39:50.324] Build status: STARTED
[22:39:50.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:59:0) after 5m45s
[22:45:35.460] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:59:0)
[22:45:35.478] Build status: STARTED
[22:45:35.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:60:0) after 7m50s
[22:53:25.613] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:60:0)
[22:53:25.636] Build status: STARTED
[22:53:25.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:61:0) after 1m11s
[22:54:36.649] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:61:0)
[22:54:36.689] Build status: STARTED
[22:54:36.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8943632493041692256:62:0) after 8m24s
[23:00:15.050] Received PubSub notification, asking Buildbucket for the build status
[23:00:15.079] Build:
{
"id": "8778202431131327841",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29738,
"createdBy": "project:chromium",
"createTime": "2023-06-15T17:40:19.423577812Z",
"startTime": "2023-06-15T17:44:46.325203Z",
"endTime": "2023-06-15T23:00:14.762759905Z",
"updateTime": "2023-06-15T23:00:14.762759905Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bbef38e55c96470ada53549a674c5bd0f13ad3c8",
"ref": "refs/heads/main"
}
},
"canary": true
}
[23:00:15.079] Invocation finished in 5h19m56.861666159s with status FAILED