[16:35:20.325] New invocation is queued and will start shortly
[16:35:21.427] Starting the invocation (attempt 1)
[16:35:21.476] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/ed6e5a06aab58d7f9bb645fa1f906b2ecf56bb6e"
[16:35:21.476] Popped gitiles commit info from properties and tags
[16:35:21.476] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:35:21.476] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:35:21.476] Buildbucket request:
{
"requestId": "8945992101413166384",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ed6e5a06aab58d7f9bb645fa1f906b2ecf56bb6e",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8945992101413166384"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:35:21.920] Scheduled build:
{
"id": "8780562039475867089",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29444,
"createdBy": "project:chromium",
"createTime": "2023-05-20T16:35:21.548934337Z",
"updateTime": "2023-05-20T16:35:21.548934337Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ed6e5a06aab58d7f9bb645fa1f906b2ecf56bb6e",
"ref": "refs/heads/main"
}
}
}
[16:35:21.920] Task URL: https://cr-buildbucket.appspot.com/build/8780562039475867089
[16:35:21.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:2:0) after 4m17s
[16:38:14.567] Received PubSub notification, asking Buildbucket for the build status
[16:38:14.603] Build status: STARTED
[16:39:38.937] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:2:0)
[16:39:38.959] Build status: STARTED
[16:39:38.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:4:0) after 1m51s
[16:41:29.980] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:4:0)
[16:41:30.010] Build status: STARTED
[16:41:30.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:5:0) after 3m39s
[16:45:09.025] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:5:0)
[16:45:09.097] Build status: STARTED
[16:45:09.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:6:0) after 9m3s
[16:54:12.475] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:6:0)
[16:54:12.503] Build status: STARTED
[16:54:12.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:7:0) after 5m41s
[16:59:53.699] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:7:0)
[16:59:53.718] Build status: STARTED
[16:59:53.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:8:0) after 7m24s
[17:07:18.419] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:8:0)
[17:07:18.444] Build status: STARTED
[17:07:18.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:9:0) after 6m17s
[17:13:35.563] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:9:0)
[17:13:35.579] Build status: STARTED
[17:13:35.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:10:0) after 1m37s
[17:15:12.596] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:10:0)
[17:15:12.625] Build status: STARTED
[17:15:12.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:11:0) after 5m25s
[17:20:37.644] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:11:0)
[17:20:37.799] Build status: STARTED
[17:20:37.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:12:0) after 3m55s
[17:24:33.094] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:12:0)
[17:24:33.117] Build status: STARTED
[17:24:33.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:13:0) after 7m8s
[17:31:41.360] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:13:0)
[17:31:41.385] Build status: STARTED
[17:31:41.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:14:0) after 1m34s
[17:33:15.685] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:14:0)
[17:33:15.704] Build status: STARTED
[17:33:15.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:15:0) after 2m4s
[17:35:19.825] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:15:0)
[17:35:19.846] Build status: STARTED
[17:35:19.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:16:0) after 3m3s
[17:38:23.120] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:16:0)
[17:38:23.140] Build status: STARTED
[17:38:23.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:17:0) after 9m49s
[17:48:12.158] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:17:0)
[17:48:12.177] Build status: STARTED
[17:48:12.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:18:0) after 8m8s
[17:56:20.210] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:18:0)
[17:56:20.241] Build status: STARTED
[17:56:20.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:19:0) after 9m24s
[18:05:44.257] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:19:0)
[18:05:44.275] Build status: STARTED
[18:05:44.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:20:0) after 1m16s
[18:07:00.291] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:20:0)
[18:07:00.315] Build status: STARTED
[18:07:00.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:21:0) after 7m4s
[18:14:04.334] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:21:0)
[18:14:04.359] Build status: STARTED
[18:14:04.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:22:0) after 9m25s
[18:23:29.377] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:22:0)
[18:23:29.396] Build status: STARTED
[18:23:29.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:23:0) after 2m23s
[18:25:52.448] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:23:0)
[18:25:52.470] Build status: STARTED
[18:25:52.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:24:0) after 5m12s
[18:31:04.489] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:24:0)
[18:31:04.504] Build status: STARTED
[18:31:04.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:25:0) after 2m10s
[18:33:14.531] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:25:0)
[18:33:14.551] Build status: STARTED
[18:33:14.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:26:0) after 2m57s
[18:36:11.593] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:26:0)
[18:36:11.613] Build status: STARTED
[18:36:11.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:27:0) after 7m53s
[18:44:04.801] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:27:0)
[18:44:04.828] Build status: STARTED
[18:44:04.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:28:0) after 9m30s
[18:53:34.932] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:28:0)
[18:53:34.948] Build status: STARTED
[18:53:34.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:29:0) after 4m13s
[18:57:48.157] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:29:0)
[18:57:48.173] Build status: STARTED
[18:57:48.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:30:0) after 6m37s
[19:04:25.189] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:30:0)
[19:04:25.210] Build status: STARTED
[19:04:25.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:31:0) after 4m58s
[19:09:24.096] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:31:0)
[19:09:24.118] Build status: STARTED
[19:09:24.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:32:0) after 8m50s
[19:18:14.255] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:32:0)
[19:18:14.363] Build status: STARTED
[19:18:14.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:33:0) after 1m49s
[19:20:03.514] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:33:0)
[19:20:03.534] Build status: STARTED
[19:20:03.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:34:0) after 9m7s
[19:29:10.955] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:34:0)
[19:29:10.973] Build status: STARTED
[19:29:10.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:35:0) after 2m10s
[19:31:21.396] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:35:0)
[19:31:21.417] Build status: STARTED
[19:31:21.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:36:0) after 9m29s
[19:40:50.815] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:36:0)
[19:40:50.859] Build status: STARTED
[19:40:50.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:37:0) after 8m45s
[19:49:35.914] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:37:0)
[19:49:36.030] Build status: STARTED
[19:49:36.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:38:0) after 9m58s
[19:59:34.073] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:38:0)
[19:59:34.093] Build status: STARTED
[19:59:34.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:39:0) after 1m6s
[20:00:40.148] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:39:0)
[20:00:40.171] Build status: STARTED
[20:00:40.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:40:0) after 8m45s
[20:09:25.375] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:40:0)
[20:09:25.492] Build status: STARTED
[20:09:25.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:41:0) after 7m41s
[20:17:07.384] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:41:0)
[20:17:07.409] Build status: STARTED
[20:17:07.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:42:0) after 1m8s
[20:18:15.424] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:42:0)
[20:18:15.450] Build status: STARTED
[20:18:15.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:43:0) after 7m29s
[20:25:44.468] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:43:0)
[20:25:44.499] Build status: STARTED
[20:25:44.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:44:0) after 8m18s
[20:34:02.532] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:44:0)
[20:34:02.605] Build status: STARTED
[20:34:02.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:45:0) after 9m11s
[20:43:13.633] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:45:0)
[20:43:13.652] Build status: STARTED
[20:43:13.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:46:0) after 7m22s
[20:50:35.801] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:46:0)
[20:50:35.820] Build status: STARTED
[20:50:35.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:47:0) after 6m6s
[20:56:41.838] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:47:0)
[20:56:41.857] Build status: STARTED
[20:56:41.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:48:0) after 3m25s
[21:00:06.982] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:48:0)
[21:00:07.010] Build status: STARTED
[21:00:07.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:49:0) after 3m56s
[21:04:03.159] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:49:0)
[21:04:03.178] Build status: STARTED
[21:04:03.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:50:0) after 1m30s
[21:05:33.461] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:50:0)
[21:05:33.508] Build status: STARTED
[21:05:33.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:51:0) after 5m22s
[21:10:55.668] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:51:0)
[21:10:55.689] Build status: STARTED
[21:10:55.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:52:0) after 8m48s
[21:19:43.710] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:52:0)
[21:19:43.731] Build status: STARTED
[21:19:43.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:53:0) after 1m19s
[21:21:02.721] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:53:0)
[21:21:02.792] Build status: STARTED
[21:21:02.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:54:0) after 6m11s
[21:27:13.846] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:54:0)
[21:27:13.868] Build status: STARTED
[21:27:13.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:55:0) after 6m18s
[21:33:31.885] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:55:0)
[21:33:31.913] Build status: STARTED
[21:33:31.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:56:0) after 7m14s
[21:40:46.419] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:56:0)
[21:40:46.467] Build status: STARTED
[21:40:46.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:57:0) after 4m55s
[21:45:41.489] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:57:0)
[21:45:41.510] Build status: STARTED
[21:45:41.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:58:0) after 1m33s
[21:47:14.655] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:58:0)
[21:47:14.952] Build status: STARTED
[21:47:14.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:59:0) after 5m16s
[21:52:31.097] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:59:0)
[21:52:31.116] Build status: STARTED
[21:52:31.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:60:0) after 4m51s
[21:57:22.834] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:60:0)
[21:57:22.855] Build status: STARTED
[21:57:22.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945992101413166384:61:0) after 3m11s
[21:58:38.522] Received PubSub notification, asking Buildbucket for the build status
[21:58:38.540] Build:
{
"id": "8780562039475867089",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29444,
"createdBy": "project:chromium",
"createTime": "2023-05-20T16:35:21.548934337Z",
"startTime": "2023-05-20T16:38:13.991967Z",
"endTime": "2023-05-20T21:58:38.240210001Z",
"updateTime": "2023-05-20T21:58:38.240210001Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ed6e5a06aab58d7f9bb645fa1f906b2ecf56bb6e",
"ref": "refs/heads/main"
}
}
}
[21:58:38.540] Invocation finished in 5h23m18.222646618s with status FAILED