[15:51:36.230] New invocation is queued and will start shortly
[15:51:37.306] Starting the invocation (attempt 1)
[15:51:37.340] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9043eb38ae2e21e67ffa9fedf5c82f62711881dc"
[15:51:37.340] Popped gitiles commit info from properties and tags
[15:51:37.340] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:51:37.340] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:51:37.340] Buildbucket request:
{
"requestId": "9006241835639951248",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9043eb38ae2e21e67ffa9fedf5c82f62711881dc",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9006241835639951248"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:51:38.486] Scheduled build:
{
"id": "8840811773665283504",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22591,
"createdBy": "project:chromium",
"createTime": "2021-07-24T15:51:37.481623Z",
"updateTime": "2021-07-24T15:51:38.273168Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9043eb38ae2e21e67ffa9fedf5c82f62711881dc",
"ref": "refs/heads/main"
}
}
}
[15:51:38.486] Task URL: https://cr-buildbucket.appspot.com/build/8840811773665283504
[15:51:38.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:2:0) after 7m52s
[15:56:56.819] Received PubSub notification, asking Buildbucket for the build status
[15:56:56.848] Build status: STARTED
[15:59:30.704] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:2:0)
[15:59:30.735] Build status: STARTED
[15:59:30.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:4:0) after 4m32s
[16:04:02.983] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:4:0)
[16:04:03.012] Build status: STARTED
[16:04:03.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:5:0) after 6m3s
[16:10:06.481] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:5:0)
[16:10:06.595] Build status: STARTED
[16:10:06.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:6:0) after 8m55s
[16:19:01.726] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:6:0)
[16:19:01.766] Build status: STARTED
[16:19:01.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:7:0) after 6m18s
[16:25:19.875] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:7:0)
[16:25:19.907] Build status: STARTED
[16:25:19.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:8:0) after 4m0s
[16:29:20.086] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:8:0)
[16:29:20.118] Build status: STARTED
[16:29:20.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:9:0) after 9m15s
[16:38:36.200] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:9:0)
[16:38:36.232] Build status: STARTED
[16:38:36.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:10:0) after 7m42s
[16:46:18.912] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:10:0)
[16:46:18.944] Build status: STARTED
[16:46:18.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:11:0) after 3m2s
[16:49:21.308] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:11:0)
[16:49:21.447] Build status: STARTED
[16:49:21.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:12:0) after 4m5s
[16:53:26.463] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:12:0)
[16:53:26.493] Build status: STARTED
[16:53:26.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:13:0) after 1m59s
[16:55:25.613] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:13:0)
[16:55:25.649] Build status: STARTED
[16:55:25.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:14:0) after 9m24s
[17:04:49.876] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:14:0)
[17:04:49.911] Build status: STARTED
[17:04:49.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:15:0) after 6m19s
[17:11:08.941] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:15:0)
[17:11:09.007] Build status: STARTED
[17:11:09.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:16:0) after 6m37s
[17:17:46.118] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:16:0)
[17:17:46.148] Build status: STARTED
[17:17:46.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:17:0) after 6m50s
[17:24:37.223] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:17:0)
[17:24:37.245] Build status: STARTED
[17:24:37.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:18:0) after 9m21s
[17:33:58.346] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:18:0)
[17:33:58.376] Build status: STARTED
[17:33:58.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:19:0) after 8m45s
[17:42:43.533] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:19:0)
[17:42:43.568] Build status: STARTED
[17:42:43.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:20:0) after 1m13s
[17:43:56.814] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:20:0)
[17:43:56.843] Build status: STARTED
[17:43:56.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:21:0) after 3m26s
[17:47:22.861] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:21:0)
[17:47:22.916] Build status: STARTED
[17:47:22.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:22:0) after 3m52s
[17:51:15.069] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:22:0)
[17:51:15.110] Build status: STARTED
[17:51:15.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:23:0) after 4m42s
[17:55:57.162] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:23:0)
[17:55:57.197] Build status: STARTED
[17:55:57.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:24:0) after 6m8s
[18:02:05.226] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:24:0)
[18:02:05.267] Build status: STARTED
[18:02:05.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:25:0) after 8m31s
[18:10:36.460] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:25:0)
[18:10:36.512] Build status: STARTED
[18:10:36.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:26:0) after 7m19s
[18:17:55.989] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:26:0)
[18:17:56.017] Build status: STARTED
[18:17:56.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:27:0) after 6m16s
[18:24:12.706] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:27:0)
[18:24:12.732] Build status: STARTED
[18:24:12.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:28:0) after 1m38s
[18:25:50.874] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:28:0)
[18:25:50.905] Build status: STARTED
[18:25:50.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:29:0) after 1m41s
[18:27:31.960] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:29:0)
[18:27:31.988] Build status: STARTED
[18:27:31.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:30:0) after 2m31s
[18:30:03.157] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:30:0)
[18:30:03.257] Build status: STARTED
[18:30:03.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:31:0) after 4m26s
[18:34:29.813] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:31:0)
[18:34:29.869] Build status: STARTED
[18:34:29.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:32:0) after 4m40s
[18:39:09.900] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:32:0)
[18:39:09.932] Build status: STARTED
[18:39:09.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:33:0) after 2m18s
[18:41:27.919] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:33:0)
[18:41:27.948] Build status: STARTED
[18:41:27.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:34:0) after 8m47s
[18:50:15.044] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:34:0)
[18:50:15.078] Build status: STARTED
[18:50:15.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:35:0) after 7m6s
[18:57:21.162] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:35:0)
[18:57:21.191] Build status: STARTED
[18:57:21.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:36:0) after 8m11s
[19:05:32.479] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:36:0)
[19:05:32.507] Build status: STARTED
[19:05:32.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:37:0) after 8m36s
[19:14:08.529] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:37:0)
[19:14:08.556] Build status: STARTED
[19:14:08.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:38:0) after 1m30s
[19:15:38.867] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:38:0)
[19:15:38.894] Build status: STARTED
[19:15:38.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:39:0) after 3m41s
[19:19:19.922] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:39:0)
[19:19:19.972] Build status: STARTED
[19:19:19.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:40:0) after 6m15s
[19:25:36.213] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:40:0)
[19:25:36.253] Build status: STARTED
[19:25:36.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:41:0) after 1m16s
[19:26:52.417] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:41:0)
[19:26:52.448] Build status: STARTED
[19:26:52.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:42:0) after 9m3s
[19:35:55.667] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:42:0)
[19:35:55.706] Build status: STARTED
[19:35:55.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:43:0) after 3m5s
[19:39:01.022] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:43:0)
[19:39:01.057] Build status: STARTED
[19:39:01.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:44:0) after 1m58s
[19:40:59.219] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:44:0)
[19:40:59.250] Build status: STARTED
[19:40:59.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:45:0) after 8m36s
[19:49:35.809] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:45:0)
[19:49:35.841] Build status: STARTED
[19:49:35.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:46:0) after 8m13s
[19:57:49.061] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:46:0)
[19:57:49.091] Build status: STARTED
[19:57:49.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:47:0) after 3m43s
[20:01:32.334] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:47:0)
[20:01:32.363] Build status: STARTED
[20:01:32.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:48:0) after 6m18s
[20:07:50.501] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:48:0)
[20:07:50.530] Build status: STARTED
[20:07:50.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:49:0) after 4m53s
[20:12:43.906] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:49:0)
[20:12:43.932] Build status: STARTED
[20:12:43.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:50:0) after 1m9s
[20:13:53.189] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:50:0)
[20:13:53.217] Build status: STARTED
[20:13:53.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:51:0) after 8m18s
[20:22:11.341] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:51:0)
[20:22:11.373] Build status: STARTED
[20:22:11.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:52:0) after 6m41s
[20:28:52.464] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:52:0)
[20:28:52.494] Build status: STARTED
[20:28:52.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:53:0) after 5m41s
[20:34:33.514] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:53:0)
[20:34:33.573] Build status: STARTED
[20:34:33.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:54:0) after 3m57s
[20:38:31.108] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:54:0)
[20:38:31.161] Build status: STARTED
[20:38:31.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:55:0) after 4m1s
[20:42:32.771] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:55:0)
[20:42:32.800] Build status: STARTED
[20:42:32.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:56:0) after 7m47s
[20:50:20.586] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:56:0)
[20:50:20.612] Build status: STARTED
[20:50:20.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:57:0) after 4m36s
[20:54:56.632] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:57:0)
[20:54:56.678] Build status: STARTED
[20:54:56.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:58:0) after 1m0s
[20:55:56.696] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:58:0)
[20:55:56.725] Build status: STARTED
[20:55:56.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:59:0) after 8m27s
[21:04:23.752] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:59:0)
[21:04:23.784] Build status: STARTED
[21:04:23.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9006241835639951248:60:0) after 6m25s
[21:06:52.702] Received PubSub notification, asking Buildbucket for the build status
[21:06:52.735] Build:
{
"id": "8840811773665283504",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22591,
"createdBy": "project:chromium",
"createTime": "2021-07-24T15:51:37.481623Z",
"startTime": "2021-07-24T15:53:48.566221Z",
"endTime": "2021-07-24T21:06:52.295130985Z",
"updateTime": "2021-07-24T21:06:52.295608687Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9043eb38ae2e21e67ffa9fedf5c82f62711881dc",
"ref": "refs/heads/main"
}
}
}
[21:06:52.735] Invocation finished in 5h15m16.520832206s with status FAILED