[10:30:41.128] New invocation is queued and will start shortly
[10:30:42.350] Starting the invocation (attempt 1)
[10:30:42.381] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/ec43bf273cde789eca444ccdb911f885cb8f970b"
[10:30:42.381] Popped gitiles commit info from properties and tags
[10:30:42.381] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:30:42.382] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:30:42.382] Buildbucket request:
{
"requestId": "8996658747638704128",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ec43bf273cde789eca444ccdb911f885cb8f970b",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8996658747638704128"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:30:42.925] Scheduled build:
{
"id": "8831228685600722593",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23522,
"createdBy": "project:chromium",
"createTime": "2021-11-07T10:30:42.440350078Z",
"updateTime": "2021-11-07T10:30:42.440350078Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ec43bf273cde789eca444ccdb911f885cb8f970b",
"ref": "refs/heads/main"
}
}
}
[10:30:42.925] Task URL: https://cr-buildbucket.appspot.com/build/8831228685600722593
[10:30:42.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:2:0) after 3m28s
[10:33:19.308] Received PubSub notification, asking Buildbucket for the build status
[10:33:19.335] Build status: STARTED
[10:34:10.939] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:2:0)
[10:34:10.968] Build status: STARTED
[10:34:10.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:4:0) after 9m25s
[10:43:36.031] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:4:0)
[10:43:36.064] Build status: STARTED
[10:43:36.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:5:0) after 6m25s
[10:50:01.152] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:5:0)
[10:50:01.192] Build status: STARTED
[10:50:01.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:6:0) after 7m27s
[10:57:28.711] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:6:0)
[10:57:28.737] Build status: STARTED
[10:57:28.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:7:0) after 5m24s
[11:02:52.755] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:7:0)
[11:02:52.791] Build status: STARTED
[11:02:52.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:8:0) after 4m3s
[11:06:55.894] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:8:0)
[11:06:55.921] Build status: STARTED
[11:06:55.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:9:0) after 6m24s
[11:13:20.161] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:9:0)
[11:13:20.192] Build status: STARTED
[11:13:20.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:10:0) after 4m3s
[11:17:23.209] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:10:0)
[11:17:23.242] Build status: STARTED
[11:17:23.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:11:0) after 6m28s
[11:23:51.265] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:11:0)
[11:23:51.295] Build status: STARTED
[11:23:51.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:12:0) after 3m46s
[11:27:37.506] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:12:0)
[11:27:37.533] Build status: STARTED
[11:27:37.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:13:0) after 7m48s
[11:35:25.551] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:13:0)
[11:35:25.580] Build status: STARTED
[11:35:25.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:14:0) after 6m19s
[11:41:44.805] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:14:0)
[11:41:44.830] Build status: STARTED
[11:41:44.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:15:0) after 7m46s
[11:49:31.010] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:15:0)
[11:49:31.042] Build status: STARTED
[11:49:31.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:16:0) after 3m59s
[11:53:30.062] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:16:0)
[11:53:30.106] Build status: STARTED
[11:53:30.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:17:0) after 7m22s
[12:00:52.287] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:17:0)
[12:00:52.379] Build status: STARTED
[12:00:52.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:18:0) after 9m38s
[12:10:30.503] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:18:0)
[12:10:30.531] Build status: STARTED
[12:10:30.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:19:0) after 9m13s
[12:19:43.747] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:19:0)
[12:19:43.812] Build status: STARTED
[12:19:43.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:20:0) after 8m4s
[12:27:47.937] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:20:0)
[12:27:47.962] Build status: STARTED
[12:27:47.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:21:0) after 9m29s
[12:37:17.692] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:21:0)
[12:37:17.718] Build status: STARTED
[12:37:17.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:22:0) after 7m40s
[12:44:57.736] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:22:0)
[12:44:57.763] Build status: STARTED
[12:44:57.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:23:0) after 1m5s
[12:46:02.783] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:23:0)
[12:46:02.821] Build status: STARTED
[12:46:02.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:24:0) after 5m36s
[12:51:38.882] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:24:0)
[12:51:38.922] Build status: STARTED
[12:51:38.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:25:0) after 5m29s
[12:57:08.278] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:25:0)
[12:57:08.303] Build status: STARTED
[12:57:08.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:26:0) after 8m13s
[13:05:21.322] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:26:0)
[13:05:21.353] Build status: STARTED
[13:05:21.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:27:0) after 1m13s
[13:06:34.513] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:27:0)
[13:06:34.547] Build status: STARTED
[13:06:34.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:28:0) after 6m32s
[13:13:06.566] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:28:0)
[13:13:06.608] Build status: STARTED
[13:13:06.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:29:0) after 9m13s
[13:22:19.696] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:29:0)
[13:22:19.722] Build status: STARTED
[13:22:19.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:30:0) after 3m30s
[13:25:50.435] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:30:0)
[13:25:50.465] Build status: STARTED
[13:25:50.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:31:0) after 6m38s
[13:32:28.484] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:31:0)
[13:32:28.518] Build status: STARTED
[13:32:28.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:32:0) after 2m12s
[13:34:40.546] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:32:0)
[13:34:40.594] Build status: STARTED
[13:34:40.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:33:0) after 8m47s
[13:43:27.673] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:33:0)
[13:43:27.716] Build status: STARTED
[13:43:27.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:34:0) after 6m46s
[13:50:13.751] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:34:0)
[13:50:13.781] Build status: STARTED
[13:50:13.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:35:0) after 6m17s
[13:56:30.804] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:35:0)
[13:56:30.843] Build status: STARTED
[13:56:30.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:36:0) after 1m21s
[13:57:52.113] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:36:0)
[13:57:52.141] Build status: STARTED
[13:57:52.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:37:0) after 8m27s
[14:06:19.402] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:37:0)
[14:06:19.433] Build status: STARTED
[14:06:19.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:38:0) after 7m5s
[14:13:24.734] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:38:0)
[14:13:24.762] Build status: STARTED
[14:13:24.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:39:0) after 5m59s
[14:19:23.960] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:39:0)
[14:19:23.990] Build status: STARTED
[14:19:23.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:40:0) after 4m57s
[14:24:21.166] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:40:0)
[14:24:21.240] Build status: STARTED
[14:24:21.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:41:0) after 2m58s
[14:27:19.261] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:41:0)
[14:27:19.299] Build status: STARTED
[14:27:19.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:42:0) after 3m45s
[14:31:04.437] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:42:0)
[14:31:04.474] Build status: STARTED
[14:31:04.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:43:0) after 6m31s
[14:37:35.491] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:43:0)
[14:37:35.523] Build status: STARTED
[14:37:35.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:44:0) after 7m31s
[14:45:06.566] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:44:0)
[14:45:06.604] Build status: STARTED
[14:45:06.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:45:0) after 3m17s
[14:48:24.057] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:45:0)
[14:48:24.094] Build status: STARTED
[14:48:24.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:46:0) after 4m45s
[14:53:09.308] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:46:0)
[14:53:09.339] Build status: STARTED
[14:53:09.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:47:0) after 3m35s
[14:56:44.697] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:47:0)
[14:56:44.723] Build status: STARTED
[14:56:44.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:48:0) after 5m59s
[15:02:43.755] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:48:0)
[15:02:43.779] Build status: STARTED
[15:02:43.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:49:0) after 7m1s
[15:09:45.127] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:49:0)
[15:09:45.163] Build status: STARTED
[15:09:45.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:50:0) after 3m56s
[15:13:41.185] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:50:0)
[15:13:41.211] Build status: STARTED
[15:13:41.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:51:0) after 7m59s
[15:21:40.229] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:51:0)
[15:21:40.273] Build status: STARTED
[15:21:40.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:52:0) after 6m25s
[15:28:05.304] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:52:0)
[15:28:05.337] Build status: STARTED
[15:28:05.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:53:0) after 8m10s
[15:36:15.354] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:53:0)
[15:36:15.387] Build status: STARTED
[15:36:15.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:54:0) after 4m20s
[15:40:35.862] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:54:0)
[15:40:35.912] Build status: STARTED
[15:40:35.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:55:0) after 7m21s
[15:47:57.623] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:55:0)
[15:47:57.650] Build status: STARTED
[15:47:57.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996658747638704128:56:0) after 2m21s
[15:48:38.774] Received PubSub notification, asking Buildbucket for the build status
[15:48:38.799] Build:
{
"id": "8831228685600722593",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23522,
"createdBy": "project:chromium",
"createTime": "2021-11-07T10:30:42.440350078Z",
"startTime": "2021-11-07T10:33:19.080061752Z",
"endTime": "2021-11-07T15:48:37.880574034Z",
"updateTime": "2021-11-07T15:48:37.880574034Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ec43bf273cde789eca444ccdb911f885cb8f970b",
"ref": "refs/heads/main"
}
}
}
[15:48:38.799] Invocation finished in 5h17m57.68600017s with status FAILED