[12:10:24.414] New invocation is queued and will start shortly
[12:10:25.489] Starting the invocation (attempt 1)
[12:10:25.534] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/940d6964f7122955103fe923f75f2c78f391bfde"
[12:10:25.534] Popped gitiles commit info from properties and tags
[12:10:25.534] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[12:10:25.535] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[12:10:25.535] Buildbucket request:
{
"requestId": "9008248885406475776",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "940d6964f7122955103fe923f75f2c78f391bfde",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9008248885406475776"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[12:10:27.437] Scheduled build:
{
"id": "8842818823267480192",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22475,
"createdBy": "project:chromium",
"createTime": "2021-07-02T12:10:25.824968Z",
"updateTime": "2021-07-02T12:10:27.140055Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "940d6964f7122955103fe923f75f2c78f391bfde",
"ref": "refs/heads/main"
}
},
"canary": true
}
[12:10:27.437] Task URL: https://cr-buildbucket.appspot.com/build/8842818823267480192
[12:10:27.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:2:0) after 6m26s
[12:13:25.334] Received PubSub notification, asking Buildbucket for the build status
[12:13:25.401] Build status: STARTED
[12:16:53.553] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:2:0)
[12:16:53.603] Build status: STARTED
[12:16:53.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:4:0) after 1m0s
[12:17:53.689] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:4:0)
[12:17:53.742] Build status: STARTED
[12:17:53.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:5:0) after 8m8s
[12:26:01.770] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:5:0)
[12:26:01.799] Build status: STARTED
[12:26:01.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:6:0) after 1m55s
[12:27:56.824] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:6:0)
[12:27:56.857] Build status: STARTED
[12:27:56.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:7:0) after 5m38s
[12:33:34.891] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:7:0)
[12:33:34.923] Build status: STARTED
[12:33:34.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:8:0) after 1m34s
[12:35:08.974] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:8:0)
[12:35:09.003] Build status: STARTED
[12:35:09.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:9:0) after 6m8s
[12:41:17.108] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:9:0)
[12:41:17.145] Build status: STARTED
[12:41:17.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:10:0) after 4m49s
[12:46:06.176] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:10:0)
[12:46:06.224] Build status: STARTED
[12:46:06.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:11:0) after 3m6s
[12:49:12.252] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:11:0)
[12:49:12.291] Build status: STARTED
[12:49:12.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:12:0) after 5m46s
[12:54:58.539] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:12:0)
[12:54:58.572] Build status: STARTED
[12:54:58.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:13:0) after 2m59s
[12:57:57.595] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:13:0)
[12:57:57.624] Build status: STARTED
[12:57:57.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:14:0) after 2m12s
[13:00:09.739] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:14:0)
[13:00:09.820] Build status: STARTED
[13:00:09.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:15:0) after 3m41s
[13:03:50.989] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:15:0)
[13:03:51.026] Build status: STARTED
[13:03:51.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:16:0) after 9m25s
[13:13:16.102] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:16:0)
[13:13:16.141] Build status: STARTED
[13:13:16.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:17:0) after 9m0s
[13:22:16.167] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:17:0)
[13:22:16.197] Build status: STARTED
[13:22:16.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:18:0) after 9m11s
[13:31:27.235] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:18:0)
[13:31:27.272] Build status: STARTED
[13:31:27.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:19:0) after 6m53s
[13:38:20.296] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:19:0)
[13:38:20.329] Build status: STARTED
[13:38:20.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:20:0) after 2m28s
[13:40:48.413] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:20:0)
[13:40:48.439] Build status: STARTED
[13:40:48.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:21:0) after 6m27s
[13:47:15.463] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:21:0)
[13:47:15.494] Build status: STARTED
[13:47:15.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:22:0) after 3m22s
[13:50:37.573] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:22:0)
[13:50:37.601] Build status: STARTED
[13:50:37.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:23:0) after 2m9s
[13:52:46.717] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:23:0)
[13:52:46.751] Build status: STARTED
[13:52:46.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:24:0) after 5m34s
[13:58:20.874] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:24:0)
[13:58:20.976] Build status: STARTED
[13:58:20.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:25:0) after 1m50s
[14:00:11.111] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:25:0)
[14:00:11.158] Build status: STARTED
[14:00:11.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:26:0) after 8m54s
[14:09:05.293] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:26:0)
[14:09:05.338] Build status: STARTED
[14:09:05.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:27:0) after 5m25s
[14:14:30.344] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:27:0)
[14:14:30.375] Build status: STARTED
[14:14:30.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:28:0) after 3m11s
[14:17:41.407] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:28:0)
[14:17:41.442] Build status: STARTED
[14:17:41.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:29:0) after 9m36s
[14:27:17.515] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:29:0)
[14:27:17.548] Build status: STARTED
[14:27:17.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:30:0) after 2m26s
[14:29:43.791] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:30:0)
[14:29:43.826] Build status: STARTED
[14:29:43.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:31:0) after 5m23s
[14:35:07.016] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:31:0)
[14:35:07.050] Build status: STARTED
[14:35:07.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:32:0) after 2m32s
[14:37:39.110] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:32:0)
[14:37:39.141] Build status: STARTED
[14:37:39.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:33:0) after 9m50s
[14:47:29.230] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:33:0)
[14:47:29.424] Build status: STARTED
[14:47:29.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:34:0) after 4m23s
[14:51:52.450] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:34:0)
[14:51:52.536] Build status: STARTED
[14:51:52.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:35:0) after 7m2s
[14:58:54.897] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:35:0)
[14:58:54.937] Build status: STARTED
[14:58:54.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:36:0) after 1m59s
[15:00:54.038] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:36:0)
[15:00:54.077] Build status: STARTED
[15:00:54.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:37:0) after 3m20s
[15:04:14.176] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:37:0)
[15:04:14.213] Build status: STARTED
[15:04:14.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:38:0) after 4m26s
[15:08:40.301] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:38:0)
[15:08:40.337] Build status: STARTED
[15:08:40.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:39:0) after 7m36s
[15:16:16.466] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:39:0)
[15:16:16.502] Build status: STARTED
[15:16:16.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:40:0) after 4m57s
[15:21:13.532] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:40:0)
[15:21:13.566] Build status: STARTED
[15:21:13.566] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:41:0) after 6m17s
[15:27:30.585] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:41:0)
[15:27:30.615] Build status: STARTED
[15:27:30.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:42:0) after 4m27s
[15:31:57.761] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:42:0)
[15:31:57.804] Build status: STARTED
[15:31:57.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:43:0) after 8m37s
[15:40:34.836] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:43:0)
[15:40:34.861] Build status: STARTED
[15:40:34.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:44:0) after 5m29s
[15:46:03.989] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:44:0)
[15:46:04.024] Build status: STARTED
[15:46:04.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:45:0) after 4m35s
[15:50:39.050] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:45:0)
[15:50:39.082] Build status: STARTED
[15:50:39.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:46:0) after 8m46s
[15:59:25.117] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:46:0)
[15:59:25.165] Build status: STARTED
[15:59:25.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:47:0) after 7m12s
[16:06:37.498] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:47:0)
[16:06:37.532] Build status: STARTED
[16:06:37.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:48:0) after 8m30s
[16:15:07.604] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:48:0)
[16:15:07.662] Build status: STARTED
[16:15:07.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:49:0) after 9m18s
[16:24:25.689] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:49:0)
[16:24:25.723] Build status: STARTED
[16:24:25.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:50:0) after 4m5s
[16:28:30.752] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:50:0)
[16:28:30.788] Build status: STARTED
[16:28:30.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:51:0) after 3m17s
[16:31:47.820] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:51:0)
[16:31:47.854] Build status: STARTED
[16:31:47.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:52:0) after 2m50s
[16:34:38.213] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:52:0)
[16:34:38.244] Build status: STARTED
[16:34:38.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:53:0) after 9m18s
[16:43:56.274] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:53:0)
[16:43:56.311] Build status: STARTED
[16:43:56.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:54:0) after 3m49s
[16:47:45.404] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:54:0)
[16:47:45.440] Build status: STARTED
[16:47:45.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:55:0) after 1m13s
[16:48:58.544] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:55:0)
[16:48:58.596] Build status: STARTED
[16:48:58.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:56:0) after 4m45s
[16:53:43.619] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:56:0)
[16:53:43.650] Build status: STARTED
[16:53:43.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:57:0) after 7m16s
[17:00:59.682] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:57:0)
[17:00:59.740] Build status: STARTED
[17:00:59.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:58:0) after 4m59s
[17:05:58.772] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:58:0)
[17:05:58.843] Build status: STARTED
[17:05:58.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:59:0) after 3m42s
[17:09:40.885] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:59:0)
[17:09:40.916] Build status: STARTED
[17:09:40.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:60:0) after 1m20s
[17:11:01.346] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:60:0)
[17:11:01.376] Build status: STARTED
[17:11:01.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:61:0) after 7m44s
[17:18:45.414] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:61:0)
[17:18:45.472] Build status: STARTED
[17:18:45.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:62:0) after 7m10s
[17:25:55.573] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:62:0)
[17:25:55.644] Build status: STARTED
[17:25:55.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008248885406475776:63:0) after 9m24s
[17:28:33.552] Received PubSub notification, asking Buildbucket for the build status
[17:28:33.580] Build:
{
"id": "8842818823267480192",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22475,
"createdBy": "project:chromium",
"createTime": "2021-07-02T12:10:25.824968Z",
"startTime": "2021-07-02T12:13:23.225055Z",
"endTime": "2021-07-02T17:28:32.920377812Z",
"updateTime": "2021-07-02T17:28:32.920700160Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "940d6964f7122955103fe923f75f2c78f391bfde",
"ref": "refs/heads/main"
}
},
"canary": true
}
[17:28:33.580] Invocation finished in 5h18m9.179794503s with status FAILED