[21:23:30.251] New invocation is queued and will start shortly
[21:23:31.369] Starting the invocation (attempt 1)
[21:23:31.412] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c8a9918501fc0d736d2e3f0e8efed309b83fd329"
[21:23:31.412] Popped gitiles commit info from properties and tags
[21:23:31.412] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:23:31.413] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:23:31.413] Buildbucket request:
{
"requestId": "8998248421232394448",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c8a9918501fc0d736d2e3f0e8efed309b83fd329",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8998248421232394448"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:23:31.986] Scheduled build:
{
"id": "8832818359266801329",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23381,
"createdBy": "project:chromium",
"createTime": "2021-10-20T21:23:31.493815720Z",
"updateTime": "2021-10-20T21:23:31.758872065Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c8a9918501fc0d736d2e3f0e8efed309b83fd329",
"ref": "refs/heads/main"
}
}
}
[21:23:31.986] Task URL: https://cr-buildbucket.appspot.com/build/8832818359266801329
[21:23:31.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:2:0) after 7m47s
[21:26:01.631] Received PubSub notification, asking Buildbucket for the build status
[21:26:01.667] Build status: STARTED
[21:31:19.091] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:2:0)
[21:31:19.203] Build status: STARTED
[21:31:19.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:4:0) after 9m37s
[21:40:56.226] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:4:0)
[21:40:56.284] Build status: STARTED
[21:40:56.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:5:0) after 7m58s
[21:48:54.446] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:5:0)
[21:48:54.493] Build status: STARTED
[21:48:54.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:6:0) after 2m19s
[21:51:13.596] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:6:0)
[21:51:13.628] Build status: STARTED
[21:51:13.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:7:0) after 3m20s
[21:54:33.649] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:7:0)
[21:54:33.685] Build status: STARTED
[21:54:33.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:8:0) after 5m20s
[21:59:53.896] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:8:0)
[21:59:53.926] Build status: STARTED
[21:59:53.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:9:0) after 1m11s
[22:01:05.010] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:9:0)
[22:01:05.045] Build status: STARTED
[22:01:05.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:10:0) after 7m8s
[22:08:13.091] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:10:0)
[22:08:13.140] Build status: STARTED
[22:08:13.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:11:0) after 9m14s
[22:17:27.269] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:11:0)
[22:17:27.304] Build status: STARTED
[22:17:27.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:12:0) after 2m25s
[22:19:52.326] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:12:0)
[22:19:52.357] Build status: STARTED
[22:19:52.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:13:0) after 5m32s
[22:25:24.378] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:13:0)
[22:25:24.478] Build status: STARTED
[22:25:24.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:14:0) after 6m36s
[22:32:00.505] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:14:0)
[22:32:00.558] Build status: STARTED
[22:32:00.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:15:0) after 9m7s
[22:41:07.594] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:15:0)
[22:41:07.628] Build status: STARTED
[22:41:07.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:16:0) after 2m45s
[22:43:52.845] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:16:0)
[22:43:52.881] Build status: STARTED
[22:43:52.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:17:0) after 5m33s
[22:49:25.983] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:17:0)
[22:49:26.016] Build status: STARTED
[22:49:26.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:18:0) after 9m39s
[22:59:05.033] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:18:0)
[22:59:05.109] Build status: STARTED
[22:59:05.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:19:0) after 1m50s
[23:00:55.236] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:19:0)
[23:00:55.262] Build status: STARTED
[23:00:55.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:20:0) after 4m24s
[23:05:19.241] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:20:0)
[23:05:19.279] Build status: STARTED
[23:05:19.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:21:0) after 6m29s
[23:11:48.447] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:21:0)
[23:11:48.873] Build status: STARTED
[23:11:48.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:22:0) after 5m37s
[23:17:25.897] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:22:0)
[23:17:25.931] Build status: STARTED
[23:17:25.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:23:0) after 5m22s
[23:22:47.931] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:23:0)
[23:22:48.023] Build status: STARTED
[23:22:48.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:24:0) after 9m45s
[23:32:33.060] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:24:0)
[23:32:33.096] Build status: STARTED
[23:32:33.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:25:0) after 7m20s
[23:39:53.592] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:25:0)
[23:39:53.617] Build status: STARTED
[23:39:53.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:26:0) after 4m0s
[23:43:53.791] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:26:0)
[23:43:53.955] Build status: STARTED
[23:43:53.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:27:0) after 2m26s
[23:46:20.043] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:27:0)
[23:46:20.089] Build status: STARTED
[23:46:20.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:28:0) after 6m30s
[23:52:50.188] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:28:0)
[23:52:50.245] Build status: STARTED
[23:52:50.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:29:0) after 1m43s
[23:54:33.267] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:29:0)
[23:54:33.294] Build status: STARTED
[23:54:33.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:30:0) after 7m35s
[00:02:08.705] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:30:0)
[00:02:08.736] Build status: STARTED
[00:02:08.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:31:0) after 1m57s
[00:04:06.491] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:31:0)
[00:04:06.556] Build status: STARTED
[00:04:06.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:32:0) after 8m2s
[00:12:08.653] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:32:0)
[00:12:08.685] Build status: STARTED
[00:12:08.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:33:0) after 7m56s
[00:20:04.708] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:33:0)
[00:20:04.741] Build status: STARTED
[00:20:04.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:34:0) after 8m36s
[00:28:41.004] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:34:0)
[00:28:41.035] Build status: STARTED
[00:28:41.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:35:0) after 2m45s
[00:31:26.110] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:35:0)
[00:31:26.208] Build status: STARTED
[00:31:26.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:36:0) after 7m4s
[00:38:30.234] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:36:0)
[00:38:30.269] Build status: STARTED
[00:38:30.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:37:0) after 1m19s
[00:39:49.916] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:37:0)
[00:39:49.950] Build status: STARTED
[00:39:49.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:38:0) after 1m4s
[00:40:54.049] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:38:0)
[00:40:54.091] Build status: STARTED
[00:40:54.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:39:0) after 1m25s
[00:42:19.463] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:39:0)
[00:42:19.497] Build status: STARTED
[00:42:19.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:40:0) after 9m51s
[00:52:10.520] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:40:0)
[00:52:10.558] Build status: STARTED
[00:52:10.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:41:0) after 2m50s
[00:55:00.794] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:41:0)
[00:55:00.831] Build status: STARTED
[00:55:00.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:42:0) after 9m20s
[01:04:20.859] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:42:0)
[01:04:20.925] Build status: STARTED
[01:04:20.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:43:0) after 1m37s
[01:05:57.971] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:43:0)
[01:05:58.201] Build status: STARTED
[01:05:58.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:44:0) after 5m26s
[01:11:24.788] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:44:0)
[01:11:24.832] Build status: STARTED
[01:11:24.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:45:0) after 9m34s
[01:20:59.082] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:45:0)
[01:20:59.190] Build status: STARTED
[01:20:59.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:46:0) after 6m9s
[01:27:08.412] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:46:0)
[01:27:08.440] Build status: STARTED
[01:27:08.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:47:0) after 2m55s
[01:30:03.584] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:47:0)
[01:30:03.619] Build status: STARTED
[01:30:03.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:48:0) after 4m34s
[01:34:37.643] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:48:0)
[01:34:37.733] Build status: STARTED
[01:34:37.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:49:0) after 4m46s
[01:39:23.903] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:49:0)
[01:39:23.933] Build status: STARTED
[01:39:23.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:50:0) after 3m19s
[01:42:43.106] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:50:0)
[01:42:43.135] Build status: STARTED
[01:42:43.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:51:0) after 9m56s
[01:52:39.220] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:51:0)
[01:52:39.278] Build status: STARTED
[01:52:39.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:52:0) after 4m36s
[01:57:15.300] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:52:0)
[01:57:15.333] Build status: STARTED
[01:57:15.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:53:0) after 6m19s
[02:03:34.661] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:53:0)
[02:03:34.689] Build status: STARTED
[02:03:34.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:54:0) after 3m31s
[02:07:06.456] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:54:0)
[02:07:06.490] Build status: STARTED
[02:07:06.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:55:0) after 3m0s
[02:10:06.924] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:55:0)
[02:10:06.956] Build status: STARTED
[02:10:06.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:56:0) after 7m3s
[02:17:09.988] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:56:0)
[02:17:10.029] Build status: STARTED
[02:17:10.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:57:0) after 6m10s
[02:23:20.172] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:57:0)
[02:23:20.202] Build status: STARTED
[02:23:20.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:58:0) after 9m7s
[02:32:27.268] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:58:0)
[02:32:27.302] Build status: STARTED
[02:32:27.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998248421232394448:59:0) after 8m48s
[02:40:05.489] Received PubSub notification, asking Buildbucket for the build status
[02:40:05.522] Build:
{
"id": "8832818359266801329",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23381,
"createdBy": "project:chromium",
"createTime": "2021-10-20T21:23:31.493815720Z",
"startTime": "2021-10-20T21:26:01.064220Z",
"endTime": "2021-10-21T02:40:05.193243791Z",
"updateTime": "2021-10-21T02:40:05.193766145Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c8a9918501fc0d736d2e3f0e8efed309b83fd329",
"ref": "refs/heads/main"
}
}
}
[02:40:05.522] Invocation finished in 5h16m35.28673711s with status FAILED