[14:47:33.018] New invocation is queued and will start shortly
[14:47:34.206] Starting the invocation (attempt 1)
[14:47:34.241] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/688a7ae68981a88f6fb825c9cd29465ae10c7ada"
[14:47:34.241] Popped gitiles commit info from properties and tags
[14:47:34.241] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:47:34.241] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:47:34.241] Buildbucket request:
{
"requestId": "9008873177571012384",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "688a7ae68981a88f6fb825c9cd29465ae10c7ada",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9008873177571012384"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:47:34.835] Scheduled build:
{
"id": "8843443115543537649",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22392,
"createdBy": "project:chromium",
"createTime": "2021-06-25T14:47:34.314334691Z",
"updateTime": "2021-06-25T14:47:34.641246317Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "688a7ae68981a88f6fb825c9cd29465ae10c7ada",
"ref": "refs/heads/main"
}
}
}
[14:47:34.835] Task URL: https://cr-buildbucket.appspot.com/build/8843443115543537649
[14:47:34.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:2:0) after 4m51s
[14:50:42.564] Received PubSub notification, asking Buildbucket for the build status
[14:50:42.590] Build status: STARTED
[14:52:25.858] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:2:0)
[14:52:25.931] Build status: STARTED
[14:52:25.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:4:0) after 8m21s
[15:00:47.064] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:4:0)
[15:00:47.097] Build status: STARTED
[15:00:47.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:5:0) after 7m1s
[15:07:48.182] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:5:0)
[15:07:48.216] Build status: STARTED
[15:07:48.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:6:0) after 2m47s
[15:10:35.372] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:6:0)
[15:10:35.402] Build status: STARTED
[15:10:35.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:7:0) after 2m30s
[15:13:05.438] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:7:0)
[15:13:05.485] Build status: STARTED
[15:13:05.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:8:0) after 9m57s
[15:23:02.505] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:8:0)
[15:23:02.537] Build status: STARTED
[15:23:02.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:9:0) after 1m36s
[15:24:38.852] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:9:0)
[15:24:38.881] Build status: STARTED
[15:24:38.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:10:0) after 8m55s
[15:33:33.910] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:10:0)
[15:33:33.936] Build status: STARTED
[15:33:33.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:11:0) after 5m12s
[15:38:45.979] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:11:0)
[15:38:46.009] Build status: STARTED
[15:38:46.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:12:0) after 1m31s
[15:40:17.527] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:12:0)
[15:40:17.574] Build status: STARTED
[15:40:17.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:13:0) after 1m33s
[15:41:50.791] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:13:0)
[15:41:50.826] Build status: STARTED
[15:41:50.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:14:0) after 9m8s
[15:50:58.969] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:14:0)
[15:50:59.011] Build status: STARTED
[15:50:59.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:15:0) after 9m13s
[16:00:12.382] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:15:0)
[16:00:12.420] Build status: STARTED
[16:00:12.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:16:0) after 3m17s
[16:03:29.458] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:16:0)
[16:03:29.486] Build status: STARTED
[16:03:29.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:17:0) after 1m41s
[16:05:10.643] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:17:0)
[16:05:10.672] Build status: STARTED
[16:05:10.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:18:0) after 8m2s
[16:13:12.786] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:18:0)
[16:13:12.814] Build status: STARTED
[16:13:12.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:19:0) after 7m11s
[16:20:23.851] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:19:0)
[16:20:23.880] Build status: STARTED
[16:20:23.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:20:0) after 8m9s
[16:28:32.910] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:20:0)
[16:28:32.944] Build status: STARTED
[16:28:32.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:21:0) after 4m2s
[16:32:35.077] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:21:0)
[16:32:35.148] Build status: STARTED
[16:32:35.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:22:0) after 9m50s
[16:42:25.185] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:22:0)
[16:42:25.227] Build status: STARTED
[16:42:25.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:23:0) after 4m56s
[16:47:21.248] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:23:0)
[16:47:21.362] Build status: STARTED
[16:47:21.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:24:0) after 6m17s
[16:53:38.432] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:24:0)
[16:53:38.483] Build status: STARTED
[16:53:38.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:25:0) after 6m58s
[17:00:36.628] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:25:0)
[17:00:36.674] Build status: STARTED
[17:00:36.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:26:0) after 2m53s
[17:03:29.666] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:26:0)
[17:03:29.697] Build status: STARTED
[17:03:29.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:27:0) after 6m13s
[17:09:42.719] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:27:0)
[17:09:42.754] Build status: STARTED
[17:09:42.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:28:0) after 7m56s
[17:17:39.063] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:28:0)
[17:17:39.102] Build status: STARTED
[17:17:39.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:29:0) after 9m8s
[17:26:47.182] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:29:0)
[17:26:47.213] Build status: STARTED
[17:26:47.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:30:0) after 8m55s
[17:35:42.661] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:30:0)
[17:35:42.702] Build status: STARTED
[17:35:42.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:31:0) after 4m44s
[17:40:27.113] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:31:0)
[17:40:27.141] Build status: STARTED
[17:40:27.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:32:0) after 2m16s
[17:42:43.169] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:32:0)
[17:42:43.205] Build status: STARTED
[17:42:43.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:33:0) after 6m16s
[17:48:59.390] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:33:0)
[17:48:59.439] Build status: STARTED
[17:48:59.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:34:0) after 2m59s
[17:51:58.521] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:34:0)
[17:51:58.553] Build status: STARTED
[17:51:58.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:35:0) after 6m52s
[17:58:50.717] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:35:0)
[17:58:50.748] Build status: STARTED
[17:58:50.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:36:0) after 1m50s
[18:00:40.962] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:36:0)
[18:00:40.991] Build status: STARTED
[18:00:40.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:37:0) after 8m31s
[18:09:12.113] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:37:0)
[18:09:12.145] Build status: STARTED
[18:09:12.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:38:0) after 1m12s
[18:10:24.303] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:38:0)
[18:10:24.349] Build status: STARTED
[18:10:24.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:39:0) after 2m19s
[18:12:43.387] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:39:0)
[18:12:43.414] Build status: STARTED
[18:12:43.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:40:0) after 4m39s
[18:17:22.548] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:40:0)
[18:17:22.578] Build status: STARTED
[18:17:22.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:41:0) after 9m47s
[18:27:09.612] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:41:0)
[18:27:09.642] Build status: STARTED
[18:27:09.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:42:0) after 5m36s
[18:32:45.931] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:42:0)
[18:32:45.979] Build status: STARTED
[18:32:45.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:43:0) after 4m53s
[18:37:39.334] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:43:0)
[18:37:39.363] Build status: STARTED
[18:37:39.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:44:0) after 3m30s
[18:41:09.583] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:44:0)
[18:41:09.629] Build status: STARTED
[18:41:09.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:45:0) after 2m42s
[18:43:51.806] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:45:0)
[18:43:51.835] Build status: STARTED
[18:43:51.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:46:0) after 5m38s
[18:49:29.909] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:46:0)
[18:49:29.946] Build status: STARTED
[18:49:29.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:47:0) after 7m56s
[18:57:26.142] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:47:0)
[18:57:26.177] Build status: STARTED
[18:57:26.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:48:0) after 2m54s
[19:00:20.302] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:48:0)
[19:00:20.375] Build status: STARTED
[19:00:20.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:49:0) after 7m35s
[19:07:55.416] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:49:0)
[19:07:55.452] Build status: STARTED
[19:07:55.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:50:0) after 2m58s
[19:10:53.725] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:50:0)
[19:10:53.756] Build status: STARTED
[19:10:53.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:51:0) after 4m30s
[19:15:24.106] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:51:0)
[19:15:24.946] Build status: STARTED
[19:15:24.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:52:0) after 3m8s
[19:18:33.054] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:52:0)
[19:18:33.085] Build status: STARTED
[19:18:33.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:53:0) after 4m27s
[19:23:00.224] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:53:0)
[19:23:00.314] Build status: STARTED
[19:23:00.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:54:0) after 1m26s
[19:24:26.362] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:54:0)
[19:24:26.394] Build status: STARTED
[19:24:26.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:55:0) after 6m28s
[19:30:54.589] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:55:0)
[19:30:54.651] Build status: STARTED
[19:30:54.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:56:0) after 1m26s
[19:32:20.684] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:56:0)
[19:32:20.719] Build status: STARTED
[19:32:20.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:57:0) after 5m22s
[19:37:42.896] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:57:0)
[19:37:42.935] Build status: STARTED
[19:37:42.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:58:0) after 1m33s
[19:39:15.956] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:58:0)
[19:39:15.986] Build status: STARTED
[19:39:15.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:59:0) after 7m47s
[19:47:03.216] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:59:0)
[19:47:03.256] Build status: STARTED
[19:47:03.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:60:0) after 5m14s
[19:52:17.288] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:60:0)
[19:52:17.324] Build status: STARTED
[19:52:17.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:61:0) after 3m39s
[19:55:56.536] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:61:0)
[19:55:56.565] Build status: STARTED
[19:55:56.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008873177571012384:62:0) after 7m7s
[19:56:26.491] Received PubSub notification, asking Buildbucket for the build status
[19:56:26.558] Build:
{
"id": "8843443115543537649",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22392,
"createdBy": "project:chromium",
"createTime": "2021-06-25T14:47:34.314334691Z",
"startTime": "2021-06-25T14:50:41.213851Z",
"endTime": "2021-06-25T19:56:26.249336567Z",
"updateTime": "2021-06-25T19:56:26.249882267Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "688a7ae68981a88f6fb825c9cd29465ae10c7ada",
"ref": "refs/heads/main"
}
}
}
[19:56:26.558] Invocation finished in 5h8m53.560399537s with status FAILED