[11:00:50.314] New invocation is queued and will start shortly
[11:00:51.371] Starting the invocation (attempt 1)
[11:00:51.401] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a20b0991377cc51e4fcc23b6eb1fdd5ce7e1b65b"
[11:00:51.401] Popped gitiles commit info from properties and tags
[11:00:51.401] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[11:00:51.401] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[11:00:51.402] Buildbucket request:
{
"requestId": "9014504452951184736",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a20b0991377cc51e4fcc23b6eb1fdd5ce7e1b65b",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9014504452951184736"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[11:00:52.821] Scheduled build:
{
"id": "8849074391048165264",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22013,
"createdBy": "project:chromium",
"createTime": "2021-04-24T11:00:51.497926Z",
"updateTime": "2021-04-24T11:00:52.629930Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a20b0991377cc51e4fcc23b6eb1fdd5ce7e1b65b",
"ref": "refs/heads/master"
}
}
}
[11:00:52.821] Task URL: https://cr-buildbucket.appspot.com/build/8849074391048165264
[11:00:52.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:2:0) after 3m18s
[11:03:57.153] Received PubSub notification, asking Buildbucket for the build status
[11:03:57.195] Build status: STARTED
[11:04:11.189] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:2:0)
[11:04:11.213] Build status: STARTED
[11:04:11.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:4:0) after 3m43s
[11:07:54.232] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:4:0)
[11:07:54.259] Build status: STARTED
[11:07:54.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:5:0) after 4m10s
[11:12:04.417] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:5:0)
[11:12:04.450] Build status: STARTED
[11:12:04.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:6:0) after 8m20s
[11:20:24.955] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:6:0)
[11:20:24.980] Build status: STARTED
[11:20:24.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:7:0) after 2m34s
[11:22:58.996] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:7:0)
[11:22:59.033] Build status: STARTED
[11:22:59.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:8:0) after 8m48s
[11:31:47.056] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:8:0)
[11:31:47.131] Build status: STARTED
[11:31:47.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:9:0) after 2m1s
[11:33:48.316] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:9:0)
[11:33:48.343] Build status: STARTED
[11:33:48.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:10:0) after 4m6s
[11:37:54.627] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:10:0)
[11:37:54.653] Build status: STARTED
[11:37:54.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:11:0) after 8m9s
[11:46:04.013] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:11:0)
[11:46:04.042] Build status: STARTED
[11:46:04.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:12:0) after 3m53s
[11:49:57.247] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:12:0)
[11:49:57.272] Build status: STARTED
[11:49:57.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:13:0) after 3m14s
[11:53:11.489] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:13:0)
[11:53:11.521] Build status: STARTED
[11:53:11.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:14:0) after 1m3s
[11:54:14.536] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:14:0)
[11:54:14.561] Build status: STARTED
[11:54:14.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:15:0) after 4m34s
[11:58:48.581] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:15:0)
[11:58:48.614] Build status: STARTED
[11:58:48.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:16:0) after 2m18s
[12:01:06.631] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:16:0)
[12:01:06.663] Build status: STARTED
[12:01:06.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:17:0) after 2m30s
[12:03:36.686] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:17:0)
[12:03:36.713] Build status: STARTED
[12:03:36.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:18:0) after 5m58s
[12:09:34.733] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:18:0)
[12:09:34.762] Build status: STARTED
[12:09:34.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:19:0) after 3m51s
[12:13:25.978] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:19:0)
[12:13:26.007] Build status: STARTED
[12:13:26.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:20:0) after 1m21s
[12:14:47.275] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:20:0)
[12:14:47.301] Build status: STARTED
[12:14:47.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:21:0) after 8m35s
[12:23:22.575] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:21:0)
[12:23:22.612] Build status: STARTED
[12:23:22.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:22:0) after 2m57s
[12:26:19.770] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:22:0)
[12:26:19.798] Build status: STARTED
[12:26:19.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:23:0) after 4m53s
[12:31:13.507] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:23:0)
[12:31:13.531] Build status: STARTED
[12:31:13.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:24:0) after 4m19s
[12:35:32.553] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:24:0)
[12:35:32.579] Build status: STARTED
[12:35:32.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:25:0) after 3m46s
[12:39:18.913] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:25:0)
[12:39:18.937] Build status: STARTED
[12:39:18.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:26:0) after 6m29s
[12:45:47.990] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:26:0)
[12:45:48.017] Build status: STARTED
[12:45:48.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:27:0) after 1m18s
[12:47:06.035] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:27:0)
[12:47:06.060] Build status: STARTED
[12:47:06.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:28:0) after 7m49s
[12:54:55.084] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:28:0)
[12:54:55.110] Build status: STARTED
[12:54:55.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:29:0) after 8m35s
[13:03:30.175] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:29:0)
[13:03:30.207] Build status: STARTED
[13:03:30.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:30:0) after 8m38s
[13:12:08.370] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:30:0)
[13:12:08.401] Build status: STARTED
[13:12:08.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:31:0) after 4m22s
[13:16:30.620] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:31:0)
[13:16:30.648] Build status: STARTED
[13:16:30.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:32:0) after 3m48s
[13:20:18.671] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:32:0)
[13:20:18.696] Build status: STARTED
[13:20:18.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:33:0) after 1m50s
[13:22:08.709] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:33:0)
[13:22:08.803] Build status: STARTED
[13:22:08.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:34:0) after 4m8s
[13:26:17.065] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:34:0)
[13:26:17.096] Build status: STARTED
[13:26:17.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:35:0) after 6m41s
[13:32:58.077] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:35:0)
[13:32:58.102] Build status: STARTED
[13:32:58.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:36:0) after 1m13s
[13:34:11.307] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:36:0)
[13:34:11.349] Build status: STARTED
[13:34:11.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:37:0) after 1m15s
[13:35:26.367] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:37:0)
[13:35:26.392] Build status: STARTED
[13:35:26.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:38:0) after 4m27s
[13:39:53.409] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:38:0)
[13:39:53.440] Build status: STARTED
[13:39:53.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:39:0) after 5m48s
[13:45:41.904] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:39:0)
[13:45:41.929] Build status: STARTED
[13:45:41.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:40:0) after 4m26s
[13:50:07.947] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:40:0)
[13:50:07.983] Build status: STARTED
[13:50:07.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:41:0) after 6m44s
[13:56:52.686] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:41:0)
[13:56:52.710] Build status: STARTED
[13:56:52.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:42:0) after 9m8s
[14:06:01.678] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:42:0)
[14:06:01.704] Build status: STARTED
[14:06:01.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:43:0) after 9m38s
[14:15:40.114] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:43:0)
[14:15:40.153] Build status: STARTED
[14:15:40.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:44:0) after 1m12s
[14:16:52.741] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:44:0)
[14:16:52.769] Build status: STARTED
[14:16:52.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:45:0) after 9m17s
[14:26:10.517] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:45:0)
[14:26:10.592] Build status: STARTED
[14:26:10.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:46:0) after 2m57s
[14:29:07.645] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:46:0)
[14:29:07.672] Build status: STARTED
[14:29:07.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:47:0) after 8m9s
[14:37:16.824] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:47:0)
[14:37:16.853] Build status: STARTED
[14:37:16.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:48:0) after 6m53s
[14:44:09.951] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:48:0)
[14:44:09.977] Build status: STARTED
[14:44:09.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:49:0) after 3m24s
[14:47:33.995] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:49:0)
[14:47:34.025] Build status: STARTED
[14:47:34.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:50:0) after 6m36s
[14:54:10.329] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:50:0)
[14:54:10.364] Build status: STARTED
[14:54:10.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:51:0) after 3m17s
[14:57:27.678] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:51:0)
[14:57:27.703] Build status: STARTED
[14:57:27.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:52:0) after 9m12s
[15:06:39.746] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:52:0)
[15:06:39.775] Build status: STARTED
[15:06:39.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:53:0) after 5m54s
[15:12:33.844] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:53:0)
[15:12:33.929] Build status: STARTED
[15:12:33.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:54:0) after 2m4s
[15:14:38.100] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:54:0)
[15:14:38.139] Build status: STARTED
[15:14:38.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:55:0) after 3m2s
[15:17:40.265] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:55:0)
[15:17:40.333] Build status: STARTED
[15:17:40.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:56:0) after 9m26s
[15:27:06.351] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:56:0)
[15:27:06.376] Build status: STARTED
[15:27:06.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:57:0) after 2m17s
[15:29:23.388] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:57:0)
[15:29:23.413] Build status: STARTED
[15:29:23.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:58:0) after 7m11s
[15:36:34.580] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:58:0)
[15:36:34.608] Build status: STARTED
[15:36:34.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:59:0) after 6m39s
[15:43:13.773] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:59:0)
[15:43:13.800] Build status: STARTED
[15:43:13.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:60:0) after 6m37s
[15:49:50.853] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:60:0)
[15:49:50.879] Build status: STARTED
[15:49:50.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:61:0) after 7m40s
[15:57:31.035] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:61:0)
[15:57:31.073] Build status: STARTED
[15:57:31.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014504452951184736:62:0) after 7m51s
[16:00:54.052] Received PubSub notification, asking Buildbucket for the build status
[16:00:54.077] Build:
{
"id": "8849074391048165264",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22013,
"createdBy": "project:chromium",
"createTime": "2021-04-24T11:00:51.497926Z",
"startTime": "2021-04-24T11:03:56.603505Z",
"endTime": "2021-04-24T16:00:53.733853619Z",
"updateTime": "2021-04-24T16:00:53.734235454Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a20b0991377cc51e4fcc23b6eb1fdd5ce7e1b65b",
"ref": "refs/heads/master"
}
}
}
[16:00:54.077] Invocation finished in 5h0m3.779998892s with status FAILED