[16:24:42.211] New invocation is queued and will start shortly
[16:24:43.240] Starting the invocation (attempt 1)
[16:24:43.270] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/64609fa5296d0c6bcef947443c055f313dfc9634"
[16:24:43.270] Popped gitiles commit info from properties and tags
[16:24:43.270] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:24:43.270] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:24:43.270] Buildbucket request:
{
"requestId": "9014393480161607328",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "64609fa5296d0c6bcef947443c055f313dfc9634",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9014393480161607328"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:24:44.220] Scheduled build:
{
"id": "8848963418261159856",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22019,
"createdBy": "project:chromium",
"createTime": "2021-04-25T16:24:43.393428Z",
"updateTime": "2021-04-25T16:24:44.087752Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "64609fa5296d0c6bcef947443c055f313dfc9634",
"ref": "refs/heads/master"
}
}
}
[16:24:44.220] Task URL: https://cr-buildbucket.appspot.com/build/8848963418261159856
[16:24:44.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:2:0) after 1m16s
[16:26:00.327] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:2:0)
[16:26:00.354] Build status: SCHEDULED
[16:26:00.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:3:0) after 4m39s
[16:27:44.642] Received PubSub notification, asking Buildbucket for the build status
[16:27:44.669] Build status: STARTED
[16:30:39.491] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:3:0)
[16:30:39.567] Build status: STARTED
[16:30:39.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:5:0) after 7m54s
[16:38:33.674] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:5:0)
[16:38:33.702] Build status: STARTED
[16:38:33.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:6:0) after 4m8s
[16:42:41.856] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:6:0)
[16:42:41.879] Build status: STARTED
[16:42:41.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:7:0) after 4m20s
[16:47:02.127] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:7:0)
[16:47:02.152] Build status: STARTED
[16:47:02.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:8:0) after 6m10s
[16:53:12.171] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:8:0)
[16:53:12.200] Build status: STARTED
[16:53:12.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:9:0) after 4m8s
[16:57:20.224] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:9:0)
[16:57:20.254] Build status: STARTED
[16:57:20.254] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:10:0) after 8m38s
[17:05:58.359] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:10:0)
[17:05:58.399] Build status: STARTED
[17:05:58.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:11:0) after 3m37s
[17:09:35.604] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:11:0)
[17:09:35.628] Build status: STARTED
[17:09:35.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:12:0) after 6m47s
[17:16:23.052] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:12:0)
[17:16:23.078] Build status: STARTED
[17:16:23.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:13:0) after 3m51s
[17:20:14.131] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:13:0)
[17:20:14.156] Build status: STARTED
[17:20:14.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:14:0) after 2m8s
[17:22:22.177] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:14:0)
[17:22:22.204] Build status: STARTED
[17:22:22.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:15:0) after 2m1s
[17:24:23.251] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:15:0)
[17:24:23.277] Build status: STARTED
[17:24:23.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:16:0) after 8m50s
[17:33:13.890] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:16:0)
[17:33:13.916] Build status: STARTED
[17:33:13.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:17:0) after 8m1s
[17:41:14.935] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:17:0)
[17:41:14.959] Build status: STARTED
[17:41:14.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:18:0) after 9m45s
[17:51:00.179] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:18:0)
[17:51:00.264] Build status: STARTED
[17:51:00.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:19:0) after 6m35s
[17:57:35.280] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:19:0)
[17:57:35.362] Build status: STARTED
[17:57:35.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:20:0) after 1m15s
[17:58:50.384] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:20:0)
[17:58:50.413] Build status: STARTED
[17:58:50.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:21:0) after 4m41s
[18:03:31.445] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:21:0)
[18:03:31.483] Build status: STARTED
[18:03:31.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:22:0) after 9m0s
[18:12:31.511] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:22:0)
[18:12:31.543] Build status: STARTED
[18:12:31.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:23:0) after 5m2s
[18:17:33.562] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:23:0)
[18:17:33.590] Build status: STARTED
[18:17:33.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:24:0) after 1m46s
[18:19:19.729] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:24:0)
[18:19:19.760] Build status: STARTED
[18:19:19.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:25:0) after 7m13s
[18:26:32.779] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:25:0)
[18:26:32.804] Build status: STARTED
[18:26:32.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:26:0) after 4m51s
[18:31:23.823] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:26:0)
[18:31:23.849] Build status: STARTED
[18:31:23.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:27:0) after 7m20s
[18:38:44.002] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:27:0)
[18:38:44.031] Build status: STARTED
[18:38:44.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:28:0) after 3m51s
[18:42:35.048] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:28:0)
[18:42:35.075] Build status: STARTED
[18:42:35.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:29:0) after 5m23s
[18:47:58.094] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:29:0)
[18:47:58.122] Build status: STARTED
[18:47:58.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:30:0) after 3m0s
[18:50:58.551] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:30:0)
[18:50:58.583] Build status: STARTED
[18:50:58.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:31:0) after 6m47s
[18:57:45.944] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:31:0)
[18:57:45.975] Build status: STARTED
[18:57:45.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:32:0) after 7m57s
[19:05:43.227] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:32:0)
[19:05:43.274] Build status: STARTED
[19:05:43.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:33:0) after 2m36s
[19:08:19.311] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:33:0)
[19:08:19.336] Build status: STARTED
[19:08:19.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:34:0) after 4m49s
[19:13:08.355] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:34:0)
[19:13:08.378] Build status: STARTED
[19:13:08.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:35:0) after 7m22s
[19:20:30.400] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:35:0)
[19:20:30.427] Build status: STARTED
[19:20:30.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:36:0) after 4m31s
[19:25:01.446] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:36:0)
[19:25:01.470] Build status: STARTED
[19:25:01.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:37:0) after 2m20s
[19:27:21.763] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:37:0)
[19:27:21.792] Build status: STARTED
[19:27:21.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:38:0) after 7m51s
[19:35:12.811] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:38:0)
[19:35:12.841] Build status: STARTED
[19:35:12.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:39:0) after 7m50s
[19:43:03.105] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:39:0)
[19:43:03.133] Build status: STARTED
[19:43:03.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:40:0) after 4m15s
[19:47:18.158] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:40:0)
[19:47:18.182] Build status: STARTED
[19:47:18.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:41:0) after 9m6s
[19:56:24.409] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:41:0)
[19:56:24.435] Build status: STARTED
[19:56:24.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:42:0) after 1m38s
[19:58:02.795] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:42:0)
[19:58:02.830] Build status: STARTED
[19:58:02.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:43:0) after 9m34s
[20:07:37.112] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:43:0)
[20:07:37.145] Build status: STARTED
[20:07:37.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:44:0) after 2m42s
[20:10:19.164] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:44:0)
[20:10:19.191] Build status: STARTED
[20:10:19.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:45:0) after 5m12s
[20:15:31.177] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:45:0)
[20:15:31.205] Build status: STARTED
[20:15:31.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:46:0) after 9m48s
[20:25:19.226] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:46:0)
[20:25:19.253] Build status: STARTED
[20:25:19.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:47:0) after 6m50s
[20:32:09.282] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:47:0)
[20:32:09.309] Build status: STARTED
[20:32:09.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:48:0) after 2m50s
[20:34:59.326] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:48:0)
[20:34:59.351] Build status: STARTED
[20:34:59.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:49:0) after 5m51s
[20:40:50.458] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:49:0)
[20:40:50.484] Build status: STARTED
[20:40:50.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:50:0) after 3m24s
[20:44:14.500] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:50:0)
[20:44:14.527] Build status: STARTED
[20:44:14.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:51:0) after 4m53s
[20:49:07.740] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:51:0)
[20:49:07.771] Build status: STARTED
[20:49:07.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:52:0) after 2m56s
[20:52:04.457] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:52:0)
[20:52:04.482] Build status: STARTED
[20:52:04.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:53:0) after 4m35s
[20:56:39.507] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:53:0)
[20:56:39.532] Build status: STARTED
[20:56:39.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:54:0) after 5m20s
[21:01:59.561] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:54:0)
[21:01:59.591] Build status: STARTED
[21:01:59.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:55:0) after 4m44s
[21:06:43.644] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:55:0)
[21:06:43.669] Build status: STARTED
[21:06:43.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:56:0) after 5m42s
[21:12:25.695] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:56:0)
[21:12:25.728] Build status: STARTED
[21:12:25.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014393480161607328:57:0) after 3m9s
[21:14:43.284] Received PubSub notification, asking Buildbucket for the build status
[21:14:43.309] Build:
{
"id": "8848963418261159856",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22019,
"createdBy": "project:chromium",
"createTime": "2021-04-25T16:24:43.393428Z",
"startTime": "2021-04-25T16:27:44.075053Z",
"endTime": "2021-04-25T21:14:42.931188253Z",
"updateTime": "2021-04-25T21:14:42.931573853Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "64609fa5296d0c6bcef947443c055f313dfc9634",
"ref": "refs/heads/master"
}
}
}
[21:14:43.310] Invocation finished in 4h50m1.113002478s with status FAILED