[13:21:05.212] New invocation is queued and will start shortly
[13:21:06.550] Starting the invocation (attempt 1)
[13:21:06.600] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/b5c6b4b2a806dc727247cd04f20ec1cd443c953a"
[13:21:06.600] Popped gitiles commit info from properties and tags
[13:21:06.600] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:21:06.600] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:21:06.600] Buildbucket request:
{
"requestId": "9014858017157795584",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b5c6b4b2a806dc727247cd04f20ec1cd443c953a",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9014858017157795584"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:21:09.059] Scheduled build:
{
"id": "8849427953878770848",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 21957,
"createdBy": "project:chromium",
"createTime": "2021-04-20T13:21:07.706078Z",
"updateTime": "2021-04-20T13:21:08.377570Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b5c6b4b2a806dc727247cd04f20ec1cd443c953a",
"ref": "refs/heads/master"
}
}
}
[13:21:09.059] Task URL: https://cr-buildbucket.appspot.com/build/8849427953878770848
[13:21:09.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:2:0) after 6m40s
[13:24:29.705] Received PubSub notification, asking Buildbucket for the build status
[13:24:29.740] Build status: STARTED
[13:27:49.078] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:2:0)
[13:27:49.115] Build status: STARTED
[13:27:49.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:4:0) after 7m25s
[13:35:14.234] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:4:0)
[13:35:14.267] Build status: STARTED
[13:35:14.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:5:0) after 2m19s
[13:37:33.622] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:5:0)
[13:37:33.653] Build status: STARTED
[13:37:33.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:6:0) after 6m52s
[13:44:26.325] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:6:0)
[13:44:26.359] Build status: STARTED
[13:44:26.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:7:0) after 4m29s
[13:48:55.417] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:7:0)
[13:48:55.453] Build status: STARTED
[13:48:55.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:8:0) after 7m42s
[13:56:37.707] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:8:0)
[13:56:37.744] Build status: STARTED
[13:56:37.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:9:0) after 2m19s
[13:58:57.010] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:9:0)
[13:58:57.038] Build status: STARTED
[13:58:57.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:10:0) after 3m32s
[14:02:29.418] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:10:0)
[14:02:29.518] Build status: STARTED
[14:02:29.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:11:0) after 9m38s
[14:12:07.537] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:11:0)
[14:12:07.578] Build status: STARTED
[14:12:07.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:12:0) after 8m28s
[14:20:35.601] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:12:0)
[14:20:35.644] Build status: STARTED
[14:20:35.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:13:0) after 2m40s
[14:23:15.925] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:13:0)
[14:23:15.952] Build status: STARTED
[14:23:15.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:14:0) after 8m18s
[14:31:34.193] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:14:0)
[14:31:34.225] Build status: STARTED
[14:31:34.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:15:0) after 8m14s
[14:39:48.254] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:15:0)
[14:39:48.286] Build status: STARTED
[14:39:48.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:16:0) after 9m7s
[14:48:55.682] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:16:0)
[14:48:55.711] Build status: STARTED
[14:48:55.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:17:0) after 6m8s
[14:55:03.762] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:17:0)
[14:55:03.793] Build status: STARTED
[14:55:03.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:18:0) after 4m14s
[14:59:17.820] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:18:0)
[14:59:17.851] Build status: STARTED
[14:59:17.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:19:0) after 4m43s
[15:04:01.034] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:19:0)
[15:04:01.059] Build status: STARTED
[15:04:01.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:20:0) after 1m55s
[15:05:56.161] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:20:0)
[15:05:56.188] Build status: STARTED
[15:05:56.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:21:0) after 6m24s
[15:12:20.225] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:21:0)
[15:12:20.257] Build status: STARTED
[15:12:20.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:22:0) after 5m34s
[15:17:54.517] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:22:0)
[15:17:54.543] Build status: STARTED
[15:17:54.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:23:0) after 7m13s
[15:25:07.789] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:23:0)
[15:25:07.823] Build status: STARTED
[15:25:07.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:24:0) after 7m19s
[15:32:27.028] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:24:0)
[15:32:27.058] Build status: STARTED
[15:32:27.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:25:0) after 7m18s
[15:39:45.229] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:25:0)
[15:39:45.259] Build status: STARTED
[15:39:45.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:26:0) after 6m5s
[15:45:50.289] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:26:0)
[15:45:50.369] Build status: STARTED
[15:45:50.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:27:0) after 4m50s
[15:50:40.494] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:27:0)
[15:50:40.522] Build status: STARTED
[15:50:40.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:28:0) after 7m33s
[15:58:13.549] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:28:0)
[15:58:13.575] Build status: STARTED
[15:58:13.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:29:0) after 7m58s
[16:06:11.591] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:29:0)
[16:06:11.637] Build status: STARTED
[16:06:11.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:30:0) after 8m40s
[16:14:51.727] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:30:0)
[16:14:51.755] Build status: STARTED
[16:14:51.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:31:0) after 8m29s
[16:23:20.813] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:31:0)
[16:23:20.841] Build status: STARTED
[16:23:20.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:32:0) after 5m44s
[16:29:04.887] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:32:0)
[16:29:04.915] Build status: STARTED
[16:29:04.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:33:0) after 7m13s
[16:36:17.939] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:33:0)
[16:36:17.975] Build status: STARTED
[16:36:17.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:34:0) after 2m50s
[16:39:08.019] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:34:0)
[16:39:08.046] Build status: STARTED
[16:39:08.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:35:0) after 2m20s
[16:41:28.070] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:35:0)
[16:41:28.099] Build status: STARTED
[16:41:28.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:36:0) after 5m16s
[16:46:44.370] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:36:0)
[16:46:44.401] Build status: STARTED
[16:46:44.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:37:0) after 2m34s
[16:49:18.456] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:37:0)
[16:49:18.484] Build status: STARTED
[16:49:18.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:38:0) after 7m39s
[16:56:57.676] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:38:0)
[16:56:57.701] Build status: STARTED
[16:56:57.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:39:0) after 3m29s
[17:00:27.128] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:39:0)
[17:00:27.158] Build status: STARTED
[17:00:27.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:40:0) after 8m34s
[17:09:01.573] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:40:0)
[17:09:01.618] Build status: STARTED
[17:09:01.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:41:0) after 1m2s
[17:10:03.686] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:41:0)
[17:10:03.721] Build status: STARTED
[17:10:03.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:42:0) after 1m23s
[17:11:26.740] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:42:0)
[17:11:26.777] Build status: STARTED
[17:11:26.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:43:0) after 6m32s
[17:17:58.966] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:43:0)
[17:17:58.999] Build status: STARTED
[17:17:58.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:44:0) after 3m19s
[17:21:18.154] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:44:0)
[17:21:18.185] Build status: STARTED
[17:21:18.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:45:0) after 1m46s
[17:23:04.715] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:45:0)
[17:23:04.742] Build status: STARTED
[17:23:04.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:46:0) after 7m24s
[17:30:28.844] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:46:0)
[17:30:28.881] Build status: STARTED
[17:30:28.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:47:0) after 7m8s
[17:37:37.156] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:47:0)
[17:37:37.189] Build status: STARTED
[17:37:37.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:48:0) after 9m56s
[17:47:33.209] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:48:0)
[17:47:33.237] Build status: STARTED
[17:47:33.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:49:0) after 1m37s
[17:49:10.267] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:49:0)
[17:49:10.301] Build status: STARTED
[17:49:10.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:50:0) after 2m2s
[17:51:12.326] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:50:0)
[17:51:12.363] Build status: STARTED
[17:51:12.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:51:0) after 5m42s
[17:56:54.473] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:51:0)
[17:56:54.509] Build status: STARTED
[17:56:54.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:52:0) after 7m39s
[18:04:33.878] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:52:0)
[18:04:33.910] Build status: STARTED
[18:04:33.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:53:0) after 3m36s
[18:08:09.927] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:53:0)
[18:08:09.964] Build status: STARTED
[18:08:09.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9014858017157795584:54:0) after 9m21s
[18:16:42.714] Received PubSub notification, asking Buildbucket for the build status
[18:16:42.792] Build:
{
"id": "8849427953878770848",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 21957,
"createdBy": "project:chromium",
"createTime": "2021-04-20T13:21:07.706078Z",
"startTime": "2021-04-20T13:24:19.950092Z",
"endTime": "2021-04-20T18:16:42.338766220Z",
"updateTime": "2021-04-20T18:16:42.339415618Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b5c6b4b2a806dc727247cd04f20ec1cd443c953a",
"ref": "refs/heads/master"
}
}
}
[18:16:42.792] Invocation finished in 4h55m37.597247658s with status FAILED