[14:46:59.444] New invocation is queued and will start shortly
[14:47:00.560] Starting the invocation (attempt 1)
[14:47:00.606] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e03c577c1d64768fea0266fffa62ce1dd630687e"
[14:47:00.606] Popped gitiles commit info from properties and tags
[14:47:00.606] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:47:00.606] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:47:00.606] Buildbucket request:
{
"requestId": "9003618588723236448",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e03c577c1d64768fea0266fffa62ce1dd630687e",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9003618588723236448"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:47:01.189] Scheduled build:
{
"id": "8838188526712697584",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22988,
"createdBy": "project:chromium",
"createTime": "2021-08-22T14:47:00.725336Z",
"updateTime": "2021-08-22T14:47:01.123188Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e03c577c1d64768fea0266fffa62ce1dd630687e",
"ref": "refs/heads/main"
}
}
}
[14:47:01.189] Task URL: https://cr-buildbucket.appspot.com/build/8838188526712697584
[14:47:01.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:2:0) after 8m35s
[14:49:42.062] Received PubSub notification, asking Buildbucket for the build status
[14:49:42.086] Build status: STARTED
[14:55:36.206] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:2:0)
[14:55:36.256] Build status: STARTED
[14:55:36.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:4:0) after 6m59s
[15:02:35.287] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:4:0)
[15:02:35.314] Build status: STARTED
[15:02:35.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:5:0) after 9m15s
[15:11:50.331] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:5:0)
[15:11:50.380] Build status: STARTED
[15:11:50.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:6:0) after 9m33s
[15:21:23.400] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:6:0)
[15:21:23.469] Build status: STARTED
[15:21:23.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:7:0) after 3m0s
[15:24:23.488] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:7:0)
[15:24:23.516] Build status: STARTED
[15:24:23.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:8:0) after 6m5s
[15:30:28.532] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:8:0)
[15:30:28.610] Build status: STARTED
[15:30:28.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:9:0) after 1m11s
[15:31:39.625] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:9:0)
[15:31:39.845] Build status: STARTED
[15:31:39.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:10:0) after 8m19s
[15:39:59.083] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:10:0)
[15:39:59.120] Build status: STARTED
[15:39:59.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:11:0) after 4m13s
[15:44:12.175] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:11:0)
[15:44:12.213] Build status: STARTED
[15:44:12.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:12:0) after 9m30s
[15:53:42.230] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:12:0)
[15:53:42.262] Build status: STARTED
[15:53:42.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:13:0) after 8m44s
[16:02:26.282] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:13:0)
[16:02:26.313] Build status: STARTED
[16:02:26.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:14:0) after 3m5s
[16:05:31.462] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:14:0)
[16:05:31.503] Build status: STARTED
[16:05:31.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:15:0) after 9m43s
[16:15:14.703] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:15:0)
[16:15:14.744] Build status: STARTED
[16:15:14.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:16:0) after 1m50s
[16:17:04.754] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:16:0)
[16:17:04.798] Build status: STARTED
[16:17:04.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:17:0) after 6m13s
[16:23:17.815] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:17:0)
[16:23:17.855] Build status: STARTED
[16:23:17.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:18:0) after 5m12s
[16:28:29.875] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:18:0)
[16:28:29.969] Build status: STARTED
[16:28:29.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:19:0) after 9m26s
[16:37:55.978] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:19:0)
[16:37:56.002] Build status: STARTED
[16:37:56.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:20:0) after 1m26s
[16:39:22.019] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:20:0)
[16:39:22.047] Build status: STARTED
[16:39:22.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:21:0) after 9m14s
[16:48:36.180] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:21:0)
[16:48:36.246] Build status: STARTED
[16:48:36.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:22:0) after 2m31s
[16:51:07.265] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:22:0)
[16:51:07.300] Build status: STARTED
[16:51:07.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:23:0) after 7m26s
[16:58:33.325] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:23:0)
[16:58:33.353] Build status: STARTED
[16:58:33.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:24:0) after 9m29s
[17:08:02.372] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:24:0)
[17:08:02.403] Build status: STARTED
[17:08:02.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:25:0) after 8m5s
[17:16:07.424] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:25:0)
[17:16:07.633] Build status: STARTED
[17:16:07.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:26:0) after 3m1s
[17:19:08.656] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:26:0)
[17:19:08.685] Build status: STARTED
[17:19:08.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:27:0) after 2m53s
[17:22:01.707] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:27:0)
[17:22:01.737] Build status: STARTED
[17:22:01.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:28:0) after 1m22s
[17:23:23.821] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:28:0)
[17:23:23.851] Build status: STARTED
[17:23:23.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:29:0) after 6m17s
[17:29:41.155] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:29:0)
[17:29:41.184] Build status: STARTED
[17:29:41.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:30:0) after 3m36s
[17:33:17.239] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:30:0)
[17:33:17.268] Build status: STARTED
[17:33:17.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:31:0) after 7m46s
[17:41:03.316] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:31:0)
[17:41:03.353] Build status: STARTED
[17:41:03.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:32:0) after 7m39s
[17:48:42.368] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:32:0)
[17:48:42.397] Build status: STARTED
[17:48:42.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:33:0) after 6m40s
[17:55:22.525] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:33:0)
[17:55:22.551] Build status: STARTED
[17:55:22.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:34:0) after 1m18s
[17:56:41.170] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:34:0)
[17:56:41.198] Build status: STARTED
[17:56:41.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:35:0) after 3m46s
[18:00:27.246] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:35:0)
[18:00:27.287] Build status: STARTED
[18:00:27.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:36:0) after 4m17s
[18:04:44.332] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:36:0)
[18:04:44.370] Build status: STARTED
[18:04:44.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:37:0) after 8m55s
[18:13:39.397] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:37:0)
[18:13:39.668] Build status: STARTED
[18:13:39.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:38:0) after 7m3s
[18:20:42.707] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:38:0)
[18:20:42.732] Build status: STARTED
[18:20:42.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:39:0) after 8m58s
[18:29:40.772] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:39:0)
[18:29:40.806] Build status: STARTED
[18:29:40.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:40:0) after 7m21s
[18:37:01.902] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:40:0)
[18:37:01.961] Build status: STARTED
[18:37:01.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:41:0) after 7m8s
[18:44:09.979] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:41:0)
[18:44:10.003] Build status: STARTED
[18:44:10.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:42:0) after 4m6s
[18:48:16.100] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:42:0)
[18:48:16.132] Build status: STARTED
[18:48:16.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:43:0) after 7m23s
[18:55:39.155] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:43:0)
[18:55:39.186] Build status: STARTED
[18:55:39.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:44:0) after 7m58s
[19:03:37.208] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:44:0)
[19:03:37.255] Build status: STARTED
[19:03:37.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:45:0) after 7m36s
[19:11:13.277] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:45:0)
[19:11:13.307] Build status: STARTED
[19:11:13.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:46:0) after 5m55s
[19:17:08.364] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:46:0)
[19:17:08.446] Build status: STARTED
[19:17:08.446] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:47:0) after 2m10s
[19:19:18.464] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:47:0)
[19:19:18.504] Build status: STARTED
[19:19:18.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:48:0) after 9m49s
[19:29:07.570] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:48:0)
[19:29:07.671] Build status: STARTED
[19:29:07.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:49:0) after 1m24s
[19:30:31.691] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:49:0)
[19:30:31.720] Build status: STARTED
[19:30:31.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:50:0) after 1m50s
[19:32:21.738] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:50:0)
[19:32:21.764] Build status: STARTED
[19:32:21.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:51:0) after 7m19s
[19:39:40.786] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:51:0)
[19:39:40.821] Build status: STARTED
[19:39:40.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:52:0) after 8m27s
[19:48:07.843] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:52:0)
[19:48:07.872] Build status: STARTED
[19:48:07.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:53:0) after 2m17s
[19:50:24.905] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:53:0)
[19:50:24.956] Build status: STARTED
[19:50:24.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:54:0) after 6m43s
[19:57:08.145] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:54:0)
[19:57:08.177] Build status: STARTED
[19:57:08.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:55:0) after 1m24s
[19:58:32.203] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:55:0)
[19:58:32.228] Build status: STARTED
[19:58:32.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:56:0) after 8m40s
[20:07:12.247] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:56:0)
[20:07:12.301] Build status: STARTED
[20:07:12.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:57:0) after 9m45s
[20:16:57.598] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:57:0)
[20:16:57.626] Build status: STARTED
[20:16:57.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:58:0) after 3m48s
[20:20:45.667] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:58:0)
[20:20:45.709] Build status: STARTED
[20:20:45.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:59:0) after 3m17s
[20:24:02.856] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:59:0)
[20:24:02.924] Build status: STARTED
[20:24:02.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:60:0) after 7m52s
[20:31:54.989] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:60:0)
[20:31:55.016] Build status: STARTED
[20:31:55.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:61:0) after 4m17s
[20:36:12.165] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:61:0)
[20:36:12.195] Build status: STARTED
[20:36:12.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:62:0) after 5m43s
[20:41:55.213] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:62:0)
[20:41:55.315] Build status: STARTED
[20:41:55.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:63:0) after 5m42s
[20:47:37.331] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:63:0)
[20:47:37.358] Build status: STARTED
[20:47:37.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:64:0) after 1m24s
[20:49:01.377] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:64:0)
[20:49:01.406] Build status: STARTED
[20:49:01.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003618588723236448:65:0) after 9m33s
[20:52:59.154] Received PubSub notification, asking Buildbucket for the build status
[20:52:59.185] Build:
{
"id": "8838188526712697584",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22988,
"createdBy": "project:chromium",
"createTime": "2021-08-22T14:47:00.725336Z",
"startTime": "2021-08-22T14:49:41.480293Z",
"endTime": "2021-08-22T20:52:58.408625219Z",
"updateTime": "2021-08-22T20:52:58.408976869Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e03c577c1d64768fea0266fffa62ce1dd630687e",
"ref": "refs/heads/main"
}
}
}
[20:52:59.185] Invocation finished in 6h5m59.761384569s with status FAILED