[14:20:36.671] New invocation is queued and will start shortly
[14:20:37.736] Starting the invocation (attempt 1)
[14:20:37.767] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2976888cccc4faa20b03417cee5bcb8aabfe526a"
[14:20:37.767] Popped gitiles commit info from properties and tags
[14:20:37.767] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:20:37.767] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:20:37.767] Buildbucket request:
{
"requestId": "8999180997030289264",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2976888cccc4faa20b03417cee5bcb8aabfe526a",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8999180997030289264"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:20:38.292] Scheduled build:
{
"id": "8833750935146238881",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23328,
"createdBy": "project:chromium",
"createTime": "2021-10-10T14:20:37.829916471Z",
"updateTime": "2021-10-10T14:20:38.140379238Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2976888cccc4faa20b03417cee5bcb8aabfe526a",
"ref": "refs/heads/main"
}
}
}
[14:20:38.292] Task URL: https://cr-buildbucket.appspot.com/build/8833750935146238881
[14:20:38.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:2:0) after 9m51s
[14:22:53.742] Received PubSub notification, asking Buildbucket for the build status
[14:22:53.776] Build status: STARTED
[14:30:29.459] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:2:0)
[14:30:29.517] Build status: STARTED
[14:30:29.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:4:0) after 6m57s
[14:37:26.685] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:4:0)
[14:37:26.718] Build status: STARTED
[14:37:26.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:5:0) after 9m58s
[14:47:24.739] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:5:0)
[14:47:24.769] Build status: STARTED
[14:47:24.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:6:0) after 4m59s
[14:52:24.086] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:6:0)
[14:52:24.111] Build status: STARTED
[14:52:24.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:7:0) after 6m14s
[14:58:38.214] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:7:0)
[14:58:38.261] Build status: STARTED
[14:58:38.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:8:0) after 9m58s
[15:08:36.442] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:8:0)
[15:08:36.472] Build status: STARTED
[15:08:36.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:9:0) after 7m31s
[15:16:07.689] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:9:0)
[15:16:07.718] Build status: STARTED
[15:16:07.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:10:0) after 3m18s
[15:19:26.056] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:10:0)
[15:19:26.088] Build status: STARTED
[15:19:26.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:11:0) after 7m46s
[15:27:12.105] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:11:0)
[15:27:12.181] Build status: STARTED
[15:27:12.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:12:0) after 1m30s
[15:28:42.200] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:12:0)
[15:28:42.230] Build status: STARTED
[15:28:42.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:13:0) after 2m10s
[15:30:52.247] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:13:0)
[15:30:52.285] Build status: STARTED
[15:30:52.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:14:0) after 4m40s
[15:35:32.451] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:14:0)
[15:35:32.491] Build status: STARTED
[15:35:32.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:15:0) after 7m1s
[15:42:33.511] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:15:0)
[15:42:33.546] Build status: STARTED
[15:42:33.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:16:0) after 6m44s
[15:49:17.590] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:16:0)
[15:49:17.656] Build status: STARTED
[15:49:17.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:17:0) after 9m11s
[15:58:28.677] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:17:0)
[15:58:28.706] Build status: STARTED
[15:58:28.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:18:0) after 9m20s
[16:07:48.875] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:18:0)
[16:07:48.921] Build status: STARTED
[16:07:48.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:19:0) after 2m57s
[16:10:46.044] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:19:0)
[16:10:46.073] Build status: STARTED
[16:10:46.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:20:0) after 6m6s
[16:16:52.150] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:20:0)
[16:16:52.190] Build status: STARTED
[16:16:52.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:21:0) after 5m57s
[16:22:49.189] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:21:0)
[16:22:49.218] Build status: STARTED
[16:22:49.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:22:0) after 3m37s
[16:26:26.234] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:22:0)
[16:26:26.262] Build status: STARTED
[16:26:26.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:23:0) after 7m22s
[16:33:48.314] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:23:0)
[16:33:48.385] Build status: STARTED
[16:33:48.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:24:0) after 9m52s
[16:43:40.598] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:24:0)
[16:43:40.625] Build status: STARTED
[16:43:40.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:25:0) after 1m8s
[16:44:48.629] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:25:0)
[16:44:48.677] Build status: STARTED
[16:44:48.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:26:0) after 3m7s
[16:47:55.715] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:26:0)
[16:47:55.755] Build status: STARTED
[16:47:55.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:27:0) after 2m12s
[16:50:07.778] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:27:0)
[16:50:07.808] Build status: STARTED
[16:50:07.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:28:0) after 6m33s
[16:56:40.826] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:28:0)
[16:56:40.850] Build status: STARTED
[16:56:40.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:29:0) after 9m34s
[17:06:14.983] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:29:0)
[17:06:15.019] Build status: STARTED
[17:06:15.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:30:0) after 4m42s
[17:10:58.534] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:30:0)
[17:10:58.563] Build status: STARTED
[17:10:58.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:31:0) after 7m8s
[17:18:06.653] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:31:0)
[17:18:06.696] Build status: STARTED
[17:18:06.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:32:0) after 8m59s
[17:27:05.712] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:32:0)
[17:27:05.816] Build status: STARTED
[17:27:05.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:33:0) after 1m33s
[17:28:38.835] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:33:0)
[17:28:38.867] Build status: STARTED
[17:28:38.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:34:0) after 2m37s
[17:31:15.881] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:34:0)
[17:31:15.936] Build status: STARTED
[17:31:15.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:35:0) after 5m39s
[17:36:55.223] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:35:0)
[17:36:55.258] Build status: STARTED
[17:36:55.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:36:0) after 1m22s
[17:38:17.275] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:36:0)
[17:38:17.305] Build status: STARTED
[17:38:17.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:37:0) after 2m31s
[17:40:48.347] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:37:0)
[17:40:48.372] Build status: STARTED
[17:40:48.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:38:0) after 6m14s
[17:47:02.525] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:38:0)
[17:47:02.557] Build status: STARTED
[17:47:02.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:39:0) after 6m0s
[17:53:03.305] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:39:0)
[17:53:03.389] Build status: STARTED
[17:53:03.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:40:0) after 5m24s
[17:58:27.406] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:40:0)
[17:58:27.571] Build status: STARTED
[17:58:27.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:41:0) after 6m22s
[18:04:49.654] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:41:0)
[18:04:49.680] Build status: STARTED
[18:04:49.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:42:0) after 6m39s
[18:11:28.697] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:42:0)
[18:11:28.730] Build status: STARTED
[18:11:28.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:43:0) after 3m44s
[18:15:13.021] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:43:0)
[18:15:13.087] Build status: STARTED
[18:15:13.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:44:0) after 7m6s
[18:22:19.104] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:44:0)
[18:22:19.172] Build status: STARTED
[18:22:19.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:45:0) after 5m3s
[18:27:22.190] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:45:0)
[18:27:22.358] Build status: STARTED
[18:27:22.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:46:0) after 1m58s
[18:29:20.374] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:46:0)
[18:29:20.408] Build status: STARTED
[18:29:20.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:47:0) after 6m50s
[18:36:10.428] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:47:0)
[18:36:10.456] Build status: STARTED
[18:36:10.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:48:0) after 5m7s
[18:41:17.514] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:48:0)
[18:41:17.544] Build status: STARTED
[18:41:17.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:49:0) after 9m10s
[18:50:27.564] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:49:0)
[18:50:27.602] Build status: STARTED
[18:50:27.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:50:0) after 5m36s
[18:56:03.913] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:50:0)
[18:56:03.948] Build status: STARTED
[18:56:03.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:51:0) after 7m39s
[19:03:42.968] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:51:0)
[19:03:42.995] Build status: STARTED
[19:03:42.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:52:0) after 9m8s
[19:12:51.017] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:52:0)
[19:12:51.056] Build status: STARTED
[19:12:51.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:53:0) after 6m51s
[19:19:42.076] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:53:0)
[19:19:42.109] Build status: STARTED
[19:19:42.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:54:0) after 4m21s
[19:24:03.155] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:54:0)
[19:24:03.353] Build status: STARTED
[19:24:03.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999180997030289264:55:0) after 6m29s
[19:28:44.374] Received PubSub notification, asking Buildbucket for the build status
[19:28:44.403] Build:
{
"id": "8833750935146238881",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23328,
"createdBy": "project:chromium",
"createTime": "2021-10-10T14:20:37.829916471Z",
"startTime": "2021-10-10T14:22:53.298877Z",
"endTime": "2021-10-10T19:28:43.781259915Z",
"updateTime": "2021-10-10T19:28:43.781815950Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2976888cccc4faa20b03417cee5bcb8aabfe526a",
"ref": "refs/heads/main"
}
}
}
[19:28:44.403] Invocation finished in 5h8m7.754151616s with status FAILED