[10:48:58.789] New invocation is queued and will start shortly
[10:48:59.922] Starting the invocation (attempt 1)
[10:48:59.957] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/6b36f30b1c4673d467dbce1d1b9f383f7266a62c"
[10:48:59.957] Popped gitiles commit info from properties and tags
[10:48:59.957] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:48:59.957] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:48:59.957] Buildbucket request:
{
"requestId": "8954620604238714560",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6b36f30b1c4673d467dbce1d1b9f383f7266a62c",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8954620604238714560"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:49:00.464] Scheduled build:
{
"id": "8789190542222157489",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 28943,
"createdBy": "project:chromium",
"createTime": "2023-02-14T10:49:00.090272143Z",
"updateTime": "2023-02-14T10:49:00.090272143Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6b36f30b1c4673d467dbce1d1b9f383f7266a62c",
"ref": "refs/heads/main"
}
}
}
[10:49:00.464] Task URL: https://cr-buildbucket.appspot.com/build/8789190542222157489
[10:49:00.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:2:0) after 2m28s
[10:51:27.060] Received PubSub notification, asking Buildbucket for the build status
[10:51:27.101] Build status: STARTED
[10:51:28.659] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:2:0)
[10:51:28.679] Build status: STARTED
[10:51:28.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:4:0) after 5m38s
[10:57:07.114] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:4:0)
[10:57:07.158] Build status: STARTED
[10:57:07.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:5:0) after 4m41s
[11:01:48.384] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:5:0)
[11:01:48.432] Build status: STARTED
[11:01:48.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:6:0) after 2m1s
[11:03:49.473] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:6:0)
[11:03:49.509] Build status: STARTED
[11:03:49.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:7:0) after 6m11s
[11:10:00.533] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:7:0)
[11:10:00.567] Build status: STARTED
[11:10:00.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:8:0) after 6m54s
[11:16:54.697] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:8:0)
[11:16:54.723] Build status: STARTED
[11:16:54.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:9:0) after 4m22s
[11:21:16.725] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:9:0)
[11:21:16.752] Build status: STARTED
[11:21:16.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:10:0) after 1m39s
[11:22:55.807] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:10:0)
[11:22:55.874] Build status: STARTED
[11:22:55.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:11:0) after 1m25s
[11:24:21.001] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:11:0)
[11:24:21.027] Build status: STARTED
[11:24:21.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:12:0) after 8m41s
[11:33:02.203] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:12:0)
[11:33:02.256] Build status: STARTED
[11:33:02.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:13:0) after 4m32s
[11:37:34.348] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:13:0)
[11:37:34.373] Build status: STARTED
[11:37:34.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:14:0) after 7m10s
[11:44:44.373] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:14:0)
[11:44:44.414] Build status: STARTED
[11:44:44.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:15:0) after 9m25s
[11:54:09.452] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:15:0)
[11:54:09.475] Build status: STARTED
[11:54:09.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:16:0) after 2m22s
[11:56:31.497] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:16:0)
[11:56:31.524] Build status: STARTED
[11:56:31.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:17:0) after 5m18s
[12:01:49.547] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:17:0)
[12:01:49.581] Build status: STARTED
[12:01:49.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:18:0) after 5m30s
[12:07:20.053] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:18:0)
[12:07:20.074] Build status: STARTED
[12:07:20.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:19:0) after 7m16s
[12:14:36.326] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:19:0)
[12:14:36.345] Build status: STARTED
[12:14:36.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:20:0) after 1m58s
[12:16:34.507] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:20:0)
[12:16:34.527] Build status: STARTED
[12:16:34.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:21:0) after 1m40s
[12:18:14.601] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:21:0)
[12:18:14.634] Build status: STARTED
[12:18:14.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:22:0) after 6m56s
[12:25:10.666] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:22:0)
[12:25:10.691] Build status: STARTED
[12:25:10.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:23:0) after 1m39s
[12:26:49.676] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:23:0)
[12:26:49.760] Build status: STARTED
[12:26:49.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:24:0) after 7m11s
[12:34:00.781] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:24:0)
[12:34:00.809] Build status: STARTED
[12:34:00.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:25:0) after 3m18s
[12:37:18.901] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:25:0)
[12:37:18.938] Build status: STARTED
[12:37:18.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:26:0) after 8m48s
[12:46:06.955] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:26:0)
[12:46:06.983] Build status: STARTED
[12:46:06.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:27:0) after 5m38s
[12:51:45.163] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:27:0)
[12:51:45.185] Build status: STARTED
[12:51:45.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:28:0) after 4m59s
[12:56:44.308] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:28:0)
[12:56:44.334] Build status: STARTED
[12:56:44.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:29:0) after 5m54s
[13:02:38.642] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:29:0)
[13:02:38.696] Build status: STARTED
[13:02:38.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:30:0) after 7m56s
[13:10:34.716] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:30:0)
[13:10:34.748] Build status: STARTED
[13:10:34.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:31:0) after 7m0s
[13:17:35.238] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:31:0)
[13:17:35.290] Build status: STARTED
[13:17:35.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:32:0) after 2m54s
[13:20:29.469] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:32:0)
[13:20:29.493] Build status: STARTED
[13:20:29.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:33:0) after 2m23s
[13:22:52.516] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:33:0)
[13:22:52.535] Build status: STARTED
[13:22:52.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:34:0) after 8m54s
[13:31:46.584] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:34:0)
[13:31:46.675] Build status: STARTED
[13:31:46.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:35:0) after 4m6s
[13:35:52.827] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:35:0)
[13:35:52.853] Build status: STARTED
[13:35:52.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:36:0) after 3m54s
[13:39:46.892] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:36:0)
[13:39:46.980] Build status: STARTED
[13:39:46.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:37:0) after 4m24s
[13:44:11.591] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:37:0)
[13:44:11.616] Build status: STARTED
[13:44:11.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:38:0) after 3m46s
[13:47:57.644] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:38:0)
[13:47:57.677] Build status: STARTED
[13:47:57.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:39:0) after 3m39s
[13:51:36.804] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:39:0)
[13:51:36.830] Build status: STARTED
[13:51:36.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:40:0) after 6m47s
[13:58:23.873] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:40:0)
[13:58:23.968] Build status: STARTED
[13:58:23.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:41:0) after 4m14s
[14:02:37.999] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:41:0)
[14:02:38.257] Build status: STARTED
[14:02:38.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:42:0) after 3m42s
[14:06:20.475] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:42:0)
[14:06:20.498] Build status: STARTED
[14:06:20.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:43:0) after 4m32s
[14:10:52.518] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:43:0)
[14:10:52.541] Build status: STARTED
[14:10:52.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:44:0) after 5m2s
[14:15:54.568] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:44:0)
[14:15:54.592] Build status: STARTED
[14:15:54.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:45:0) after 1m40s
[14:17:34.661] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:45:0)
[14:17:34.693] Build status: STARTED
[14:17:34.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:46:0) after 6m26s
[14:24:00.758] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:46:0)
[14:24:00.881] Build status: STARTED
[14:24:00.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:47:0) after 1m20s
[14:25:20.916] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:47:0)
[14:25:20.938] Build status: STARTED
[14:25:20.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:48:0) after 9m49s
[14:35:10.598] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:48:0)
[14:35:10.622] Build status: STARTED
[14:35:10.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:49:0) after 1m41s
[14:36:51.806] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:49:0)
[14:36:51.829] Build status: STARTED
[14:36:51.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:50:0) after 4m19s
[14:41:11.302] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:50:0)
[14:41:11.328] Build status: STARTED
[14:41:11.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:51:0) after 8m41s
[14:49:52.452] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:51:0)
[14:49:52.515] Build status: STARTED
[14:49:52.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:52:0) after 7m52s
[14:57:44.546] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:52:0)
[14:57:44.571] Build status: STARTED
[14:57:44.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:53:0) after 5m0s
[15:02:44.723] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:53:0)
[15:02:44.746] Build status: STARTED
[15:02:44.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:54:0) after 2m15s
[15:04:59.871] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:54:0)
[15:04:59.899] Build status: STARTED
[15:04:59.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:55:0) after 5m55s
[15:10:54.985] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:55:0)
[15:10:55.017] Build status: STARTED
[15:10:55.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:56:0) after 2m2s
[15:12:57.169] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:56:0)
[15:12:57.191] Build status: STARTED
[15:12:57.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:57:0) after 3m13s
[15:16:10.677] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:57:0)
[15:16:10.700] Build status: STARTED
[15:16:10.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:58:0) after 9m52s
[15:26:03.071] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:58:0)
[15:26:03.105] Build status: STARTED
[15:26:03.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:59:0) after 7m31s
[15:33:34.216] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:59:0)
[15:33:34.242] Build status: STARTED
[15:33:34.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:60:0) after 8m52s
[15:42:26.461] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:60:0)
[15:42:26.485] Build status: STARTED
[15:42:26.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:61:0) after 8m49s
[15:51:15.504] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:61:0)
[15:51:15.531] Build status: STARTED
[15:51:15.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:62:0) after 7m6s
[15:58:21.651] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:62:0)
[15:58:21.769] Build status: STARTED
[15:58:21.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8954620604238714560:63:0) after 6m3s
[16:04:12.949] Received PubSub notification, asking Buildbucket for the build status
[16:04:12.968] Build:
{
"id": "8789190542222157489",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 28943,
"createdBy": "project:chromium",
"createTime": "2023-02-14T10:49:00.090272143Z",
"startTime": "2023-02-14T10:51:26.069657Z",
"endTime": "2023-02-14T16:04:12.332495013Z",
"updateTime": "2023-02-14T16:04:12.332495013Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6b36f30b1c4673d467dbce1d1b9f383f7266a62c",
"ref": "refs/heads/main"
}
}
}
[16:04:12.968] Invocation finished in 5h15m14.185635869s with status FAILED