[08:21:34.932] New invocation is queued and will start shortly
[08:21:36.303] Starting the invocation (attempt 1)
[08:21:36.335] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f9a7dfb5741680e3db09a75b6e2cf4a840140bf5"
[08:21:36.335] Popped gitiles commit info from properties and tags
[08:21:36.335] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:21:36.335] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:21:36.335] Buildbucket request:
{
"requestId": "8927903772608900240",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f9a7dfb5741680e3db09a75b6e2cf4a840140bf5",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8927903772608900240"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:21:37.301] Scheduled build:
{
"id": "8762473710417222961",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30996,
"createdBy": "project:chromium",
"createTime": "2023-12-06T08:21:36.398662584Z",
"updateTime": "2023-12-06T08:21:36.398662584Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f9a7dfb5741680e3db09a75b6e2cf4a840140bf5",
"ref": "refs/heads/main"
}
}
}
[08:21:37.301] Task URL: https://cr-buildbucket.appspot.com/build/8762473710417222961
[08:21:37.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:2:0) after 4m23s
[08:21:38.199] Received PubSub notification, asking Buildbucket for the build status
[08:21:38.244] Build status: SCHEDULED
[08:22:34.203] Received PubSub notification, asking Buildbucket for the build status
[08:22:34.231] Build status: STARTED
[08:26:00.318] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:2:0)
[08:26:00.338] Build status: STARTED
[08:26:00.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:5:0) after 1m28s
[08:27:28.556] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:5:0)
[08:27:28.586] Build status: STARTED
[08:27:28.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:6:0) after 3m51s
[08:31:20.048] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:6:0)
[08:31:20.068] Build status: STARTED
[08:31:20.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:7:0) after 8m45s
[08:40:05.147] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:7:0)
[08:40:05.195] Build status: STARTED
[08:40:05.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:8:0) after 8m58s
[08:49:03.231] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:8:0)
[08:49:03.262] Build status: STARTED
[08:49:03.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:9:0) after 4m1s
[08:53:04.361] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:9:0)
[08:53:04.381] Build status: STARTED
[08:53:04.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:10:0) after 1m28s
[08:54:32.469] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:10:0)
[08:54:32.496] Build status: STARTED
[08:54:32.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:11:0) after 9m41s
[09:04:13.544] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:11:0)
[09:04:13.569] Build status: STARTED
[09:04:13.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:12:0) after 6m56s
[09:11:09.639] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:12:0)
[09:11:09.664] Build status: STARTED
[09:11:09.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:13:0) after 1m25s
[09:12:34.776] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:13:0)
[09:12:34.793] Build status: STARTED
[09:12:34.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:14:0) after 9m36s
[09:22:10.834] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:14:0)
[09:22:10.856] Build status: STARTED
[09:22:10.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:15:0) after 8m40s
[09:30:50.880] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:15:0)
[09:30:50.944] Build status: STARTED
[09:30:50.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:16:0) after 9m56s
[09:40:46.989] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:16:0)
[09:40:47.014] Build status: STARTED
[09:40:47.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:17:0) after 1m25s
[09:42:12.044] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:17:0)
[09:42:12.065] Build status: STARTED
[09:42:12.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:18:0) after 1m33s
[09:43:45.146] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:18:0)
[09:43:45.168] Build status: STARTED
[09:43:45.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:19:0) after 8m8s
[09:51:53.198] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:19:0)
[09:51:53.222] Build status: STARTED
[09:51:53.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:20:0) after 2m24s
[09:54:17.245] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:20:0)
[09:54:17.280] Build status: STARTED
[09:54:17.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:21:0) after 3m4s
[09:57:21.403] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:21:0)
[09:57:21.427] Build status: STARTED
[09:57:21.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:22:0) after 6m53s
[10:04:14.803] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:22:0)
[10:04:14.874] Build status: STARTED
[10:04:14.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:23:0) after 2m42s
[10:06:56.950] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:23:0)
[10:06:57.018] Build status: STARTED
[10:06:57.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:24:0) after 7m8s
[10:14:05.091] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:24:0)
[10:14:05.125] Build status: STARTED
[10:14:05.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:25:0) after 3m18s
[10:17:23.290] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:25:0)
[10:17:23.311] Build status: STARTED
[10:17:23.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:26:0) after 3m27s
[10:20:50.335] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:26:0)
[10:20:50.391] Build status: STARTED
[10:20:50.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:27:0) after 3m38s
[10:24:28.417] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:27:0)
[10:24:28.437] Build status: STARTED
[10:24:28.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:28:0) after 5m3s
[10:29:31.459] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:28:0)
[10:29:31.482] Build status: STARTED
[10:29:31.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:29:0) after 5m16s
[10:34:48.312] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:29:0)
[10:34:48.331] Build status: STARTED
[10:34:48.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:30:0) after 5m12s
[10:40:00.351] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:30:0)
[10:40:00.370] Build status: STARTED
[10:40:00.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:31:0) after 9m41s
[10:49:41.405] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:31:0)
[10:49:41.424] Build status: STARTED
[10:49:41.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:32:0) after 1m25s
[10:51:06.655] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:32:0)
[10:51:06.679] Build status: STARTED
[10:51:06.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:33:0) after 5m52s
[10:56:58.695] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:33:0)
[10:56:58.717] Build status: STARTED
[10:56:58.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:34:0) after 5m8s
[11:02:06.841] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:34:0)
[11:02:06.871] Build status: STARTED
[11:02:06.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:35:0) after 4m58s
[11:07:04.890] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:35:0)
[11:07:04.909] Build status: STARTED
[11:07:04.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:36:0) after 6m54s
[11:13:58.941] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:36:0)
[11:13:58.965] Build status: STARTED
[11:13:58.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:37:0) after 7m37s
[11:21:36.127] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:37:0)
[11:21:36.147] Build status: STARTED
[11:21:36.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:38:0) after 9m50s
[11:31:26.165] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:38:0)
[11:31:26.224] Build status: STARTED
[11:31:26.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:39:0) after 8m6s
[11:39:32.504] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:39:0)
[11:39:32.532] Build status: STARTED
[11:39:32.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:40:0) after 4m31s
[11:44:03.554] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:40:0)
[11:44:03.589] Build status: STARTED
[11:44:03.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:41:0) after 4m24s
[11:48:28.619] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:41:0)
[11:48:28.643] Build status: STARTED
[11:48:28.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:42:0) after 8m46s
[11:57:14.854] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:42:0)
[11:57:14.877] Build status: STARTED
[11:57:14.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:43:0) after 9m5s
[12:06:20.806] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:43:0)
[12:06:20.887] Build status: STARTED
[12:06:20.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:44:0) after 9m55s
[12:16:16.049] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:44:0)
[12:16:16.075] Build status: STARTED
[12:16:16.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:45:0) after 4m8s
[12:20:24.102] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:45:0)
[12:20:24.135] Build status: STARTED
[12:20:24.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:46:0) after 8m53s
[12:29:17.300] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:46:0)
[12:29:17.670] Build status: STARTED
[12:29:17.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:47:0) after 7m8s
[12:36:25.746] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:47:0)
[12:36:25.777] Build status: STARTED
[12:36:25.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:48:0) after 9m35s
[12:46:01.066] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:48:0)
[12:46:01.089] Build status: STARTED
[12:46:01.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:49:0) after 9m48s
[12:55:49.495] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:49:0)
[12:55:49.559] Build status: STARTED
[12:55:49.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:50:0) after 9m7s
[13:04:56.958] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:50:0)
[13:04:56.993] Build status: STARTED
[13:04:56.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:51:0) after 1m49s
[13:06:46.077] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:51:0)
[13:06:46.113] Build status: STARTED
[13:06:46.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:52:0) after 1m20s
[13:08:06.224] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:52:0)
[13:08:06.409] Build status: STARTED
[13:08:06.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:53:0) after 5m33s
[13:13:39.416] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:53:0)
[13:13:39.434] Build status: STARTED
[13:13:39.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:54:0) after 7m38s
[13:21:17.457] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:54:0)
[13:21:17.476] Build status: STARTED
[13:21:17.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:55:0) after 7m13s
[13:28:30.581] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:55:0)
[13:28:30.609] Build status: STARTED
[13:28:30.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:56:0) after 9m11s
[13:37:41.777] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:56:0)
[13:37:41.825] Build status: STARTED
[13:37:41.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:57:0) after 2m2s
[13:39:44.034] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:57:0)
[13:39:44.054] Build status: STARTED
[13:39:44.054] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:58:0) after 7m29s
[13:47:13.467] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:58:0)
[13:47:13.486] Build status: STARTED
[13:47:13.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:59:0) after 3m9s
[13:50:23.117] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:59:0)
[13:50:23.142] Build status: STARTED
[13:50:23.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:60:0) after 7m13s
[13:57:36.353] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:60:0)
[13:57:36.399] Build status: STARTED
[13:57:36.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:61:0) after 9m57s
[14:07:33.431] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:61:0)
[14:07:33.461] Build status: STARTED
[14:07:33.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:62:0) after 3m36s
[14:11:09.662] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:62:0)
[14:11:09.753] Build status: STARTED
[14:11:09.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:63:0) after 7m40s
[14:18:50.072] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:63:0)
[14:18:50.120] Build status: STARTED
[14:18:50.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:64:0) after 9m33s
[14:28:23.245] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:64:0)
[14:28:23.301] Build status: STARTED
[14:28:23.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:65:0) after 8m25s
[14:36:48.638] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:65:0)
[14:36:48.658] Build status: STARTED
[14:36:48.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8927903772608900240:66:0) after 6m4s
[14:36:54.572] Received PubSub notification, asking Buildbucket for the build status
[14:36:54.600] Build:
{
"id": "8762473710417222961",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30996,
"createdBy": "project:chromium",
"createTime": "2023-12-06T08:21:36.398662584Z",
"startTime": "2023-12-06T08:22:33.549573Z",
"endTime": "2023-12-06T14:36:53.754072Z",
"updateTime": "2023-12-06T14:36:53.754072Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f9a7dfb5741680e3db09a75b6e2cf4a840140bf5",
"ref": "refs/heads/main"
}
}
}
[14:36:54.600] Invocation finished in 6h15m19.676029665s with status FAILED