[08:14:01.048] New invocation is queued and will start shortly
[08:14:02.155] Starting the invocation (attempt 1)
[08:14:02.187] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/4236ca5d178d6cff3cfbc9745f09e5e47a24e290"
[08:14:02.187] Popped gitiles commit info from properties and tags
[08:14:02.187] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:14:02.187] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:14:02.187] Buildbucket request:
{
"requestId": "8930169172697878448",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4236ca5d178d6cff3cfbc9745f09e5e47a24e290",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8930169172697878448"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:14:02.792] Scheduled build:
{
"id": "8764739110776973681",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30896,
"createdBy": "project:chromium",
"createTime": "2023-11-11T08:14:02.258412464Z",
"updateTime": "2023-11-11T08:14:02.258412464Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4236ca5d178d6cff3cfbc9745f09e5e47a24e290",
"ref": "refs/heads/main"
}
}
}
[08:14:02.792] Task URL: https://cr-buildbucket.appspot.com/build/8764739110776973681
[08:14:02.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:2:0) after 6m26s
[08:14:03.770] Received PubSub notification, asking Buildbucket for the build status
[08:14:03.794] Build status: SCHEDULED
[08:15:06.544] Received PubSub notification, asking Buildbucket for the build status
[08:15:06.564] Build status: STARTED
[08:20:28.866] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:2:0)
[08:20:28.885] Build status: STARTED
[08:20:28.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:5:0) after 1m9s
[08:21:37.914] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:5:0)
[08:21:37.961] Build status: STARTED
[08:21:37.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:6:0) after 8m38s
[08:30:16.136] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:6:0)
[08:30:16.162] Build status: STARTED
[08:30:16.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:7:0) after 9m27s
[08:39:43.262] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:7:0)
[08:39:43.285] Build status: STARTED
[08:39:43.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:8:0) after 9m7s
[08:48:50.432] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:8:0)
[08:48:50.468] Build status: STARTED
[08:48:50.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:9:0) after 6m31s
[08:55:21.506] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:9:0)
[08:55:21.556] Build status: STARTED
[08:55:21.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:10:0) after 8m57s
[09:04:18.570] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:10:0)
[09:04:18.595] Build status: STARTED
[09:04:18.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:11:0) after 8m24s
[09:12:42.617] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:11:0)
[09:12:42.790] Build status: STARTED
[09:12:42.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:12:0) after 8m24s
[09:21:06.810] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:12:0)
[09:21:06.834] Build status: STARTED
[09:21:06.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:13:0) after 6m25s
[09:27:31.951] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:13:0)
[09:27:31.975] Build status: STARTED
[09:27:31.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:14:0) after 5m28s
[09:33:00.079] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:14:0)
[09:33:00.101] Build status: STARTED
[09:33:00.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:15:0) after 5m36s
[09:38:36.157] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:15:0)
[09:38:36.184] Build status: STARTED
[09:38:36.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:16:0) after 8m28s
[09:47:04.235] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:16:0)
[09:47:04.300] Build status: STARTED
[09:47:04.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:17:0) after 7m10s
[09:54:14.319] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:17:0)
[09:54:14.342] Build status: STARTED
[09:54:14.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:18:0) after 3m30s
[09:57:44.324] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:18:0)
[09:57:44.371] Build status: STARTED
[09:57:44.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:19:0) after 9m37s
[10:07:21.463] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:19:0)
[10:07:21.481] Build status: STARTED
[10:07:21.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:20:0) after 6m10s
[10:13:31.668] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:20:0)
[10:13:31.697] Build status: STARTED
[10:13:31.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:21:0) after 6m20s
[10:19:51.834] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:21:0)
[10:19:51.860] Build status: STARTED
[10:19:51.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:22:0) after 1m50s
[10:21:41.878] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:22:0)
[10:21:41.899] Build status: STARTED
[10:21:41.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:23:0) after 9m9s
[10:30:50.921] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:23:0)
[10:30:50.939] Build status: STARTED
[10:30:50.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:24:0) after 3m48s
[10:34:38.962] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:24:0)
[10:34:39.021] Build status: STARTED
[10:34:39.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:25:0) after 4m6s
[10:38:45.096] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:25:0)
[10:38:45.116] Build status: STARTED
[10:38:45.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:26:0) after 4m29s
[10:43:14.271] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:26:0)
[10:43:14.288] Build status: STARTED
[10:43:14.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:27:0) after 5m47s
[10:49:01.305] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:27:0)
[10:49:01.327] Build status: STARTED
[10:49:01.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:28:0) after 6m6s
[10:55:07.605] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:28:0)
[10:55:07.649] Build status: STARTED
[10:55:07.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:29:0) after 3m41s
[10:58:48.781] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:29:0)
[10:58:48.843] Build status: STARTED
[10:58:48.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:30:0) after 1m22s
[11:00:11.006] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:30:0)
[11:00:11.054] Build status: STARTED
[11:00:11.054] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:31:0) after 2m15s
[11:02:26.173] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:31:0)
[11:02:26.197] Build status: STARTED
[11:02:26.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:32:0) after 2m20s
[11:04:46.216] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:32:0)
[11:04:46.251] Build status: STARTED
[11:04:46.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:33:0) after 7m36s
[11:12:22.572] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:33:0)
[11:12:22.595] Build status: STARTED
[11:12:22.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:34:0) after 4m27s
[11:16:49.919] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:34:0)
[11:16:49.945] Build status: STARTED
[11:16:49.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:35:0) after 7m35s
[11:24:25.070] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:35:0)
[11:24:25.091] Build status: STARTED
[11:24:25.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:36:0) after 4m22s
[11:28:47.118] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:36:0)
[11:28:47.145] Build status: STARTED
[11:28:47.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:37:0) after 3m17s
[11:32:04.266] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:37:0)
[11:32:04.283] Build status: STARTED
[11:32:04.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:38:0) after 8m23s
[11:40:27.482] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:38:0)
[11:40:27.503] Build status: STARTED
[11:40:27.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:39:0) after 8m54s
[11:49:21.858] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:39:0)
[11:49:21.877] Build status: STARTED
[11:49:21.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:40:0) after 3m13s
[11:52:35.086] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:40:0)
[11:52:35.322] Build status: STARTED
[11:52:35.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:41:0) after 6m48s
[11:59:23.344] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:41:0)
[11:59:23.362] Build status: STARTED
[11:59:23.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:42:0) after 9m26s
[12:08:49.596] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:42:0)
[12:08:49.790] Build status: STARTED
[12:08:49.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:43:0) after 5m39s
[12:14:28.813] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:43:0)
[12:14:28.832] Build status: STARTED
[12:14:28.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:44:0) after 7m54s
[12:22:22.856] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:44:0)
[12:22:22.876] Build status: STARTED
[12:22:22.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:45:0) after 6m46s
[12:29:09.330] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:45:0)
[12:29:09.354] Build status: STARTED
[12:29:09.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:46:0) after 8m38s
[12:37:47.345] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:46:0)
[12:37:47.368] Build status: STARTED
[12:37:47.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:47:0) after 3m21s
[12:41:08.389] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:47:0)
[12:41:08.410] Build status: STARTED
[12:41:08.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:48:0) after 4m35s
[12:45:43.452] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:48:0)
[12:45:43.473] Build status: STARTED
[12:45:43.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:49:0) after 7m23s
[12:53:06.456] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:49:0)
[12:53:06.476] Build status: STARTED
[12:53:06.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:50:0) after 8m1s
[13:01:07.443] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:50:0)
[13:01:07.465] Build status: STARTED
[13:01:07.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:51:0) after 7m1s
[13:08:08.483] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:51:0)
[13:08:08.503] Build status: STARTED
[13:08:08.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:52:0) after 9m32s
[13:17:40.569] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:52:0)
[13:17:40.587] Build status: STARTED
[13:17:40.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:53:0) after 8m56s
[13:26:36.604] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:53:0)
[13:26:36.634] Build status: STARTED
[13:26:36.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:54:0) after 8m24s
[13:35:00.660] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:54:0)
[13:35:00.677] Build status: STARTED
[13:35:00.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:55:0) after 7m46s
[13:42:46.731] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:55:0)
[13:42:46.789] Build status: STARTED
[13:42:46.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:56:0) after 4m4s
[13:46:50.834] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:56:0)
[13:46:50.949] Build status: STARTED
[13:46:50.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:57:0) after 5m48s
[13:52:38.966] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:57:0)
[13:52:38.983] Build status: STARTED
[13:52:38.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:58:0) after 8m56s
[14:01:35.085] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:58:0)
[14:01:35.120] Build status: STARTED
[14:01:35.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:59:0) after 4m39s
[14:06:14.138] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:59:0)
[14:06:14.325] Build status: STARTED
[14:06:14.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:60:0) after 2m10s
[14:08:24.488] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:60:0)
[14:08:24.505] Build status: STARTED
[14:08:24.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:61:0) after 5m36s
[14:14:00.780] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:61:0)
[14:14:00.812] Build status: STARTED
[14:14:00.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:62:0) after 3m17s
[14:17:18.311] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:62:0)
[14:17:18.478] Build status: STARTED
[14:17:18.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:63:0) after 5m25s
[14:22:43.517] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:63:0)
[14:22:43.547] Build status: STARTED
[14:22:43.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8930169172697878448:64:0) after 9m41s
[14:27:19.021] Received PubSub notification, asking Buildbucket for the build status
[14:27:19.041] Build:
{
"id": "8764739110776973681",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30896,
"createdBy": "project:chromium",
"createTime": "2023-11-11T08:14:02.258412464Z",
"startTime": "2023-11-11T08:15:05.346578Z",
"endTime": "2023-11-11T14:27:18.310389Z",
"updateTime": "2023-11-11T14:27:18.310389Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4236ca5d178d6cff3cfbc9745f09e5e47a24e290",
"ref": "refs/heads/main"
}
}
}
[14:27:19.041] Invocation finished in 6h13m17.997820918s with status FAILED