[21:23:12.567] New invocation is queued and will start shortly
[21:23:13.663] Starting the invocation (attempt 1)
[21:23:13.691] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/89ee37cc0481ef1c54bd2ce40d0010a899516405"
[21:23:13.691] Popped gitiles commit info from properties and tags
[21:23:13.691] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:23:13.691] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:23:13.691] Buildbucket request:
{
"requestId": "8887357752895729904",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinux"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "89ee37cc0481ef1c54bd2ce40d0010a899516405",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8887357752895729904"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinux"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:23:14.155] Scheduled build:
{
"id": "8721927691000044081",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinux"
},
"number": 29003,
"createdBy": "project:chromium",
"createTime": "2025-02-25T21:23:13.748180672Z",
"updateTime": "2025-02-25T21:23:13.748180672Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "89ee37cc0481ef1c54bd2ce40d0010a899516405",
"ref": "refs/heads/main"
}
}
}
[21:23:14.155] Task URL: https://cr-buildbucket.appspot.com/build/8721927691000044081
[21:23:14.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:2:0) after 5m32s
[21:23:15.142] Received PubSub notification, asking Buildbucket for the build status
[21:23:15.159] Build status: SCHEDULED
[21:24:51.996] Received PubSub notification, asking Buildbucket for the build status
[21:24:52.019] Build status: STARTED
[21:28:46.243] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:2:0)
[21:28:46.262] Build status: STARTED
[21:28:46.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:5:0) after 5m20s
[21:34:06.283] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:5:0)
[21:34:06.328] Build status: STARTED
[21:34:06.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:6:0) after 1m57s
[21:36:03.433] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:6:0)
[21:36:03.456] Build status: STARTED
[21:36:03.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:7:0) after 4m28s
[21:40:31.443] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:7:0)
[21:40:31.469] Build status: STARTED
[21:40:31.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:8:0) after 5m31s
[21:46:02.541] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:8:0)
[21:46:02.567] Build status: STARTED
[21:46:02.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:9:0) after 2m23s
[21:48:25.652] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:9:0)
[21:48:25.673] Build status: STARTED
[21:48:25.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:10:0) after 7m5s
[21:55:30.926] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:10:0)
[21:55:30.946] Build status: STARTED
[21:55:30.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:11:0) after 4m39s
[22:00:10.044] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:11:0)
[22:00:10.066] Build status: STARTED
[22:00:10.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:12:0) after 1m54s
[22:02:04.095] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:12:0)
[22:02:04.147] Build status: STARTED
[22:02:04.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:13:0) after 1m17s
[22:03:21.176] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:13:0)
[22:03:21.201] Build status: STARTED
[22:03:21.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:14:0) after 6m2s
[22:09:23.250] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:14:0)
[22:09:23.344] Build status: STARTED
[22:09:23.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:15:0) after 1m23s
[22:10:46.367] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:15:0)
[22:10:46.388] Build status: STARTED
[22:10:46.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:16:0) after 9m39s
[22:20:25.436] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:16:0)
[22:20:25.452] Build status: STARTED
[22:20:25.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:17:0) after 9m47s
[22:30:12.563] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:17:0)
[22:30:12.577] Build status: STARTED
[22:30:12.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:18:0) after 2m33s
[22:32:45.738] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:18:0)
[22:32:45.756] Build status: STARTED
[22:32:45.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:19:0) after 9m33s
[22:42:18.779] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:19:0)
[22:42:18.798] Build status: STARTED
[22:42:18.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:20:0) after 5m17s
[22:47:35.924] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:20:0)
[22:47:35.961] Build status: STARTED
[22:47:35.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:21:0) after 3m20s
[22:50:55.996] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:21:0)
[22:50:56.012] Build status: STARTED
[22:50:56.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:22:0) after 2m40s
[22:53:36.039] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:22:0)
[22:53:36.054] Build status: STARTED
[22:53:36.054] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:23:0) after 6m52s
[23:00:28.209] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:23:0)
[23:00:28.230] Build status: STARTED
[23:00:28.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:24:0) after 2m26s
[23:02:54.258] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:24:0)
[23:02:54.279] Build status: STARTED
[23:02:54.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:25:0) after 7m22s
[23:10:16.419] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:25:0)
[23:10:16.446] Build status: STARTED
[23:10:16.446] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:26:0) after 3m45s
[23:14:01.472] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:26:0)
[23:14:01.488] Build status: STARTED
[23:14:01.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:27:0) after 1m18s
[23:15:19.687] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:27:0)
[23:15:19.751] Build status: STARTED
[23:15:19.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:28:0) after 5m5s
[23:20:24.733] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:28:0)
[23:20:24.748] Build status: STARTED
[23:20:24.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:29:0) after 6m12s
[23:26:36.784] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:29:0)
[23:26:36.803] Build status: STARTED
[23:26:36.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:30:0) after 7m50s
[23:34:26.828] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:30:0)
[23:34:26.845] Build status: STARTED
[23:34:26.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:31:0) after 8m35s
[23:43:01.860] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:31:0)
[23:43:01.933] Build status: STARTED
[23:43:01.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:32:0) after 1m41s
[23:44:42.965] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:32:0)
[23:44:42.993] Build status: STARTED
[23:44:42.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:33:0) after 4m49s
[23:49:32.014] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:33:0)
[23:49:32.029] Build status: STARTED
[23:49:32.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:34:0) after 2m24s
[23:51:56.062] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:34:0)
[23:51:56.076] Build status: STARTED
[23:51:56.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:35:0) after 5m5s
[23:57:01.138] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:35:0)
[23:57:01.153] Build status: STARTED
[23:57:01.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:36:0) after 2m16s
[23:59:17.224] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:36:0)
[23:59:17.301] Build status: STARTED
[23:59:17.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:37:0) after 8m28s
[00:07:45.326] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:37:0)
[00:07:45.400] Build status: STARTED
[00:07:45.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:38:0) after 2m58s
[00:10:43.481] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:38:0)
[00:10:43.495] Build status: STARTED
[00:10:43.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:39:0) after 2m55s
[00:13:38.511] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:39:0)
[00:13:38.593] Build status: STARTED
[00:13:38.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:40:0) after 1m4s
[00:14:42.574] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:40:0)
[00:14:42.589] Build status: STARTED
[00:14:42.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:41:0) after 4m33s
[00:19:15.614] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:41:0)
[00:19:15.700] Build status: STARTED
[00:19:15.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:42:0) after 6m27s
[00:25:42.794] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:42:0)
[00:25:42.840] Build status: STARTED
[00:25:42.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:43:0) after 7m4s
[00:32:46.868] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:43:0)
[00:32:46.892] Build status: STARTED
[00:32:46.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:44:0) after 3m51s
[00:36:37.975] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:44:0)
[00:36:37.998] Build status: STARTED
[00:36:37.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:45:0) after 2m30s
[00:39:08.024] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:45:0)
[00:39:08.040] Build status: STARTED
[00:39:08.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:46:0) after 5m3s
[00:44:11.112] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:46:0)
[00:44:11.128] Build status: STARTED
[00:44:11.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:47:0) after 8m3s
[00:52:14.232] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:47:0)
[00:52:14.247] Build status: STARTED
[00:52:14.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:48:0) after 1m14s
[00:53:28.319] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:48:0)
[00:53:28.358] Build status: STARTED
[00:53:28.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:49:0) after 6m45s
[01:00:13.493] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:49:0)
[01:00:13.509] Build status: STARTED
[01:00:13.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:50:0) after 9m2s
[01:09:15.534] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:50:0)
[01:09:15.552] Build status: STARTED
[01:09:15.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:51:0) after 8m9s
[01:17:24.684] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:51:0)
[01:17:24.706] Build status: STARTED
[01:17:24.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:52:0) after 8m52s
[01:26:16.701] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:52:0)
[01:26:16.764] Build status: STARTED
[01:26:16.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:53:0) after 2m21s
[01:28:37.790] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:53:0)
[01:28:37.809] Build status: STARTED
[01:28:37.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:54:0) after 8m30s
[01:37:07.863] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:54:0)
[01:37:07.931] Build status: STARTED
[01:37:07.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:55:0) after 2m4s
[01:39:12.047] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:55:0)
[01:39:12.063] Build status: STARTED
[01:39:12.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:56:0) after 5m14s
[01:44:26.105] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:56:0)
[01:44:26.124] Build status: STARTED
[01:44:26.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:57:0) after 1m20s
[01:45:46.156] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:57:0)
[01:45:46.171] Build status: STARTED
[01:45:46.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:58:0) after 8m3s
[01:53:49.193] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:58:0)
[01:53:49.214] Build status: STARTED
[01:53:49.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:59:0) after 5m46s
[01:59:35.244] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:59:0)
[01:59:35.259] Build status: STARTED
[01:59:35.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:60:0) after 8m52s
[02:08:27.324] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:60:0)
[02:08:27.341] Build status: STARTED
[02:08:27.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:61:0) after 8m19s
[02:16:46.370] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:61:0)
[02:16:46.394] Build status: STARTED
[02:16:46.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:62:0) after 4m19s
[02:21:05.472] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:62:0)
[02:21:05.490] Build status: STARTED
[02:21:05.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:63:0) after 9m2s
[02:30:07.525] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:63:0)
[02:30:07.598] Build status: STARTED
[02:30:07.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:64:0) after 3m12s
[02:33:19.687] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:64:0)
[02:33:19.705] Build status: STARTED
[02:33:19.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:65:0) after 4m1s
[02:37:20.732] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:65:0)
[02:37:20.747] Build status: STARTED
[02:37:20.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:66:0) after 3m46s
[02:41:06.822] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:66:0)
[02:41:06.848] Build status: STARTED
[02:41:06.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:67:0) after 9m25s
[02:50:31.871] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:67:0)
[02:50:31.889] Build status: STARTED
[02:50:31.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:68:0) after 2m42s
[02:53:13.951] Handling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:68:0)
[02:53:13.966] Build status: STARTED
[02:53:13.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinux:8887357752895729904:69:0) after 5m22s
[02:56:14.549] Received PubSub notification, asking Buildbucket for the build status
[02:56:14.619] Build:
{
"id": "8721927691000044081",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinux"
},
"number": 29003,
"createdBy": "project:chromium",
"createTime": "2025-02-25T21:23:13.748180672Z",
"startTime": "2025-02-25T21:24:51.652656439Z",
"endTime": "2025-02-26T02:56:14.211145662Z",
"updateTime": "2025-02-26T02:56:14.211145662Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "89ee37cc0481ef1c54bd2ce40d0010a899516405",
"ref": "refs/heads/main"
}
}
}
[02:56:14.619] Invocation finished in 5h33m2.062229068s with status FAILED