[09:26:27.969] New invocation is queued and will start shortly
[09:26:30.318] Starting the invocation (attempt 1)
[09:26:30.344] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c6591ec766b1299763eb213d87916a96cbe526f4"
[09:26:30.345] Popped gitiles commit info from properties and tags
[09:26:30.345] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[09:26:30.345] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[09:26:30.345] Buildbucket request:
{
"requestId": "8833497651471987888",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c6591ec766b1299763eb213d87916a96cbe526f4",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8833497651471987888"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[09:26:30.927] Scheduled build:
{
"id": "8668067588240086865",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 43419,
"createdBy": "project:chromium",
"createTime": "2026-10-13T09:26:30.429574309Z",
"updateTime": "2026-10-13T09:26:30.429574309Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c6591ec766b1299763eb213d87916a96cbe526f4",
"ref": "refs/heads/main"
}
}
}
[09:26:30.927] Task URL: https://cr-buildbucket.appspot.com/build/8668067588240086865
[09:26:30.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:2:0) after 8m3s
[09:26:31.841] Received PubSub notification, asking Buildbucket for the build status
[09:26:31.858] Build status: SCHEDULED
[09:27:08.806] Received PubSub notification, asking Buildbucket for the build status
[09:27:08.840] Build status: STARTED
[09:34:33.999] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:2:0)
[09:34:34.069] Build status: STARTED
[09:34:34.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:5:0) after 1m50s
[09:36:24.146] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:5:0)
[09:36:24.166] Build status: STARTED
[09:36:24.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:6:0) after 1m30s
[09:37:54.236] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:6:0)
[09:37:54.258] Build status: STARTED
[09:37:54.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:7:0) after 6m59s
[09:44:53.311] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:7:0)
[09:44:53.329] Build status: STARTED
[09:44:53.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:8:0) after 2m27s
[09:47:20.353] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:8:0)
[09:47:20.373] Build status: STARTED
[09:47:20.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:9:0) after 4m23s
[09:51:43.391] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:9:0)
[09:51:43.410] Build status: STARTED
[09:51:43.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:10:0) after 5m57s
[09:57:40.429] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:10:0)
[09:57:40.451] Build status: STARTED
[09:57:40.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:11:0) after 8m46s
[10:06:26.528] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:11:0)
[10:06:26.572] Build status: STARTED
[10:06:26.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:12:0) after 6m55s
[10:13:21.628] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:12:0)
[10:13:21.648] Build status: STARTED
[10:13:21.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:13:0) after 7m26s
[10:20:47.667] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:13:0)
[10:20:47.694] Build status: STARTED
[10:20:47.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:14:0) after 6m43s
[10:27:30.719] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:14:0)
[10:27:30.748] Build status: STARTED
[10:27:30.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:15:0) after 7m35s
[10:35:05.896] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:15:0)
[10:35:05.917] Build status: STARTED
[10:35:05.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:16:0) after 6m55s
[10:42:00.955] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:16:0)
[10:42:00.980] Build status: STARTED
[10:42:00.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:17:0) after 7m48s
[10:49:48.999] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:17:0)
[10:49:49.049] Build status: STARTED
[10:49:49.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:18:0) after 6m36s
[10:56:25.066] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:18:0)
[10:56:25.090] Build status: STARTED
[10:56:25.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:19:0) after 7m1s
[11:03:26.117] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:19:0)
[11:03:26.134] Build status: STARTED
[11:03:26.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:20:0) after 7m17s
[11:10:43.270] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:20:0)
[11:10:43.290] Build status: STARTED
[11:10:43.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:21:0) after 4m1s
[11:14:44.323] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:21:0)
[11:14:44.441] Build status: STARTED
[11:14:44.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:22:0) after 7m44s
[11:22:28.463] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:22:0)
[11:22:28.505] Build status: STARTED
[11:22:28.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:23:0) after 1m19s
[11:23:47.522] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:23:0)
[11:23:47.629] Build status: STARTED
[11:23:47.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:24:0) after 4m4s
[11:27:51.662] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:24:0)
[11:27:51.701] Build status: STARTED
[11:27:51.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:25:0) after 3m41s
[11:31:32.878] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:25:0)
[11:31:32.896] Build status: STARTED
[11:31:32.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:26:0) after 4m36s
[11:36:08.933] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:26:0)
[11:36:08.991] Build status: STARTED
[11:36:08.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:27:0) after 1m25s
[11:37:34.109] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:27:0)
[11:37:34.132] Build status: STARTED
[11:37:34.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:28:0) after 3m17s
[11:40:51.202] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:28:0)
[11:40:51.226] Build status: STARTED
[11:40:51.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:29:0) after 4m12s
[11:45:03.211] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:29:0)
[11:45:03.234] Build status: STARTED
[11:45:03.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:30:0) after 3m24s
[11:48:27.253] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:30:0)
[11:48:27.273] Build status: STARTED
[11:48:27.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:31:0) after 8m35s
[11:57:02.292] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:31:0)
[11:57:02.312] Build status: STARTED
[11:57:02.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:32:0) after 7m50s
[12:04:52.331] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:32:0)
[12:04:52.350] Build status: STARTED
[12:04:52.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:33:0) after 6m35s
[12:11:27.490] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:33:0)
[12:11:27.517] Build status: STARTED
[12:11:27.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:34:0) after 4m19s
[12:15:46.605] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:34:0)
[12:15:46.622] Build status: STARTED
[12:15:46.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:35:0) after 7m22s
[12:23:08.786] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:35:0)
[12:23:08.832] Build status: STARTED
[12:23:08.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:36:0) after 5m38s
[12:28:46.854] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:36:0)
[12:28:46.876] Build status: STARTED
[12:28:46.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:37:0) after 4m5s
[12:32:51.928] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:37:0)
[12:32:51.967] Build status: STARTED
[12:32:51.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:38:0) after 3m14s
[12:36:05.955] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:38:0)
[12:36:05.977] Build status: STARTED
[12:36:05.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:39:0) after 1m51s
[12:37:56.954] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:39:0)
[12:37:57.041] Build status: STARTED
[12:37:57.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:40:0) after 6m22s
[12:44:19.074] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:40:0)
[12:44:19.091] Build status: STARTED
[12:44:19.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:41:0) after 5m5s
[12:49:24.110] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:41:0)
[12:49:24.147] Build status: STARTED
[12:49:24.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:42:0) after 6m49s
[12:56:13.249] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:42:0)
[12:56:13.271] Build status: STARTED
[12:56:13.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:43:0) after 5m51s
[13:02:04.306] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:43:0)
[13:02:04.331] Build status: STARTED
[13:02:04.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:44:0) after 4m47s
[13:06:51.404] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:44:0)
[13:06:51.424] Build status: STARTED
[13:06:51.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:45:0) after 2m16s
[13:09:07.448] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:45:0)
[13:09:07.472] Build status: STARTED
[13:09:07.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:46:0) after 2m6s
[13:11:13.495] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:46:0)
[13:11:13.513] Build status: STARTED
[13:11:13.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:47:0) after 4m25s
[13:15:38.535] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:47:0)
[13:15:38.558] Build status: STARTED
[13:15:38.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:48:0) after 5m49s
[13:21:27.740] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:48:0)
[13:21:27.767] Build status: STARTED
[13:21:27.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:49:0) after 8m5s
[13:29:32.789] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:49:0)
[13:29:32.849] Build status: STARTED
[13:29:32.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:50:0) after 6m41s
[13:36:13.863] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:50:0)
[13:36:13.942] Build status: STARTED
[13:36:13.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:51:0) after 8m10s
[13:44:23.994] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:51:0)
[13:44:24.016] Build status: STARTED
[13:44:24.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:52:0) after 6m56s
[13:51:20.001] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:52:0)
[13:51:20.083] Build status: STARTED
[13:51:20.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:53:0) after 2m51s
[13:54:11.106] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:53:0)
[13:54:11.123] Build status: STARTED
[13:54:11.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:54:0) after 9m42s
[14:03:53.145] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:54:0)
[14:03:53.187] Build status: STARTED
[14:03:53.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:55:0) after 8m30s
[14:12:23.209] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:55:0)
[14:12:23.234] Build status: STARTED
[14:12:23.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:56:0) after 9m26s
[14:21:49.274] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:56:0)
[14:21:49.310] Build status: STARTED
[14:21:49.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:57:0) after 3m28s
[14:25:17.488] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:57:0)
[14:25:17.525] Build status: STARTED
[14:25:17.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:58:0) after 7m23s
[14:32:40.559] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:58:0)
[14:32:40.634] Build status: STARTED
[14:32:40.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8833497651471987888:59:0) after 5m5s
[14:34:24.136] Received PubSub notification, asking Buildbucket for the build status
[14:34:24.158] Build:
{
"id": "8668067588240086865",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 43419,
"createdBy": "project:chromium",
"createTime": "2026-10-13T09:26:30.429574309Z",
"startTime": "2026-10-13T09:27:07.982865279Z",
"endTime": "2026-10-13T14:34:23.808005477Z",
"updateTime": "2026-10-13T14:34:23.808005477Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c6591ec766b1299763eb213d87916a96cbe526f4",
"ref": "refs/heads/main"
}
}
}
[14:34:24.159] Invocation finished in 5h7m56.194361827s with status FAILED