[18:43:29.033] New invocation is queued and will start shortly
[18:43:30.158] Starting the invocation (attempt 1)
[18:43:30.188] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e884e9f0405843e35a70ce62dc5b9bb5fb33bec8"
[18:43:30.188] Popped gitiles commit info from properties and tags
[18:43:30.188] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:43:30.189] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:43:30.189] Buildbucket request:
{
"requestId": "8848773494268281920",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e884e9f0405843e35a70ce62dc5b9bb5fb33bec8",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8848773494268281920"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:43:30.739] Scheduled build:
{
"id": "8683343432323539473",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 40514,
"createdBy": "project:chromium",
"createTime": "2026-04-27T18:43:30.266821737Z",
"updateTime": "2026-04-27T18:43:30.266821737Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e884e9f0405843e35a70ce62dc5b9bb5fb33bec8",
"ref": "refs/heads/main"
}
}
}
[18:43:30.739] Task URL: https://cr-buildbucket.appspot.com/build/8683343432323539473
[18:43:30.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:2:0) after 7m20s
[18:43:31.717] Received PubSub notification, asking Buildbucket for the build status
[18:43:31.733] Build status: SCHEDULED
[18:44:21.485] Received PubSub notification, asking Buildbucket for the build status
[18:44:21.583] Build status: STARTED
[18:50:50.761] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:2:0)
[18:50:50.778] Build status: STARTED
[18:50:50.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:5:0) after 5m16s
[18:56:06.803] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:5:0)
[18:56:06.839] Build status: STARTED
[18:56:06.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:6:0) after 8m54s
[19:05:00.946] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:6:0)
[19:05:00.964] Build status: STARTED
[19:05:00.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:7:0) after 5m39s
[19:10:40.233] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:7:0)
[19:10:40.250] Build status: STARTED
[19:10:40.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:8:0) after 7m33s
[19:18:13.271] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:8:0)
[19:18:13.289] Build status: STARTED
[19:18:13.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:9:0) after 8m57s
[19:27:10.353] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:9:0)
[19:27:10.370] Build status: STARTED
[19:27:10.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:10:0) after 4m46s
[19:31:56.381] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:10:0)
[19:31:56.491] Build status: STARTED
[19:31:56.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:11:0) after 9m40s
[19:41:36.597] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:11:0)
[19:41:36.614] Build status: STARTED
[19:41:36.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:12:0) after 7m20s
[19:48:56.643] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:12:0)
[19:48:56.660] Build status: STARTED
[19:48:56.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:13:0) after 6m25s
[19:55:21.679] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:13:0)
[19:55:21.703] Build status: STARTED
[19:55:21.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:14:0) after 2m55s
[19:58:16.696] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:14:0)
[19:58:16.732] Build status: STARTED
[19:58:16.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:15:0) after 1m31s
[19:59:47.759] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:15:0)
[19:59:47.823] Build status: STARTED
[19:59:47.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:16:0) after 3m8s
[20:02:55.842] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:16:0)
[20:02:55.857] Build status: STARTED
[20:02:55.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:17:0) after 1m18s
[20:04:14.027] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:17:0)
[20:04:14.045] Build status: STARTED
[20:04:14.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:18:0) after 5m56s
[20:10:10.112] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:18:0)
[20:10:10.136] Build status: STARTED
[20:10:10.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:19:0) after 3m54s
[20:14:04.155] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:19:0)
[20:14:04.198] Build status: STARTED
[20:14:04.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:20:0) after 2m58s
[20:17:02.236] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:20:0)
[20:17:02.271] Build status: STARTED
[20:17:02.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:21:0) after 2m0s
[20:19:02.424] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:21:0)
[20:19:02.472] Build status: STARTED
[20:19:02.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:22:0) after 7m23s
[20:26:25.447] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:22:0)
[20:26:25.543] Build status: STARTED
[20:26:25.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:23:0) after 7m14s
[20:33:39.561] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:23:0)
[20:33:39.609] Build status: STARTED
[20:33:39.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:24:0) after 5m57s
[20:39:36.631] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:24:0)
[20:39:36.648] Build status: STARTED
[20:39:36.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:25:0) after 5m39s
[20:45:15.870] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:25:0)
[20:45:15.886] Build status: STARTED
[20:45:15.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:26:0) after 2m24s
[20:47:39.906] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:26:0)
[20:47:39.921] Build status: STARTED
[20:47:39.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:27:0) after 4m48s
[20:52:27.942] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:27:0)
[20:52:27.980] Build status: STARTED
[20:52:27.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:28:0) after 1m51s
[20:54:19.001] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:28:0)
[20:54:19.018] Build status: STARTED
[20:54:19.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:29:0) after 9m43s
[21:04:02.046] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:29:0)
[21:04:02.068] Build status: STARTED
[21:04:02.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:30:0) after 6m3s
[21:10:05.111] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:30:0)
[21:10:05.134] Build status: STARTED
[21:10:05.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:31:0) after 1m7s
[21:11:12.213] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:31:0)
[21:11:12.231] Build status: STARTED
[21:11:12.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:32:0) after 3m59s
[21:15:11.491] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:32:0)
[21:15:11.508] Build status: STARTED
[21:15:11.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:33:0) after 9m28s
[21:24:39.635] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:33:0)
[21:24:39.650] Build status: STARTED
[21:24:39.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:34:0) after 3m36s
[21:28:15.728] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:34:0)
[21:28:15.752] Build status: STARTED
[21:28:15.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:35:0) after 6m13s
[21:34:28.789] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:35:0)
[21:34:28.882] Build status: STARTED
[21:34:28.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:36:0) after 8m6s
[21:42:34.853] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:36:0)
[21:42:34.898] Build status: STARTED
[21:42:34.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:37:0) after 7m16s
[21:49:51.021] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:37:0)
[21:49:51.068] Build status: STARTED
[21:49:51.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:38:0) after 3m42s
[21:53:33.114] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:38:0)
[21:53:33.133] Build status: STARTED
[21:53:33.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:39:0) after 2m29s
[21:56:02.201] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:39:0)
[21:56:02.220] Build status: STARTED
[21:56:02.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:40:0) after 5m5s
[22:01:07.263] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:40:0)
[22:01:07.287] Build status: STARTED
[22:01:07.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:41:0) after 1m59s
[22:03:06.399] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:41:0)
[22:03:06.454] Build status: STARTED
[22:03:06.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:42:0) after 3m27s
[22:06:33.447] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:42:0)
[22:06:33.466] Build status: STARTED
[22:06:33.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:43:0) after 4m11s
[22:10:44.512] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:43:0)
[22:10:44.529] Build status: STARTED
[22:10:44.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:44:0) after 6m50s
[22:17:34.547] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:44:0)
[22:17:34.560] Build status: STARTED
[22:17:34.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:45:0) after 8m35s
[22:26:09.584] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:45:0)
[22:26:09.642] Build status: STARTED
[22:26:09.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:46:0) after 5m27s
[22:31:36.661] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:46:0)
[22:31:36.678] Build status: STARTED
[22:31:36.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:47:0) after 7m25s
[22:39:01.750] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:47:0)
[22:39:01.854] Build status: STARTED
[22:39:01.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:48:0) after 3m12s
[22:42:13.875] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:48:0)
[22:42:13.892] Build status: STARTED
[22:42:13.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:49:0) after 8m25s
[22:50:38.963] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:49:0)
[22:50:38.975] Build status: STARTED
[22:50:38.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:50:0) after 9m9s
[22:59:48.264] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:50:0)
[22:59:48.281] Build status: STARTED
[22:59:48.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:51:0) after 8m14s
[23:08:02.284] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:51:0)
[23:08:02.350] Build status: STARTED
[23:08:02.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:52:0) after 6m30s
[23:14:32.418] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:52:0)
[23:14:32.460] Build status: STARTED
[23:14:32.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:53:0) after 7m58s
[23:22:30.528] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:53:0)
[23:22:30.543] Build status: STARTED
[23:22:30.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:54:0) after 3m13s
[23:25:43.562] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:54:0)
[23:25:43.580] Build status: STARTED
[23:25:43.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:55:0) after 4m19s
[23:30:02.600] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:55:0)
[23:30:04.479] Build status: STARTED
[23:30:04.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:56:0) after 7m31s
[23:37:35.472] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:56:0)
[23:37:35.488] Build status: STARTED
[23:37:35.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:57:0) after 2m33s
[23:40:08.591] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:57:0)
[23:40:08.607] Build status: STARTED
[23:40:08.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:58:0) after 3m13s
[23:43:21.822] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:58:0)
[23:43:21.838] Build status: STARTED
[23:43:21.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:59:0) after 7m12s
[23:50:33.862] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:59:0)
[23:50:33.878] Build status: STARTED
[23:50:33.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:60:0) after 9m49s
[00:00:22.895] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:60:0)
[00:00:22.926] Build status: STARTED
[00:00:22.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:61:0) after 4m46s
[00:05:08.898] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:61:0)
[00:05:08.931] Build status: STARTED
[00:05:08.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:62:0) after 8m25s
[00:13:33.972] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:62:0)
[00:13:33.990] Build status: STARTED
[00:13:33.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:63:0) after 7m42s
[00:21:15.983] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:63:0)
[00:21:15.998] Build status: STARTED
[00:21:15.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848773494268281920:64:0) after 9m49s
[00:22:01.429] Received PubSub notification, asking Buildbucket for the build status
[00:22:01.447] Build:
{
"id": "8683343432323539473",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 40514,
"createdBy": "project:chromium",
"createTime": "2026-04-27T18:43:30.266821737Z",
"startTime": "2026-04-27T18:44:19.040091978Z",
"endTime": "2026-04-28T00:22:01.195264062Z",
"updateTime": "2026-04-28T00:22:01.195264062Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e884e9f0405843e35a70ce62dc5b9bb5fb33bec8",
"ref": "refs/heads/main"
}
}
}
[00:22:01.447] Invocation finished in 5h38m32.419166506s with status FAILED