[11:31:50.722] New invocation is queued and will start shortly
[11:31:51.807] Starting the invocation (attempt 1)
[11:31:51.836] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f7b616019d0e8649951bfba385ff0462ed28ba48"
[11:31:51.836] Popped gitiles commit info from properties and tags
[11:31:51.836] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[11:31:51.836] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[11:31:51.836] Buildbucket request:
{
"requestId": "8851880947472626192",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f7b616019d0e8649951bfba385ff0462ed28ba48",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851880947472626192"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[11:31:52.311] Scheduled build:
{
"id": "8686450885606314177",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 40035,
"createdBy": "project:chromium",
"createTime": "2026-03-24T11:31:51.880676136Z",
"updateTime": "2026-03-24T11:31:51.880676136Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f7b616019d0e8649951bfba385ff0462ed28ba48",
"ref": "refs/heads/main"
}
}
}
[11:31:52.311] Task URL: https://cr-buildbucket.appspot.com/build/8686450885606314177
[11:31:52.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:2:0) after 8m44s
[11:32:02.939] Received PubSub notification, asking Buildbucket for the build status
[11:32:02.967] Build status: SCHEDULED
[11:32:25.833] Received PubSub notification, asking Buildbucket for the build status
[11:32:25.849] Build status: STARTED
[11:40:36.329] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:2:0)
[11:40:36.355] Build status: STARTED
[11:40:36.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:5:0) after 9m49s
[11:50:25.372] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:5:0)
[11:50:25.390] Build status: STARTED
[11:50:25.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:6:0) after 6m40s
[11:57:05.457] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:6:0)
[11:57:05.477] Build status: STARTED
[11:57:05.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:7:0) after 8m13s
[12:05:18.546] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:7:0)
[12:05:18.569] Build status: STARTED
[12:05:18.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:8:0) after 5m19s
[12:10:37.690] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:8:0)
[12:10:37.705] Build status: STARTED
[12:10:37.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:9:0) after 1m1s
[12:11:38.884] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:9:0)
[12:11:38.974] Build status: STARTED
[12:11:38.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:10:0) after 6m43s
[12:18:21.993] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:10:0)
[12:18:22.018] Build status: STARTED
[12:18:22.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:11:0) after 9m7s
[12:27:29.042] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:11:0)
[12:27:29.111] Build status: STARTED
[12:27:29.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:12:0) after 8m36s
[12:36:05.330] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:12:0)
[12:36:05.347] Build status: STARTED
[12:36:05.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:13:0) after 5m45s
[12:41:50.362] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:13:0)
[12:41:50.376] Build status: STARTED
[12:41:50.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:14:0) after 9m36s
[12:51:26.392] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:14:0)
[12:51:26.544] Build status: STARTED
[12:51:26.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:15:0) after 5m47s
[12:57:13.613] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:15:0)
[12:57:13.631] Build status: STARTED
[12:57:13.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:16:0) after 8m52s
[13:06:05.652] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:16:0)
[13:06:05.672] Build status: STARTED
[13:06:05.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:17:0) after 6m16s
[13:12:21.672] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:17:0)
[13:12:21.691] Build status: STARTED
[13:12:21.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:18:0) after 6m6s
[13:18:27.724] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:18:0)
[13:18:27.743] Build status: STARTED
[13:18:27.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:19:0) after 3m29s
[13:21:56.906] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:19:0)
[13:21:56.946] Build status: STARTED
[13:21:56.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:20:0) after 1m27s
[13:23:24.024] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:20:0)
[13:23:24.055] Build status: STARTED
[13:23:24.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:21:0) after 6m40s
[13:30:04.181] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:21:0)
[13:30:04.231] Build status: STARTED
[13:30:04.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:22:0) after 6m1s
[13:36:05.227] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:22:0)
[13:36:05.243] Build status: STARTED
[13:36:05.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:23:0) after 4m38s
[13:40:43.266] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:23:0)
[13:40:43.322] Build status: STARTED
[13:40:43.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:24:0) after 6m25s
[13:47:08.347] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:24:0)
[13:47:08.366] Build status: STARTED
[13:47:08.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:25:0) after 4m1s
[13:51:09.422] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:25:0)
[13:51:09.452] Build status: STARTED
[13:51:09.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:26:0) after 1m9s
[13:52:18.564] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:26:0)
[13:52:18.583] Build status: STARTED
[13:52:18.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:27:0) after 2m54s
[13:55:12.601] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:27:0)
[13:55:12.615] Build status: STARTED
[13:55:12.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:28:0) after 6m24s
[14:01:36.690] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:28:0)
[14:01:36.707] Build status: STARTED
[14:01:36.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:29:0) after 3m41s
[14:05:17.731] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:29:0)
[14:05:17.750] Build status: STARTED
[14:05:17.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:30:0) after 5m24s
[14:10:41.820] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:30:0)
[14:10:41.842] Build status: STARTED
[14:10:41.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:31:0) after 7m38s
[14:18:19.859] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:31:0)
[14:18:19.881] Build status: STARTED
[14:18:19.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:32:0) after 8m55s
[14:27:14.905] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:32:0)
[14:27:14.925] Build status: STARTED
[14:27:14.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:33:0) after 8m41s
[14:35:55.993] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:33:0)
[14:35:56.009] Build status: STARTED
[14:35:56.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:34:0) after 7m3s
[14:42:59.048] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:34:0)
[14:42:59.071] Build status: STARTED
[14:42:59.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:35:0) after 1m21s
[14:44:20.067] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:35:0)
[14:44:20.093] Build status: STARTED
[14:44:20.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:36:0) after 7m4s
[14:51:24.132] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:36:0)
[14:51:24.150] Build status: STARTED
[14:51:24.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:37:0) after 2m40s
[14:54:04.196] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:37:0)
[14:54:04.231] Build status: STARTED
[14:54:04.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:38:0) after 8m57s
[15:03:01.260] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:38:0)
[15:03:01.277] Build status: STARTED
[15:03:01.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:39:0) after 2m3s
[15:05:04.300] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:39:0)
[15:05:04.322] Build status: STARTED
[15:05:04.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:40:0) after 7m24s
[15:12:28.357] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:40:0)
[15:12:28.380] Build status: STARTED
[15:12:28.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:41:0) after 5m33s
[15:18:01.407] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:41:0)
[15:18:01.429] Build status: STARTED
[15:18:01.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:42:0) after 9m59s
[15:28:00.502] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:42:0)
[15:28:00.526] Build status: STARTED
[15:28:00.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:43:0) after 8m29s
[15:36:29.631] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:43:0)
[15:36:29.652] Build status: STARTED
[15:36:29.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:44:0) after 3m29s
[15:39:58.713] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:44:0)
[15:39:58.728] Build status: STARTED
[15:39:58.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:45:0) after 7m14s
[15:47:12.775] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:45:0)
[15:47:12.798] Build status: STARTED
[15:47:12.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:46:0) after 2m47s
[15:49:59.816] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:46:0)
[15:49:59.833] Build status: STARTED
[15:49:59.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:47:0) after 8m29s
[15:58:28.938] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:47:0)
[15:58:28.961] Build status: STARTED
[15:58:28.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:48:0) after 3m42s
[16:02:10.981] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:48:0)
[16:02:11.019] Build status: STARTED
[16:02:11.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:49:0) after 7m45s
[16:09:56.051] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:49:0)
[16:09:56.072] Build status: STARTED
[16:09:56.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:50:0) after 8m36s
[16:18:32.107] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:50:0)
[16:18:32.130] Build status: STARTED
[16:18:32.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:51:0) after 1m42s
[16:20:14.242] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:51:0)
[16:20:14.256] Build status: STARTED
[16:20:14.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:52:0) after 9m19s
[16:29:33.276] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:52:0)
[16:29:33.336] Build status: STARTED
[16:29:33.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:53:0) after 6m5s
[16:35:38.419] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:53:0)
[16:35:38.439] Build status: STARTED
[16:35:38.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:54:0) after 3m17s
[16:38:55.455] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:54:0)
[16:38:55.475] Build status: STARTED
[16:38:55.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:55:0) after 5m51s
[16:44:46.567] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:55:0)
[16:44:46.584] Build status: STARTED
[16:44:46.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:56:0) after 5m56s
[16:50:42.600] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:56:0)
[16:50:42.654] Build status: STARTED
[16:50:42.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:57:0) after 7m2s
[16:57:44.722] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:57:0)
[16:57:44.752] Build status: STARTED
[16:57:44.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:58:0) after 1m47s
[16:59:31.801] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:58:0)
[16:59:31.819] Build status: STARTED
[16:59:31.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:59:0) after 2m27s
[17:01:58.838] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:59:0)
[17:01:58.858] Build status: STARTED
[17:01:58.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:60:0) after 8m39s
[17:10:37.978] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:60:0)
[17:10:37.993] Build status: STARTED
[17:10:37.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:61:0) after 7m24s
[17:18:02.052] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:61:0)
[17:18:02.090] Build status: STARTED
[17:18:02.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:62:0) after 8m51s
[17:26:53.260] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:62:0)
[17:26:53.280] Build status: STARTED
[17:26:53.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:63:0) after 1m23s
[17:28:16.352] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:63:0)
[17:28:16.368] Build status: STARTED
[17:28:16.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8851880947472626192:64:0) after 2m26s
[17:29:01.131] Received PubSub notification, asking Buildbucket for the build status
[17:29:01.168] Build:
{
"id": "8686450885606314177",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 40035,
"createdBy": "project:chromium",
"createTime": "2026-03-24T11:31:51.880676136Z",
"startTime": "2026-03-24T11:32:16.927422850Z",
"endTime": "2026-03-24T17:29:00.771830513Z",
"updateTime": "2026-03-24T17:29:00.771830513Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f7b616019d0e8649951bfba385ff0462ed28ba48",
"ref": "refs/heads/main"
}
}
}
[17:29:01.168] Invocation finished in 5h57m10.450741643s with status FAILED