[21:54:02.622] New invocation is queued and will start shortly
[21:54:03.821] Starting the invocation (attempt 1)
[21:54:03.847] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/7d93b811a8fb2376a1f74e12852772d0aca129f8"
[21:54:03.847] Popped gitiles commit info from properties and tags
[21:54:03.847] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:54:03.847] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:54:03.847] Buildbucket request:
{
"requestId": "8853019562700189040",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7d93b811a8fb2376a1f74e12852772d0aca129f8",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8853019562700189040"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:54:04.301] Scheduled build:
{
"id": "8687589500707273873",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 39840,
"createdBy": "project:chromium",
"createTime": "2026-03-11T21:54:03.902866845Z",
"updateTime": "2026-03-11T21:54:03.902866845Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7d93b811a8fb2376a1f74e12852772d0aca129f8",
"ref": "refs/heads/main"
}
},
"canary": true
}
[21:54:04.301] Task URL: https://cr-buildbucket.appspot.com/build/8687589500707273873
[21:54:04.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:2:0) after 4m8s
[21:54:05.306] Received PubSub notification, asking Buildbucket for the build status
[21:54:05.332] Build status: SCHEDULED
[21:54:07.531] Received PubSub notification, asking Buildbucket for the build status
[21:54:07.559] Build status: STARTED
[21:58:12.447] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:2:0)
[21:58:12.463] Build status: STARTED
[21:58:12.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:5:0) after 9m4s
[22:07:16.484] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:5:0)
[22:07:16.516] Build status: STARTED
[22:07:16.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:6:0) after 5m17s
[22:12:33.635] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:6:0)
[22:12:33.685] Build status: STARTED
[22:12:33.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:7:0) after 9m59s
[22:22:32.711] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:7:0)
[22:22:32.738] Build status: STARTED
[22:22:32.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:8:0) after 8m33s
[22:31:05.759] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:8:0)
[22:31:05.775] Build status: STARTED
[22:31:05.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:9:0) after 7m35s
[22:38:40.866] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:9:0)
[22:38:40.881] Build status: STARTED
[22:38:40.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:10:0) after 7m15s
[22:45:56.043] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:10:0)
[22:45:56.075] Build status: STARTED
[22:45:56.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:11:0) after 4m0s
[22:49:56.097] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:11:0)
[22:49:56.112] Build status: STARTED
[22:49:56.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:12:0) after 1m38s
[22:51:34.258] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:12:0)
[22:51:34.274] Build status: STARTED
[22:51:34.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:13:0) after 3m28s
[22:55:02.302] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:13:0)
[22:55:02.347] Build status: STARTED
[22:55:02.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:14:0) after 9m45s
[23:04:47.499] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:14:0)
[23:04:47.532] Build status: STARTED
[23:04:47.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:15:0) after 8m2s
[23:12:49.602] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:15:0)
[23:12:49.692] Build status: STARTED
[23:12:49.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:16:0) after 1m18s
[23:14:07.910] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:16:0)
[23:14:07.923] Build status: STARTED
[23:14:07.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:17:0) after 3m7s
[23:17:15.001] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:17:0)
[23:17:15.029] Build status: STARTED
[23:17:15.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:18:0) after 1m1s
[23:18:16.101] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:18:0)
[23:18:16.142] Build status: STARTED
[23:18:16.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:19:0) after 1m4s
[23:19:20.178] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:19:0)
[23:19:20.197] Build status: STARTED
[23:19:20.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:20:0) after 9m48s
[23:29:08.221] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:20:0)
[23:29:08.238] Build status: STARTED
[23:29:08.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:21:0) after 8m51s
[23:37:59.270] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:21:0)
[23:37:59.289] Build status: STARTED
[23:37:59.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:22:0) after 8m53s
[23:46:52.352] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:22:0)
[23:46:52.379] Build status: STARTED
[23:46:52.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:23:0) after 3m18s
[23:50:10.497] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:23:0)
[23:50:10.516] Build status: STARTED
[23:50:10.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:24:0) after 4m28s
[23:54:38.711] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:24:0)
[23:54:38.728] Build status: STARTED
[23:54:38.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:25:0) after 5m26s
[00:00:04.761] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:25:0)
[00:00:04.790] Build status: STARTED
[00:00:04.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:26:0) after 9m34s
[00:09:38.974] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:26:0)
[00:09:39.053] Build status: STARTED
[00:09:39.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:27:0) after 5m18s
[00:14:57.167] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:27:0)
[00:14:57.181] Build status: STARTED
[00:14:57.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:28:0) after 2m12s
[00:17:09.392] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:28:0)
[00:17:09.408] Build status: STARTED
[00:17:09.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:29:0) after 8m38s
[00:25:47.507] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:29:0)
[00:25:47.527] Build status: STARTED
[00:25:47.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:30:0) after 2m25s
[00:28:12.557] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:30:0)
[00:28:12.574] Build status: STARTED
[00:28:12.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:31:0) after 4m11s
[00:32:23.648] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:31:0)
[00:32:23.671] Build status: STARTED
[00:32:23.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:32:0) after 8m20s
[00:40:43.754] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:32:0)
[00:40:43.788] Build status: STARTED
[00:40:43.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:33:0) after 8m13s
[00:48:56.878] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:33:0)
[00:48:56.898] Build status: STARTED
[00:48:56.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:34:0) after 4m49s
[00:53:45.985] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:34:0)
[00:53:46.010] Build status: STARTED
[00:53:46.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:35:0) after 6m46s
[01:00:32.107] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:35:0)
[01:00:32.126] Build status: STARTED
[01:00:32.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:36:0) after 6m43s
[01:07:15.159] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:36:0)
[01:07:15.228] Build status: STARTED
[01:07:15.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:37:0) after 2m2s
[01:09:17.295] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:37:0)
[01:09:17.319] Build status: STARTED
[01:09:17.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:38:0) after 6m43s
[01:16:00.355] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:38:0)
[01:16:02.199] Build status: STARTED
[01:16:02.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:39:0) after 6m4s
[01:22:06.274] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:39:0)
[01:22:06.352] Build status: STARTED
[01:22:06.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:40:0) after 1m45s
[01:23:51.448] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:40:0)
[01:23:51.522] Build status: STARTED
[01:23:51.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:41:0) after 7m38s
[01:31:29.573] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:41:0)
[01:31:29.594] Build status: STARTED
[01:31:29.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:42:0) after 7m19s
[01:38:48.609] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:42:0)
[01:38:48.665] Build status: STARTED
[01:38:48.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:43:0) after 2m23s
[01:41:11.738] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:43:0)
[01:41:11.758] Build status: STARTED
[01:41:11.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:44:0) after 2m58s
[01:44:09.929] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:44:0)
[01:44:09.951] Build status: STARTED
[01:44:09.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:45:0) after 9m33s
[01:53:42.994] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:45:0)
[01:53:43.010] Build status: STARTED
[01:53:43.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:46:0) after 1m14s
[01:54:57.077] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:46:0)
[01:54:57.095] Build status: STARTED
[01:54:57.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:47:0) after 4m53s
[01:59:50.166] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:47:0)
[01:59:50.213] Build status: STARTED
[01:59:50.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:48:0) after 8m34s
[02:08:24.239] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:48:0)
[02:08:24.262] Build status: STARTED
[02:08:24.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:49:0) after 4m54s
[02:13:18.288] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:49:0)
[02:13:18.304] Build status: STARTED
[02:13:18.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:50:0) after 8m20s
[02:21:38.331] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:50:0)
[02:21:38.353] Build status: STARTED
[02:21:38.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:51:0) after 7m15s
[02:28:53.428] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:51:0)
[02:28:53.668] Build status: STARTED
[02:28:53.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:52:0) after 7m7s
[02:36:00.808] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:52:0)
[02:36:00.824] Build status: STARTED
[02:36:00.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:53:0) after 2m26s
[02:38:26.908] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:53:0)
[02:38:26.956] Build status: STARTED
[02:38:26.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8853019562700189040:54:0) after 3m9s
[02:39:54.197] Received PubSub notification, asking Buildbucket for the build status
[02:39:54.219] Build:
{
"id": "8687589500707273873",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 39840,
"createdBy": "project:chromium",
"createTime": "2026-03-11T21:54:03.902866845Z",
"startTime": "2026-03-11T21:54:07.360558075Z",
"endTime": "2026-03-12T02:39:53.743967681Z",
"updateTime": "2026-03-12T02:39:53.743967681Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7d93b811a8fb2376a1f74e12852772d0aca129f8",
"ref": "refs/heads/main"
}
},
"canary": true
}
[02:39:54.219] Invocation finished in 4h45m51.600974259s with status FAILED