[09:49:33.893] New invocation is queued and will start shortly
[09:49:34.963] Starting the invocation (attempt 1)
[09:49:34.986] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/5914c248ad448b26199c1df8b2ca717e74161297"
[09:49:34.986] Popped gitiles commit info from properties and tags
[09:49:34.986] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[09:49:34.986] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[09:49:34.986] Buildbucket request:
{
"requestId": "8850709621848980784",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5914c248ad448b26199c1df8b2ca717e74161297",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8850709621848980784"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[09:49:35.478] Scheduled build:
{
"id": "8685279559975273665",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 40134,
"createdBy": "project:chromium",
"createTime": "2026-04-06T09:49:35.051810810Z",
"updateTime": "2026-04-06T09:49:35.051810810Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5914c248ad448b26199c1df8b2ca717e74161297",
"ref": "refs/heads/main"
}
}
}
[09:49:35.478] Task URL: https://cr-buildbucket.appspot.com/build/8685279559975273665
[09:49:35.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:2:0) after 5m52s
[09:49:36.464] Received PubSub notification, asking Buildbucket for the build status
[09:49:36.481] Build status: SCHEDULED
[09:50:14.855] Received PubSub notification, asking Buildbucket for the build status
[09:50:14.878] Build status: STARTED
[09:55:27.535] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:2:0)
[09:55:27.562] Build status: STARTED
[09:55:27.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:5:0) after 4m49s
[10:00:16.573] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:5:0)
[10:00:16.589] Build status: STARTED
[10:00:16.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:6:0) after 7m55s
[10:08:12.453] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:6:0)
[10:08:12.470] Build status: STARTED
[10:08:12.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:7:0) after 5m39s
[10:13:51.536] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:7:0)
[10:13:51.556] Build status: STARTED
[10:13:51.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:8:0) after 1m44s
[10:15:35.691] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:8:0)
[10:15:35.704] Build status: STARTED
[10:15:35.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:9:0) after 2m0s
[10:17:35.719] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:9:0)
[10:17:35.747] Build status: STARTED
[10:17:35.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:10:0) after 7m57s
[10:25:32.828] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:10:0)
[10:25:32.852] Build status: STARTED
[10:25:32.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:11:0) after 9m42s
[10:35:14.871] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:11:0)
[10:35:15.007] Build status: STARTED
[10:35:15.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:12:0) after 1m37s
[10:36:52.024] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:12:0)
[10:36:52.039] Build status: STARTED
[10:36:52.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:13:0) after 1m10s
[10:38:02.507] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:13:0)
[10:38:02.534] Build status: STARTED
[10:38:02.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:14:0) after 7m10s
[10:45:12.675] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:14:0)
[10:45:12.695] Build status: STARTED
[10:45:12.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:15:0) after 3m18s
[10:48:30.711] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:15:0)
[10:48:30.733] Build status: STARTED
[10:48:30.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:16:0) after 4m55s
[10:53:25.750] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:16:0)
[10:53:25.794] Build status: STARTED
[10:53:25.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:17:0) after 2m1s
[10:55:26.859] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:17:0)
[10:55:26.917] Build status: STARTED
[10:55:26.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:18:0) after 5m37s
[11:01:04.012] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:18:0)
[11:01:04.110] Build status: STARTED
[11:01:04.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:19:0) after 2m53s
[11:03:57.133] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:19:0)
[11:03:57.155] Build status: STARTED
[11:03:57.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:20:0) after 4m15s
[11:08:12.157] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:20:0)
[11:08:12.178] Build status: STARTED
[11:08:12.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:21:0) after 5m36s
[11:13:48.223] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:21:0)
[11:13:48.257] Build status: STARTED
[11:13:48.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:22:0) after 2m33s
[11:16:21.273] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:22:0)
[11:16:21.295] Build status: STARTED
[11:16:21.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:23:0) after 5m13s
[11:21:34.313] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:23:0)
[11:21:34.336] Build status: STARTED
[11:21:34.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:24:0) after 8m51s
[11:30:25.660] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:24:0)
[11:30:25.711] Build status: STARTED
[11:30:25.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:25:0) after 8m11s
[11:38:36.964] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:25:0)
[11:38:36.984] Build status: STARTED
[11:38:36.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:26:0) after 6m2s
[11:44:39.003] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:26:0)
[11:44:39.028] Build status: STARTED
[11:44:39.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:27:0) after 6m45s
[11:51:24.360] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:27:0)
[11:51:24.385] Build status: STARTED
[11:51:24.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:28:0) after 9m48s
[12:01:12.426] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:28:0)
[12:01:12.711] Build status: STARTED
[12:01:12.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:29:0) after 7m55s
[12:09:07.767] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:29:0)
[12:09:07.790] Build status: STARTED
[12:09:07.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:30:0) after 3m10s
[12:12:17.848] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:30:0)
[12:12:17.867] Build status: STARTED
[12:12:17.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:31:0) after 6m50s
[12:19:07.985] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:31:0)
[12:19:08.005] Build status: STARTED
[12:19:08.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:32:0) after 2m16s
[12:21:23.995] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:32:0)
[12:21:24.037] Build status: STARTED
[12:21:24.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:33:0) after 6m55s
[12:28:19.153] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:33:0)
[12:28:19.225] Build status: STARTED
[12:28:19.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:34:0) after 9m50s
[12:38:09.343] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:34:0)
[12:38:09.374] Build status: STARTED
[12:38:09.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:35:0) after 2m34s
[12:40:43.433] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:35:0)
[12:40:43.451] Build status: STARTED
[12:40:43.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:36:0) after 8m22s
[12:49:05.466] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:36:0)
[12:49:05.481] Build status: STARTED
[12:49:05.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:37:0) after 7m25s
[12:56:30.504] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:37:0)
[12:56:30.560] Build status: STARTED
[12:56:30.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:38:0) after 5m42s
[13:02:12.823] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:38:0)
[13:02:12.895] Build status: STARTED
[13:02:12.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:39:0) after 5m42s
[13:07:54.913] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:39:0)
[13:07:54.938] Build status: STARTED
[13:07:54.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:40:0) after 4m33s
[13:12:27.957] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:40:0)
[13:12:27.973] Build status: STARTED
[13:12:27.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:41:0) after 2m35s
[13:15:03.109] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:41:0)
[13:15:03.132] Build status: STARTED
[13:15:03.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:42:0) after 1m3s
[13:16:06.151] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:42:0)
[13:16:06.227] Build status: STARTED
[13:16:06.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:43:0) after 6m6s
[13:22:12.245] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:43:0)
[13:22:12.275] Build status: STARTED
[13:22:12.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:44:0) after 6m29s
[13:28:41.299] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:44:0)
[13:28:41.315] Build status: STARTED
[13:28:41.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:45:0) after 7m22s
[13:36:03.428] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:45:0)
[13:36:03.518] Build status: STARTED
[13:36:03.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:46:0) after 1m3s
[13:37:06.563] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:46:0)
[13:37:06.615] Build status: STARTED
[13:37:06.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:47:0) after 7m17s
[13:44:23.650] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:47:0)
[13:44:23.685] Build status: STARTED
[13:44:23.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:48:0) after 5m36s
[13:49:59.775] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:48:0)
[13:49:59.795] Build status: STARTED
[13:49:59.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:49:0) after 3m5s
[13:53:04.816] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:49:0)
[13:53:04.833] Build status: STARTED
[13:53:04.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:50:0) after 2m10s
[13:55:14.857] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:50:0)
[13:55:15.058] Build status: STARTED
[13:55:15.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:51:0) after 3m52s
[13:59:07.054] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:51:0)
[13:59:07.073] Build status: STARTED
[13:59:07.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:52:0) after 9m0s
[14:08:07.444] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:52:0)
[14:08:07.487] Build status: STARTED
[14:08:07.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:53:0) after 3m17s
[14:11:24.702] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:53:0)
[14:11:24.721] Build status: STARTED
[14:11:24.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:54:0) after 2m15s
[14:13:39.753] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:54:0)
[14:13:39.770] Build status: STARTED
[14:13:39.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:55:0) after 3m6s
[14:16:45.859] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:55:0)
[14:16:45.883] Build status: STARTED
[14:16:45.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:56:0) after 8m35s
[14:25:21.533] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:56:0)
[14:25:21.552] Build status: STARTED
[14:25:21.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:57:0) after 6m45s
[14:32:06.688] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:57:0)
[14:32:06.769] Build status: STARTED
[14:32:06.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:58:0) after 5m46s
[14:37:52.791] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:58:0)
[14:37:52.808] Build status: STARTED
[14:37:52.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:59:0) after 6m0s
[14:43:52.901] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:59:0)
[14:43:52.921] Build status: STARTED
[14:43:52.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:60:0) after 8m49s
[14:52:42.207] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:60:0)
[14:52:42.225] Build status: STARTED
[14:52:42.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:61:0) after 2m16s
[14:54:58.737] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:61:0)
[14:54:58.751] Build status: STARTED
[14:54:58.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:62:0) after 8m44s
[15:03:42.776] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:62:0)
[15:03:42.795] Build status: STARTED
[15:03:42.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:63:0) after 8m48s
[15:12:30.812] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:63:0)
[15:12:30.835] Build status: STARTED
[15:12:30.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:64:0) after 6m54s
[15:19:24.856] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:64:0)
[15:19:24.871] Build status: STARTED
[15:19:24.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:65:0) after 6m7s
[15:25:32.131] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:65:0)
[15:25:32.152] Build status: STARTED
[15:25:32.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:66:0) after 3m18s
[15:28:50.762] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:66:0)
[15:28:50.776] Build status: STARTED
[15:28:50.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:67:0) after 7m42s
[15:36:32.995] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:67:0)
[15:36:33.016] Build status: STARTED
[15:36:33.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:68:0) after 9m13s
[15:45:46.144] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:68:0)
[15:45:47.488] Build status: STARTED
[15:45:47.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850709621848980784:69:0) after 5m15s
[15:47:44.336] Received PubSub notification, asking Buildbucket for the build status
[15:47:44.354] Build:
{
"id": "8685279559975273665",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 40134,
"createdBy": "project:chromium",
"createTime": "2026-04-06T09:49:35.051810810Z",
"startTime": "2026-04-06T09:50:14.595517115Z",
"endTime": "2026-04-06T15:47:36.376623593Z",
"updateTime": "2026-04-06T15:47:36.376623593Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5914c248ad448b26199c1df8b2ca717e74161297",
"ref": "refs/heads/main"
}
}
}
[15:47:44.354] Invocation finished in 5h58m10.474181144s with status FAILED