[08:09:55.600] New invocation is queued and will start shortly
[08:09:56.911] Starting the invocation (attempt 1)
[08:09:56.954] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/550f34cd989f500105792f10bcde754ecad1467f"
[08:09:56.954] Popped gitiles commit info from properties and tags
[08:09:56.954] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:09:56.955] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:09:56.955] Buildbucket request:
{
"requestId": "8836492166813200400",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "550f34cd989f500105792f10bcde754ecad1467f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8836492166813200400"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:09:57.482] Scheduled build:
{
"id": "8671062104661871553",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 42533,
"createdBy": "project:chromium",
"createTime": "2026-09-10T08:09:57.028570553Z",
"updateTime": "2026-09-10T08:09:57.028570553Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "550f34cd989f500105792f10bcde754ecad1467f",
"ref": "refs/heads/main"
}
}
}
[08:09:57.482] Task URL: https://cr-buildbucket.appspot.com/build/8671062104661871553
[08:09:57.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:2:0) after 1m48s
[08:09:58.458] Received PubSub notification, asking Buildbucket for the build status
[08:09:58.478] Build status: SCHEDULED
[08:10:01.805] Received PubSub notification, asking Buildbucket for the build status
[08:10:01.830] Build status: STARTED
[08:11:45.501] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:2:0)
[08:11:45.521] Build status: STARTED
[08:11:45.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:5:0) after 4m29s
[08:16:14.608] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:5:0)
[08:16:14.635] Build status: STARTED
[08:16:14.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:6:0) after 8m51s
[08:25:05.653] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:6:0)
[08:25:05.673] Build status: STARTED
[08:25:05.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:7:0) after 7m51s
[08:32:56.800] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:7:0)
[08:32:56.850] Build status: STARTED
[08:32:56.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:8:0) after 9m18s
[08:42:14.905] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:8:0)
[08:42:14.926] Build status: STARTED
[08:42:14.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:9:0) after 7m19s
[08:49:33.948] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:9:0)
[08:49:33.964] Build status: STARTED
[08:49:33.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:10:0) after 6m50s
[08:56:23.960] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:10:0)
[08:56:23.979] Build status: STARTED
[08:56:23.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:11:0) after 5m22s
[09:01:45.984] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:11:0)
[09:01:46.005] Build status: STARTED
[09:01:46.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:12:0) after 2m12s
[09:03:57.989] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:12:0)
[09:03:58.038] Build status: STARTED
[09:03:58.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:13:0) after 5m6s
[09:09:04.065] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:13:0)
[09:09:04.108] Build status: STARTED
[09:09:04.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:14:0) after 9m57s
[09:19:01.149] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:14:0)
[09:19:01.188] Build status: STARTED
[09:19:01.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:15:0) after 4m50s
[09:23:51.213] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:15:0)
[09:23:51.235] Build status: STARTED
[09:23:51.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:16:0) after 8m55s
[09:32:46.261] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:16:0)
[09:32:46.281] Build status: STARTED
[09:32:46.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:17:0) after 5m46s
[09:38:32.317] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:17:0)
[09:38:32.342] Build status: STARTED
[09:38:32.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:18:0) after 3m10s
[09:41:42.598] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:18:0)
[09:41:42.629] Build status: STARTED
[09:41:42.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:19:0) after 8m33s
[09:50:15.734] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:19:0)
[09:50:15.753] Build status: STARTED
[09:50:15.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:20:0) after 9m28s
[09:59:43.772] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:20:0)
[09:59:43.790] Build status: STARTED
[09:59:43.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:21:0) after 1m28s
[10:01:11.810] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:21:0)
[10:01:11.828] Build status: STARTED
[10:01:11.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:22:0) after 1m51s
[10:03:02.924] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:22:0)
[10:03:02.974] Build status: STARTED
[10:03:02.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:23:0) after 2m4s
[10:05:06.992] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:23:0)
[10:05:07.010] Build status: STARTED
[10:05:07.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:24:0) after 4m16s
[10:09:23.045] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:24:0)
[10:09:23.070] Build status: STARTED
[10:09:23.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:25:0) after 5m42s
[10:15:05.145] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:25:0)
[10:15:05.240] Build status: STARTED
[10:15:05.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:26:0) after 7m27s
[10:22:32.322] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:26:0)
[10:22:32.342] Build status: STARTED
[10:22:32.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:27:0) after 4m0s
[10:26:32.402] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:27:0)
[10:26:32.429] Build status: STARTED
[10:26:32.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:28:0) after 2m6s
[10:28:38.452] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:28:0)
[10:28:38.471] Build status: STARTED
[10:28:38.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:29:0) after 5m2s
[10:33:40.491] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:29:0)
[10:33:40.521] Build status: STARTED
[10:33:40.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:30:0) after 1m37s
[10:35:17.622] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:30:0)
[10:35:17.639] Build status: STARTED
[10:35:17.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:31:0) after 6m50s
[10:42:07.675] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:31:0)
[10:42:07.693] Build status: STARTED
[10:42:07.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:32:0) after 7m0s
[10:49:07.711] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:32:0)
[10:49:07.737] Build status: STARTED
[10:49:07.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:33:0) after 5m51s
[10:54:58.759] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:33:0)
[10:54:58.778] Build status: STARTED
[10:54:58.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:34:0) after 8m45s
[11:03:43.801] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:34:0)
[11:03:43.843] Build status: STARTED
[11:03:43.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:35:0) after 5m14s
[11:08:57.914] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:35:0)
[11:08:57.987] Build status: STARTED
[11:08:57.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:36:0) after 3m56s
[11:12:54.010] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:36:0)
[11:12:54.035] Build status: STARTED
[11:12:54.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:37:0) after 3m50s
[11:16:44.110] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:37:0)
[11:16:44.155] Build status: STARTED
[11:16:44.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:38:0) after 3m27s
[11:20:11.173] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:38:0)
[11:20:11.193] Build status: STARTED
[11:20:11.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:39:0) after 1m47s
[11:21:58.223] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:39:0)
[11:21:58.322] Build status: STARTED
[11:21:58.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:40:0) after 9m34s
[11:31:32.341] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:40:0)
[11:31:32.359] Build status: STARTED
[11:31:32.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:41:0) after 5m0s
[11:36:32.389] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:41:0)
[11:36:32.439] Build status: STARTED
[11:36:32.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:42:0) after 9m27s
[11:45:59.508] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:42:0)
[11:45:59.529] Build status: STARTED
[11:45:59.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:43:0) after 7m5s
[11:53:04.580] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:43:0)
[11:53:04.597] Build status: STARTED
[11:53:04.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:44:0) after 1m37s
[11:54:41.618] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:44:0)
[11:54:41.637] Build status: STARTED
[11:54:41.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:45:0) after 5m56s
[12:00:37.658] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:45:0)
[12:00:37.677] Build status: STARTED
[12:00:37.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:46:0) after 4m7s
[12:04:44.665] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:46:0)
[12:04:44.692] Build status: STARTED
[12:04:44.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:47:0) after 7m56s
[12:12:40.712] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:47:0)
[12:12:40.734] Build status: STARTED
[12:12:40.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:48:0) after 2m27s
[12:15:07.753] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:48:0)
[12:15:07.993] Build status: STARTED
[12:15:07.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:49:0) after 4m47s
[12:19:55.019] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:49:0)
[12:19:55.073] Build status: STARTED
[12:19:55.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:50:0) after 5m47s
[12:25:42.113] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:50:0)
[12:25:42.132] Build status: STARTED
[12:25:42.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:51:0) after 9m26s
[12:35:08.157] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:51:0)
[12:35:08.212] Build status: STARTED
[12:35:08.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:52:0) after 6m46s
[12:41:54.241] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:52:0)
[12:41:54.263] Build status: STARTED
[12:41:54.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:53:0) after 6m27s
[12:48:21.349] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:53:0)
[12:48:21.368] Build status: STARTED
[12:48:21.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:54:0) after 5m27s
[12:53:48.388] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:54:0)
[12:53:48.413] Build status: STARTED
[12:53:48.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:55:0) after 3m22s
[12:57:10.435] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:55:0)
[12:57:10.547] Build status: STARTED
[12:57:10.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:56:0) after 2m34s
[12:59:44.616] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:56:0)
[12:59:44.637] Build status: STARTED
[12:59:44.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:57:0) after 8m6s
[13:07:50.666] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:57:0)
[13:07:50.688] Build status: STARTED
[13:07:50.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:58:0) after 1m33s
[13:09:23.677] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:58:0)
[13:09:23.707] Build status: STARTED
[13:09:23.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:59:0) after 1m8s
[13:10:31.792] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:59:0)
[13:10:31.812] Build status: STARTED
[13:10:31.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:60:0) after 7m38s
[13:18:09.832] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:60:0)
[13:18:09.851] Build status: STARTED
[13:18:09.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:61:0) after 1m33s
[13:19:42.882] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:61:0)
[13:19:42.937] Build status: STARTED
[13:19:42.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:62:0) after 1m9s
[13:20:52.012] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:62:0)
[13:20:52.030] Build status: STARTED
[13:20:52.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:63:0) after 4m30s
[13:25:22.085] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:63:0)
[13:25:22.114] Build status: STARTED
[13:25:22.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:64:0) after 6m43s
[13:32:05.136] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:64:0)
[13:32:05.161] Build status: STARTED
[13:32:05.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:65:0) after 3m14s
[13:35:19.183] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:65:0)
[13:35:19.202] Build status: STARTED
[13:35:19.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:66:0) after 7m20s
[13:42:39.230] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:66:0)
[13:42:39.252] Build status: STARTED
[13:42:39.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:67:0) after 4m23s
[13:47:02.375] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:67:0)
[13:47:02.392] Build status: STARTED
[13:47:02.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:68:0) after 7m55s
[13:54:57.476] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:68:0)
[13:54:57.505] Build status: STARTED
[13:54:57.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:69:0) after 9m40s
[14:04:37.555] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:69:0)
[14:04:37.581] Build status: STARTED
[14:04:37.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:70:0) after 3m40s
[14:08:17.641] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:70:0)
[14:08:17.661] Build status: STARTED
[14:08:17.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:71:0) after 5m11s
[14:13:28.791] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:71:0)
[14:13:28.817] Build status: STARTED
[14:13:28.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:72:0) after 7m54s
[14:21:22.880] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:72:0)
[14:21:22.909] Build status: STARTED
[14:21:22.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8836492166813200400:73:0) after 4m47s
[14:21:26.088] Received PubSub notification, asking Buildbucket for the build status
[14:21:26.115] Build:
{
"id": "8671062104661871553",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 42533,
"createdBy": "project:chromium",
"createTime": "2026-09-10T08:09:57.028570553Z",
"startTime": "2026-09-10T08:10:01.493487543Z",
"endTime": "2026-09-10T14:21:25.780035048Z",
"updateTime": "2026-09-10T14:21:25.780035048Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "550f34cd989f500105792f10bcde754ecad1467f",
"ref": "refs/heads/main"
}
}
}
[14:21:26.115] Invocation finished in 6h11m30.5221816s with status FAILED