[14:12:02.477] New invocation is queued and will start shortly
[14:12:03.628] Starting the invocation (attempt 1)
[14:12:03.652] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a7cb793fd7c71dddff5f3e54bdccf463cfc57832"
[14:12:03.652] Popped gitiles commit info from properties and tags
[14:12:03.652] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:12:03.652] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:12:03.653] Buildbucket request:
{
"requestId": "8858303253440891456",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a7cb793fd7c71dddff5f3e54bdccf463cfc57832",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8858303253440891456"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacArm64"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:12:04.083] Scheduled build:
{
"id": "8692873191486606977",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"number": 1338,
"createdBy": "project:chromium",
"createTime": "2026-01-12T14:12:03.710660096Z",
"updateTime": "2026-01-12T14:12:03.710660096Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a7cb793fd7c71dddff5f3e54bdccf463cfc57832",
"ref": "refs/heads/main"
}
}
}
[14:12:04.083] Task URL: https://cr-buildbucket.appspot.com/build/8692873191486606977
[14:12:04.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:2:0) after 3m17s
[14:12:05.130] Received PubSub notification, asking Buildbucket for the build status
[14:12:05.147] Build status: SCHEDULED
[14:13:10.623] Received PubSub notification, asking Buildbucket for the build status
[14:13:10.653] Build status: STARTED
[14:15:21.099] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:2:0)
[14:15:21.113] Build status: STARTED
[14:15:21.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:5:0) after 9m48s
[14:25:09.246] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:5:0)
[14:25:09.268] Build status: STARTED
[14:25:09.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:6:0) after 2m49s
[14:27:58.256] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:6:0)
[14:27:58.288] Build status: STARTED
[14:27:58.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:7:0) after 6m24s
[14:34:22.383] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:7:0)
[14:34:22.469] Build status: STARTED
[14:34:22.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:8:0) after 2m23s
[14:36:45.484] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:8:0)
[14:36:45.504] Build status: STARTED
[14:36:45.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:9:0) after 2m3s
[14:38:48.563] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:9:0)
[14:38:48.596] Build status: STARTED
[14:38:48.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:10:0) after 3m31s
[14:42:19.615] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:10:0)
[14:42:19.633] Build status: STARTED
[14:42:19.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:11:0) after 5m12s
[14:47:31.607] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:11:0)
[14:47:31.644] Build status: STARTED
[14:47:31.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:12:0) after 5m7s
[14:52:38.663] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:12:0)
[14:52:38.683] Build status: STARTED
[14:52:38.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:13:0) after 8m50s
[15:01:28.697] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:13:0)
[15:01:28.723] Build status: STARTED
[15:01:28.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:14:0) after 2m45s
[15:04:13.743] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:14:0)
[15:04:13.762] Build status: STARTED
[15:04:13.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:15:0) after 9m23s
[15:13:36.813] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:15:0)
[15:13:36.830] Build status: STARTED
[15:13:36.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:16:0) after 4m46s
[15:18:22.851] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:16:0)
[15:18:22.872] Build status: STARTED
[15:18:22.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:17:0) after 8m56s
[15:27:18.891] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:17:0)
[15:27:18.907] Build status: STARTED
[15:27:18.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:18:0) after 5m39s
[15:32:58.042] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:18:0)
[15:32:58.057] Build status: STARTED
[15:32:58.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:19:0) after 1m44s
[15:34:42.053] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:19:0)
[15:34:42.069] Build status: STARTED
[15:34:42.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:20:0) after 8m30s
[15:43:12.136] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:20:0)
[15:43:12.206] Build status: STARTED
[15:43:12.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:21:0) after 6m34s
[15:49:46.279] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:21:0)
[15:49:46.302] Build status: STARTED
[15:49:46.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:22:0) after 1m17s
[15:51:03.321] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:22:0)
[15:51:03.344] Build status: STARTED
[15:51:03.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:23:0) after 8m7s
[15:59:10.413] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:23:0)
[15:59:10.427] Build status: STARTED
[15:59:10.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:24:0) after 7m6s
[16:06:16.451] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:24:0)
[16:06:16.478] Build status: STARTED
[16:06:16.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:25:0) after 5m12s
[16:11:28.495] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:25:0)
[16:11:28.527] Build status: STARTED
[16:11:28.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:26:0) after 1m36s
[16:13:04.594] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:26:0)
[16:13:04.639] Build status: STARTED
[16:13:04.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:27:0) after 5m18s
[16:18:22.807] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:27:0)
[16:18:22.852] Build status: STARTED
[16:18:22.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:28:0) after 3m43s
[16:22:05.922] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:28:0)
[16:22:05.942] Build status: STARTED
[16:22:05.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:29:0) after 7m41s
[16:29:46.960] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:29:0)
[16:29:46.981] Build status: STARTED
[16:29:46.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:30:0) after 4m59s
[16:34:46.029] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:30:0)
[16:34:46.046] Build status: STARTED
[16:34:46.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:31:0) after 1m22s
[16:36:08.046] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:31:0)
[16:36:08.122] Build status: STARTED
[16:36:08.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:32:0) after 9m5s
[16:45:13.187] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:32:0)
[16:45:13.205] Build status: STARTED
[16:45:13.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:33:0) after 7m7s
[16:52:20.220] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:33:0)
[16:52:20.235] Build status: STARTED
[16:52:20.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:34:0) after 7m50s
[17:00:10.267] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:34:0)
[17:00:10.288] Build status: STARTED
[17:00:10.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:35:0) after 7m54s
[17:08:04.351] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:35:0)
[17:08:04.403] Build status: STARTED
[17:08:04.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:36:0) after 7m55s
[17:15:59.458] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:36:0)
[17:15:59.472] Build status: STARTED
[17:15:59.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:37:0) after 8m47s
[17:24:46.492] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:37:0)
[17:24:46.508] Build status: STARTED
[17:24:46.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:38:0) after 1m53s
[17:26:39.563] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:38:0)
[17:26:39.577] Build status: STARTED
[17:26:39.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:39:0) after 4m17s
[17:30:56.647] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:39:0)
[17:30:56.668] Build status: STARTED
[17:30:56.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:40:0) after 6m59s
[17:37:55.687] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:40:0)
[17:37:55.712] Build status: STARTED
[17:37:55.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:41:0) after 6m55s
[17:44:50.733] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:41:0)
[17:44:50.771] Build status: STARTED
[17:44:50.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:42:0) after 4m19s
[17:49:09.795] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:42:0)
[17:49:09.810] Build status: STARTED
[17:49:09.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:43:0) after 9m32s
[17:58:41.798] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:43:0)
[17:58:41.827] Build status: STARTED
[17:58:41.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:44:0) after 2m25s
[18:01:06.888] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:44:0)
[18:01:06.907] Build status: STARTED
[18:01:06.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:45:0) after 9m16s
[18:10:22.998] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:45:0)
[18:10:23.014] Build status: STARTED
[18:10:23.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:46:0) after 9m20s
[18:19:43.028] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:46:0)
[18:19:43.048] Build status: STARTED
[18:19:43.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:47:0) after 1m57s
[18:21:40.140] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:47:0)
[18:21:40.161] Build status: STARTED
[18:21:40.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:48:0) after 6m1s
[18:27:41.236] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:48:0)
[18:27:41.257] Build status: STARTED
[18:27:41.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:49:0) after 4m38s
[18:32:19.276] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:49:0)
[18:32:19.291] Build status: STARTED
[18:32:19.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8858303253440891456:50:0) after 4m22s
[18:32:24.869] Received PubSub notification, asking Buildbucket for the build status
[18:32:24.882] Build:
{
"id": "8692873191486606977",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"number": 1338,
"createdBy": "project:chromium",
"createTime": "2026-01-12T14:12:03.710660096Z",
"startTime": "2026-01-12T14:13:10.469734908Z",
"endTime": "2026-01-12T18:32:24.546101348Z",
"updateTime": "2026-01-12T18:32:24.546101348Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a7cb793fd7c71dddff5f3e54bdccf463cfc57832",
"ref": "refs/heads/main"
}
}
}
[18:32:24.882] Invocation finished in 4h20m22.419390445s with status FAILED