[02:34:00.287] New invocation is queued and will start shortly
[02:34:01.516] Starting the invocation (attempt 1)
[02:34:01.544] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e58734c8a5fd3c4b31896d7782508108b5d1631b"
[02:34:01.544] Popped gitiles commit info from properties and tags
[02:34:01.545] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:34:01.545] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:34:01.545] Buildbucket request:
{
"requestId": "8842945685805163232",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e58734c8a5fd3c4b31896d7782508108b5d1631b",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8842945685805163232"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacArm64"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:34:02.106] Scheduled build:
{
"id": "8677515623754076033",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"number": 3972,
"createdBy": "project:chromium",
"createTime": "2026-07-01T02:34:01.619023179Z",
"updateTime": "2026-07-01T02:34:01.619023179Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e58734c8a5fd3c4b31896d7782508108b5d1631b",
"ref": "refs/heads/main"
}
}
}
[02:34:02.106] Task URL: https://cr-buildbucket.appspot.com/build/8677515623754076033
[02:34:02.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:2:0) after 7m29s
[02:34:04.126] Received PubSub notification, asking Buildbucket for the build status
[02:34:04.144] Build status: SCHEDULED
[02:34:45.333] Received PubSub notification, asking Buildbucket for the build status
[02:34:45.354] Build status: STARTED
[02:41:31.127] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:2:0)
[02:41:31.158] Build status: STARTED
[02:41:31.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:5:0) after 6m17s
[02:47:48.263] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:5:0)
[02:47:48.284] Build status: STARTED
[02:47:48.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:6:0) after 3m58s
[02:51:46.351] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:6:0)
[02:51:46.380] Build status: STARTED
[02:51:46.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:7:0) after 9m0s
[03:00:46.449] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:7:0)
[03:00:46.474] Build status: STARTED
[03:00:46.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:8:0) after 5m44s
[03:06:30.495] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:8:0)
[03:06:30.551] Build status: STARTED
[03:06:30.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:9:0) after 1m6s
[03:07:36.614] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:9:0)
[03:07:36.645] Build status: STARTED
[03:07:36.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:10:0) after 9m10s
[03:16:46.798] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:10:0)
[03:16:46.813] Build status: STARTED
[03:16:46.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:11:0) after 2m21s
[03:19:07.843] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:11:0)
[03:19:07.902] Build status: STARTED
[03:19:07.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:12:0) after 4m6s
[03:23:13.967] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:12:0)
[03:23:14.029] Build status: STARTED
[03:23:14.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:13:0) after 9m39s
[03:32:53.015] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:13:0)
[03:32:53.049] Build status: STARTED
[03:32:53.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:14:0) after 2m35s
[03:35:28.116] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:14:0)
[03:35:28.140] Build status: STARTED
[03:35:28.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:15:0) after 3m12s
[03:38:40.138] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:15:0)
[03:38:40.187] Build status: STARTED
[03:38:40.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:16:0) after 4m1s
[03:42:41.237] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:16:0)
[03:42:41.267] Build status: STARTED
[03:42:41.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:17:0) after 4m20s
[03:47:01.338] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:17:0)
[03:47:01.356] Build status: STARTED
[03:47:01.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:18:0) after 3m15s
[03:50:16.617] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:18:0)
[03:50:16.713] Build status: STARTED
[03:50:16.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:19:0) after 9m29s
[03:59:45.785] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:19:0)
[03:59:45.813] Build status: STARTED
[03:59:45.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:20:0) after 8m55s
[04:08:40.839] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:20:0)
[04:08:40.866] Build status: STARTED
[04:08:40.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:21:0) after 6m58s
[04:15:38.888] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:21:0)
[04:15:38.941] Build status: STARTED
[04:15:38.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:22:0) after 2m23s
[04:18:01.962] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:22:0)
[04:18:01.985] Build status: STARTED
[04:18:01.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:23:0) after 8m57s
[04:26:59.002] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:23:0)
[04:26:59.022] Build status: STARTED
[04:26:59.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:24:0) after 1m23s
[04:28:22.207] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:24:0)
[04:28:22.232] Build status: STARTED
[04:28:22.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:25:0) after 7m29s
[04:35:51.250] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:25:0)
[04:35:51.269] Build status: STARTED
[04:35:51.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:26:0) after 2m6s
[04:37:57.284] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:26:0)
[04:37:57.304] Build status: STARTED
[04:37:57.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:27:0) after 7m44s
[04:45:41.347] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:27:0)
[04:45:41.376] Build status: STARTED
[04:45:41.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:28:0) after 2m10s
[04:47:51.516] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:28:0)
[04:47:51.565] Build status: STARTED
[04:47:51.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:29:0) after 3m18s
[04:51:09.586] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:29:0)
[04:51:09.603] Build status: STARTED
[04:51:09.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:30:0) after 8m42s
[04:59:51.579] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:30:0)
[04:59:51.653] Build status: STARTED
[04:59:51.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:31:0) after 3m27s
[05:03:18.670] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:31:0)
[05:03:18.690] Build status: STARTED
[05:03:18.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:32:0) after 9m42s
[05:13:00.714] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:32:0)
[05:13:00.733] Build status: STARTED
[05:13:00.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:33:0) after 8m28s
[05:21:28.754] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:33:0)
[05:21:28.775] Build status: STARTED
[05:21:28.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:34:0) after 4m58s
[05:26:26.897] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:34:0)
[05:26:26.925] Build status: STARTED
[05:26:26.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:35:0) after 5m13s
[05:31:39.945] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:35:0)
[05:31:39.964] Build status: STARTED
[05:31:39.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:36:0) after 3m37s
[05:35:16.983] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:36:0)
[05:35:17.004] Build status: STARTED
[05:35:17.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:37:0) after 4m57s
[05:40:14.049] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:37:0)
[05:40:14.063] Build status: STARTED
[05:40:14.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:38:0) after 1m16s
[05:41:30.117] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:38:0)
[05:41:30.134] Build status: STARTED
[05:41:30.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:39:0) after 9m19s
[05:50:49.155] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:39:0)
[05:50:49.177] Build status: STARTED
[05:50:49.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:40:0) after 6m6s
[05:56:55.210] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:40:0)
[05:56:55.226] Build status: STARTED
[05:56:55.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:41:0) after 9m44s
[06:06:39.253] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:41:0)
[06:06:39.271] Build status: STARTED
[06:06:39.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:42:0) after 7m54s
[06:14:33.298] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:42:0)
[06:14:33.316] Build status: STARTED
[06:14:33.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:43:0) after 8m41s
[06:23:14.342] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:43:0)
[06:23:14.359] Build status: STARTED
[06:23:14.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:44:0) after 3m22s
[06:26:36.382] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:44:0)
[06:26:36.407] Build status: STARTED
[06:26:36.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:45:0) after 8m42s
[06:35:18.425] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:45:0)
[06:35:18.456] Build status: STARTED
[06:35:18.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:46:0) after 7m14s
[06:42:32.744] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:46:0)
[06:42:32.776] Build status: STARTED
[06:42:32.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842945685805163232:47:0) after 9m25s
[06:47:54.912] Received PubSub notification, asking Buildbucket for the build status
[06:47:54.929] Build:
{
"id": "8677515623754076033",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"number": 3972,
"createdBy": "project:chromium",
"createTime": "2026-07-01T02:34:01.619023179Z",
"startTime": "2026-07-01T02:34:45.096022033Z",
"endTime": "2026-07-01T06:47:54.431689093Z",
"updateTime": "2026-07-01T06:47:54.431689093Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e58734c8a5fd3c4b31896d7782508108b5d1631b",
"ref": "refs/heads/main"
}
}
}
[06:47:54.929] Invocation finished in 4h13m54.649151411s with status FAILED