[05:49:13.439] New invocation is queued and will start shortly
[05:49:14.570] Starting the invocation (attempt 1)
[05:49:14.602] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e0f60a07351e502cc1cce534091cf7bf3ded38b4"
[05:49:14.602] Popped gitiles commit info from properties and tags
[05:49:14.602] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:49:14.602] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:49:14.602] Buildbucket request:
{
"requestId": "8848550415587950320",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e0f60a07351e502cc1cce534091cf7bf3ded38b4",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8848550415587950320"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacArm64"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[05:49:15.147] Scheduled build:
{
"id": "8683120353642636017",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"number": 2868,
"createdBy": "project:chromium",
"createTime": "2026-04-30T05:49:14.674623432Z",
"updateTime": "2026-04-30T05:49:14.674623432Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e0f60a07351e502cc1cce534091cf7bf3ded38b4",
"ref": "refs/heads/main"
}
}
}
[05:49:15.147] Task URL: https://cr-buildbucket.appspot.com/build/8683120353642636017
[05:49:15.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:2:0) after 1m19s
[05:49:16.115] Received PubSub notification, asking Buildbucket for the build status
[05:49:16.135] Build status: SCHEDULED
[05:49:55.223] Received PubSub notification, asking Buildbucket for the build status
[05:49:55.239] Build status: STARTED
[05:50:34.166] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:2:0)
[05:50:34.334] Build status: STARTED
[05:50:34.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:5:0) after 8m14s
[05:58:48.347] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:5:0)
[05:58:48.369] Build status: STARTED
[05:58:48.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:6:0) after 8m56s
[06:07:44.527] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:6:0)
[06:07:44.550] Build status: STARTED
[06:07:44.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:7:0) after 1m53s
[06:09:37.686] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:7:0)
[06:09:37.699] Build status: STARTED
[06:09:37.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:8:0) after 2m19s
[06:11:56.713] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:8:0)
[06:11:56.732] Build status: STARTED
[06:11:56.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:9:0) after 6m56s
[06:18:52.805] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:9:0)
[06:18:52.867] Build status: STARTED
[06:18:52.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:10:0) after 6m36s
[06:25:28.875] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:10:0)
[06:25:28.910] Build status: STARTED
[06:25:28.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:11:0) after 8m30s
[06:33:58.925] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:11:0)
[06:33:58.960] Build status: STARTED
[06:33:58.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:12:0) after 1m4s
[06:35:02.984] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:12:0)
[06:35:03.034] Build status: STARTED
[06:35:03.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:13:0) after 7m13s
[06:42:16.088] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:13:0)
[06:42:16.107] Build status: STARTED
[06:42:16.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:14:0) after 2m31s
[06:44:47.124] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:14:0)
[06:44:47.161] Build status: STARTED
[06:44:47.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:15:0) after 3m9s
[06:47:56.197] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:15:0)
[06:47:56.216] Build status: STARTED
[06:47:56.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:16:0) after 8m22s
[06:56:18.261] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:16:0)
[06:56:18.469] Build status: STARTED
[06:56:18.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:17:0) after 9m25s
[07:05:43.481] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:17:0)
[07:05:43.513] Build status: STARTED
[07:05:43.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:18:0) after 5m14s
[07:10:57.612] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:18:0)
[07:10:57.639] Build status: STARTED
[07:10:57.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:19:0) after 5m23s
[07:16:20.658] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:19:0)
[07:16:20.706] Build status: STARTED
[07:16:20.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:20:0) after 2m26s
[07:18:46.718] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:20:0)
[07:18:46.736] Build status: STARTED
[07:18:46.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:21:0) after 9m43s
[07:28:29.749] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:21:0)
[07:28:29.767] Build status: STARTED
[07:28:29.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:22:0) after 1m50s
[07:30:19.876] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:22:0)
[07:30:19.898] Build status: STARTED
[07:30:19.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:23:0) after 3m22s
[07:33:41.963] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:23:0)
[07:33:41.977] Build status: STARTED
[07:33:41.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:24:0) after 6m21s
[07:40:02.992] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:24:0)
[07:40:03.008] Build status: STARTED
[07:40:03.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:25:0) after 8m57s
[07:49:00.024] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:25:0)
[07:49:00.132] Build status: STARTED
[07:49:00.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:26:0) after 2m36s
[07:51:36.204] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:26:0)
[07:51:36.232] Build status: STARTED
[07:51:36.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:27:0) after 1m55s
[07:53:31.246] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:27:0)
[07:53:31.290] Build status: STARTED
[07:53:31.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:28:0) after 8m37s
[08:02:08.303] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:28:0)
[08:02:08.325] Build status: STARTED
[08:02:08.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:29:0) after 2m9s
[08:04:17.325] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:29:0)
[08:04:17.359] Build status: STARTED
[08:04:17.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:30:0) after 8m8s
[08:12:25.371] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:30:0)
[08:12:25.390] Build status: STARTED
[08:12:25.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:31:0) after 3m40s
[08:16:05.387] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:31:0)
[08:16:05.443] Build status: STARTED
[08:16:05.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:32:0) after 5m44s
[08:21:49.597] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:32:0)
[08:21:49.633] Build status: STARTED
[08:21:49.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:33:0) after 7m44s
[08:29:33.840] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:33:0)
[08:29:33.856] Build status: STARTED
[08:29:33.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:34:0) after 5m31s
[08:35:04.918] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:34:0)
[08:35:04.935] Build status: STARTED
[08:35:04.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:35:0) after 5m43s
[08:40:47.948] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:35:0)
[08:40:47.962] Build status: STARTED
[08:40:47.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:36:0) after 5m20s
[08:46:07.975] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:36:0)
[08:46:08.002] Build status: STARTED
[08:46:08.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:37:0) after 2m22s
[08:48:30.011] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:37:0)
[08:48:30.029] Build status: STARTED
[08:48:30.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:38:0) after 9m27s
[08:57:57.066] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:38:0)
[08:57:57.087] Build status: STARTED
[08:57:57.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:39:0) after 2m23s
[09:00:20.150] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:39:0)
[09:00:20.189] Build status: STARTED
[09:00:20.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:40:0) after 9m18s
[09:09:38.202] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:40:0)
[09:09:38.223] Build status: STARTED
[09:09:38.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:41:0) after 2m33s
[09:12:11.568] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:41:0)
[09:12:11.682] Build status: STARTED
[09:12:11.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:42:0) after 8m45s
[09:20:56.813] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:42:0)
[09:20:56.843] Build status: STARTED
[09:20:56.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:43:0) after 5m28s
[09:26:24.907] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:43:0)
[09:26:24.927] Build status: STARTED
[09:26:24.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:44:0) after 6m44s
[09:33:08.940] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:44:0)
[09:33:08.981] Build status: STARTED
[09:33:08.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:45:0) after 7m55s
[09:41:04.005] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:45:0)
[09:41:04.020] Build status: STARTED
[09:41:04.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:46:0) after 6m25s
[09:47:29.096] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:46:0)
[09:47:29.113] Build status: STARTED
[09:47:29.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:47:0) after 4m8s
[09:51:37.097] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:47:0)
[09:51:37.233] Build status: STARTED
[09:51:37.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:48:0) after 9m28s
[10:01:05.300] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:48:0)
[10:01:05.321] Build status: STARTED
[10:01:05.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:49:0) after 6m37s
[10:07:42.378] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:49:0)
[10:07:42.397] Build status: STARTED
[10:07:42.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848550415587950320:50:0) after 3m18s
[10:09:18.832] Received PubSub notification, asking Buildbucket for the build status
[10:09:18.846] Build:
{
"id": "8683120353642636017",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"number": 2868,
"createdBy": "project:chromium",
"createTime": "2026-04-30T05:49:14.674623432Z",
"startTime": "2026-04-30T05:49:55.053371042Z",
"endTime": "2026-04-30T10:09:18.579651063Z",
"updateTime": "2026-04-30T10:09:18.579651063Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e0f60a07351e502cc1cce534091cf7bf3ded38b4",
"ref": "refs/heads/main"
}
}
}
[10:09:18.846] Invocation finished in 4h20m5.410794844s with status FAILED