[10:43:13.200] New invocation is queued and will start shortly
[10:43:15.080] Starting the invocation (attempt 1)
[10:43:15.108] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/0b77b9c771ca51c1d0ac4a1e5bdce77e0eb42b56"
[10:43:15.108] Popped gitiles commit info from properties and tags
[10:43:15.108] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:43:15.109] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:43:15.109] Buildbucket request:
{
"requestId": "8851793409751250704",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0b77b9c771ca51c1d0ac4a1e5bdce77e0eb42b56",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851793409751250704"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacArm64"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:43:15.589] Scheduled build:
{
"id": "8686363347032068529",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"number": 2300,
"createdBy": "project:chromium",
"createTime": "2026-03-25T10:43:15.170952667Z",
"updateTime": "2026-03-25T10:43:15.170952667Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0b77b9c771ca51c1d0ac4a1e5bdce77e0eb42b56",
"ref": "refs/heads/main"
}
}
}
[10:43:15.589] Task URL: https://cr-buildbucket.appspot.com/build/8686363347032068529
[10:43:15.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:2:0) after 4m37s
[10:43:18.239] Received PubSub notification, asking Buildbucket for the build status
[10:43:18.262] Build status: SCHEDULED
[10:44:05.002] Received PubSub notification, asking Buildbucket for the build status
[10:44:05.027] Build status: STARTED
[10:47:52.710] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:2:0)
[10:47:52.733] Build status: STARTED
[10:47:52.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:5:0) after 7m42s
[10:55:34.761] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:5:0)
[10:55:34.781] Build status: STARTED
[10:55:34.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:6:0) after 3m25s
[10:58:59.825] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:6:0)
[10:58:59.872] Build status: STARTED
[10:58:59.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:7:0) after 3m35s
[11:02:34.891] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:7:0)
[11:02:34.946] Build status: STARTED
[11:02:34.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:8:0) after 4m35s
[11:07:09.957] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:8:0)
[11:07:09.996] Build status: STARTED
[11:07:09.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:9:0) after 9m35s
[11:16:45.077] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:9:0)
[11:16:45.098] Build status: STARTED
[11:16:45.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:10:0) after 1m12s
[11:17:57.169] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:10:0)
[11:17:57.183] Build status: STARTED
[11:17:57.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:11:0) after 1m37s
[11:19:34.200] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:11:0)
[11:19:34.220] Build status: STARTED
[11:19:34.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:12:0) after 6m39s
[11:26:13.483] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:12:0)
[11:26:13.511] Build status: STARTED
[11:26:13.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:13:0) after 1m10s
[11:27:23.529] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:13:0)
[11:27:23.603] Build status: STARTED
[11:27:23.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:14:0) after 9m0s
[11:36:23.745] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:14:0)
[11:36:23.762] Build status: STARTED
[11:36:23.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:15:0) after 9m30s
[11:45:54.198] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:15:0)
[11:45:54.213] Build status: STARTED
[11:45:54.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:16:0) after 9m12s
[11:55:06.232] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:16:0)
[11:55:06.254] Build status: STARTED
[11:55:06.254] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:17:0) after 9m14s
[12:04:21.071] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:17:0)
[12:04:21.147] Build status: STARTED
[12:04:21.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:18:0) after 8m38s
[12:12:59.602] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:18:0)
[12:12:59.617] Build status: STARTED
[12:12:59.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:19:0) after 3m8s
[12:16:07.687] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:19:0)
[12:16:07.705] Build status: STARTED
[12:16:07.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:20:0) after 5m52s
[12:21:59.815] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:20:0)
[12:21:59.836] Build status: STARTED
[12:21:59.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:21:0) after 2m37s
[12:24:36.851] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:21:0)
[12:24:36.870] Build status: STARTED
[12:24:36.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:22:0) after 2m22s
[12:26:59.038] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:22:0)
[12:26:59.051] Build status: STARTED
[12:26:59.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:23:0) after 6m10s
[12:33:09.092] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:23:0)
[12:33:09.134] Build status: STARTED
[12:33:09.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:24:0) after 2m17s
[12:35:26.423] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:24:0)
[12:35:26.441] Build status: STARTED
[12:35:26.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:25:0) after 8m43s
[12:44:09.431] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:25:0)
[12:44:09.498] Build status: STARTED
[12:44:09.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:26:0) after 5m10s
[12:49:19.517] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:26:0)
[12:49:19.532] Build status: STARTED
[12:49:19.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:27:0) after 8m58s
[12:58:17.550] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:27:0)
[12:58:17.574] Build status: STARTED
[12:58:17.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:28:0) after 9m48s
[13:08:05.687] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:28:0)
[13:08:05.705] Build status: STARTED
[13:08:05.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:29:0) after 8m18s
[13:16:23.768] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:29:0)
[13:16:23.786] Build status: STARTED
[13:16:23.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:30:0) after 5m0s
[13:21:23.807] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:30:0)
[13:21:23.827] Build status: STARTED
[13:21:23.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:31:0) after 8m4s
[13:29:27.936] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:31:0)
[13:29:27.951] Build status: STARTED
[13:29:27.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:32:0) after 1m21s
[13:30:48.984] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:32:0)
[13:30:48.999] Build status: STARTED
[13:30:48.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:33:0) after 8m5s
[13:38:54.018] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:33:0)
[13:38:54.035] Build status: STARTED
[13:38:54.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:34:0) after 5m33s
[13:44:27.082] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:34:0)
[13:44:27.149] Build status: STARTED
[13:44:27.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:35:0) after 1m22s
[13:45:49.179] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:35:0)
[13:45:49.234] Build status: STARTED
[13:45:49.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:36:0) after 8m59s
[13:54:48.215] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:36:0)
[13:54:48.232] Build status: STARTED
[13:54:48.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:37:0) after 2m4s
[13:56:52.223] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:37:0)
[13:56:52.239] Build status: STARTED
[13:56:52.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:38:0) after 6m26s
[14:03:18.264] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:38:0)
[14:03:18.289] Build status: STARTED
[14:03:18.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:39:0) after 7m35s
[14:10:53.305] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:39:0)
[14:10:53.322] Build status: STARTED
[14:10:53.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:40:0) after 4m57s
[14:15:50.341] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:40:0)
[14:15:50.373] Build status: STARTED
[14:15:50.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:41:0) after 1m20s
[14:17:10.488] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:41:0)
[14:17:10.508] Build status: STARTED
[14:17:10.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:42:0) after 2m1s
[14:19:11.510] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:42:0)
[14:19:11.542] Build status: STARTED
[14:19:11.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:43:0) after 2m20s
[14:21:31.614] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:43:0)
[14:21:31.635] Build status: STARTED
[14:21:31.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:44:0) after 2m56s
[14:24:27.655] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:44:0)
[14:24:27.673] Build status: STARTED
[14:24:27.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:45:0) after 8m27s
[14:32:54.696] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:45:0)
[14:32:54.712] Build status: STARTED
[14:32:54.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:46:0) after 3m42s
[14:36:36.728] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:46:0)
[14:36:36.750] Build status: STARTED
[14:36:36.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:47:0) after 7m31s
[14:44:07.812] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:47:0)
[14:44:07.838] Build status: STARTED
[14:44:07.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:48:0) after 9m34s
[14:53:41.938] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:48:0)
[14:53:41.981] Build status: STARTED
[14:53:41.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:49:0) after 6m25s
[15:00:07.004] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:49:0)
[15:00:07.036] Build status: STARTED
[15:00:07.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:50:0) after 6m1s
[15:06:08.179] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:50:0)
[15:06:08.205] Build status: STARTED
[15:06:08.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:51:0) after 3m13s
[15:09:21.222] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:51:0)
[15:09:21.238] Build status: STARTED
[15:09:21.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:52:0) after 8m17s
[15:17:38.266] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:52:0)
[15:17:38.350] Build status: STARTED
[15:17:38.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851793409751250704:53:0) after 9m0s
[15:26:07.054] Received PubSub notification, asking Buildbucket for the build status
[15:26:07.074] Build:
{
"id": "8686363347032068529",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"number": 2300,
"createdBy": "project:chromium",
"createTime": "2026-03-25T10:43:15.170952667Z",
"startTime": "2026-03-25T10:43:55.708249762Z",
"endTime": "2026-03-25T15:26:06.718466501Z",
"updateTime": "2026-03-25T15:26:06.718466501Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0b77b9c771ca51c1d0ac4a1e5bdce77e0eb42b56",
"ref": "refs/heads/main"
}
}
}
[15:26:07.074] Invocation finished in 4h42m53.879612766s with status FAILED