[01:40:40.882] New invocation is queued and will start shortly
[01:40:41.964] Starting the invocation (attempt 1)
[01:40:41.996] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/48316c122f99222193832319d46ec5c57c1109bc"
[01:40:41.996] Popped gitiles commit info from properties and tags
[01:40:41.996] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:40:41.997] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:40:41.997] Buildbucket request:
{
"requestId": "8833526956114495328",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "48316c122f99222193832319d46ec5c57c1109bc",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8833526956114495328"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacArm64"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:40:42.522] Scheduled build:
{
"id": "8668096894234078449",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"number": 5941,
"createdBy": "project:chromium",
"createTime": "2026-10-13T01:40:42.056633423Z",
"updateTime": "2026-10-13T01:40:42.056633423Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "48316c122f99222193832319d46ec5c57c1109bc",
"ref": "refs/heads/main"
}
},
"canary": true
}
[01:40:42.522] Task URL: https://cr-buildbucket.appspot.com/build/8668096894234078449
[01:40:42.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:2:0) after 6m29s
[01:40:52.036] Received PubSub notification, asking Buildbucket for the build status
[01:40:52.057] Build status: SCHEDULED
[01:41:05.854] Received PubSub notification, asking Buildbucket for the build status
[01:41:06.064] Build status: STARTED
[01:47:11.539] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:2:0)
[01:47:11.559] Build status: STARTED
[01:47:11.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:5:0) after 4m36s
[01:51:47.576] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:5:0)
[01:51:47.595] Build status: STARTED
[01:51:47.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:6:0) after 2m8s
[01:53:55.678] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:6:0)
[01:53:55.714] Build status: STARTED
[01:53:55.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:7:0) after 6m10s
[02:00:05.731] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:7:0)
[02:00:05.785] Build status: STARTED
[02:00:05.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:8:0) after 5m40s
[02:05:45.785] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:8:0)
[02:05:45.811] Build status: STARTED
[02:05:45.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:9:0) after 6m41s
[02:12:26.828] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:9:0)
[02:12:26.850] Build status: STARTED
[02:12:26.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:10:0) after 1m32s
[02:13:58.877] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:10:0)
[02:13:58.925] Build status: STARTED
[02:13:58.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:11:0) after 2m6s
[02:16:05.048] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:11:0)
[02:16:05.065] Build status: STARTED
[02:16:05.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:12:0) after 8m10s
[02:24:15.052] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:12:0)
[02:24:15.070] Build status: STARTED
[02:24:15.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:13:0) after 5m44s
[02:29:59.086] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:13:0)
[02:29:59.106] Build status: STARTED
[02:29:59.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:14:0) after 5m49s
[02:35:48.153] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:14:0)
[02:35:48.174] Build status: STARTED
[02:35:48.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:15:0) after 8m29s
[02:44:17.300] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:15:0)
[02:44:17.362] Build status: STARTED
[02:44:17.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:16:0) after 3m48s
[02:48:05.442] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:16:0)
[02:48:05.463] Build status: STARTED
[02:48:05.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:17:0) after 2m2s
[02:50:07.479] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:17:0)
[02:50:07.499] Build status: STARTED
[02:50:07.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:18:0) after 5m45s
[02:55:52.540] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:18:0)
[02:55:52.562] Build status: STARTED
[02:55:52.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:19:0) after 5m3s
[03:00:55.581] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:19:0)
[03:00:55.612] Build status: STARTED
[03:00:55.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:20:0) after 5m3s
[03:05:58.632] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:20:0)
[03:05:58.653] Build status: STARTED
[03:05:58.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:21:0) after 5m2s
[03:11:00.721] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:21:0)
[03:11:00.740] Build status: STARTED
[03:11:00.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:22:0) after 9m16s
[03:20:16.772] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:22:0)
[03:20:16.791] Build status: STARTED
[03:20:16.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:23:0) after 1m6s
[03:21:22.859] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:23:0)
[03:21:22.879] Build status: STARTED
[03:21:22.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:24:0) after 4m10s
[03:25:32.989] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:24:0)
[03:25:33.018] Build status: STARTED
[03:25:33.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:25:0) after 1m5s
[03:26:38.079] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:25:0)
[03:26:38.099] Build status: STARTED
[03:26:38.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:26:0) after 5m49s
[03:32:27.117] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:26:0)
[03:32:27.138] Build status: STARTED
[03:32:27.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:27:0) after 7m59s
[03:40:26.158] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:27:0)
[03:40:26.182] Build status: STARTED
[03:40:26.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:28:0) after 7m59s
[03:48:25.198] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:28:0)
[03:48:25.216] Build status: STARTED
[03:48:25.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:29:0) after 2m26s
[03:50:51.235] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:29:0)
[03:50:51.260] Build status: STARTED
[03:50:51.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:30:0) after 7m40s
[03:58:31.350] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:30:0)
[03:58:31.372] Build status: STARTED
[03:58:31.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:31:0) after 7m24s
[04:05:55.399] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:31:0)
[04:05:55.417] Build status: STARTED
[04:05:55.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:32:0) after 6m28s
[04:12:23.487] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:32:0)
[04:12:23.543] Build status: STARTED
[04:12:23.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:33:0) after 2m13s
[04:14:36.565] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:33:0)
[04:14:36.641] Build status: STARTED
[04:14:36.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:34:0) after 1m28s
[04:16:04.845] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:34:0)
[04:16:04.868] Build status: STARTED
[04:16:04.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:35:0) after 9m35s
[04:25:39.885] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:35:0)
[04:25:40.063] Build status: STARTED
[04:25:40.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:36:0) after 9m33s
[04:35:13.118] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:36:0)
[04:35:13.143] Build status: STARTED
[04:35:13.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:37:0) after 3m21s
[04:38:34.194] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:37:0)
[04:38:34.234] Build status: STARTED
[04:38:34.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:38:0) after 9m23s
[04:47:57.398] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:38:0)
[04:47:57.421] Build status: STARTED
[04:47:57.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:39:0) after 9m45s
[04:57:42.447] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:39:0)
[04:57:42.464] Build status: STARTED
[04:57:42.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:40:0) after 5m24s
[05:03:06.492] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:40:0)
[05:03:06.513] Build status: STARTED
[05:03:06.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:41:0) after 6m13s
[05:09:19.580] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:41:0)
[05:09:19.599] Build status: STARTED
[05:09:19.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:42:0) after 2m16s
[05:11:35.618] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:42:0)
[05:11:35.638] Build status: STARTED
[05:11:35.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:43:0) after 1m3s
[05:12:38.751] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:43:0)
[05:12:38.774] Build status: STARTED
[05:12:38.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:44:0) after 6m9s
[05:18:47.798] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:44:0)
[05:18:47.818] Build status: STARTED
[05:18:47.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:45:0) after 8m11s
[05:26:58.872] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:45:0)
[05:26:58.912] Build status: STARTED
[05:26:58.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:46:0) after 9m30s
[05:36:29.039] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:46:0)
[05:36:29.064] Build status: STARTED
[05:36:29.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:47:0) after 5m27s
[05:41:56.097] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:47:0)
[05:41:56.116] Build status: STARTED
[05:41:56.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:48:0) after 6m6s
[05:48:02.136] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:48:0)
[05:48:02.155] Build status: STARTED
[05:48:02.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8833526956114495328:49:0) after 9m1s
[05:49:23.019] Received PubSub notification, asking Buildbucket for the build status
[05:49:23.049] Build:
{
"id": "8668096894234078449",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"number": 5941,
"createdBy": "project:chromium",
"createTime": "2026-10-13T01:40:42.056633423Z",
"startTime": "2026-10-13T01:40:54.737539851Z",
"endTime": "2026-10-13T05:49:22.482557105Z",
"updateTime": "2026-10-13T05:49:22.482557105Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "48316c122f99222193832319d46ec5c57c1109bc",
"ref": "refs/heads/main"
}
},
"canary": true
}
[05:49:23.049] Invocation finished in 4h8m42.170686934s with status FAILED