[09:43:19.330] New invocation is queued and will start shortly
[09:43:20.584] Starting the invocation (attempt 1)
[09:43:20.612] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/42b2d99e42e984298c54a6ae37806d237e9f99df"
[09:43:20.612] Popped gitiles commit info from properties and tags
[09:43:20.613] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[09:43:20.613] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[09:43:20.613] Buildbucket request:
{
"requestId": "8843009272453463664",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "42b2d99e42e984298c54a6ae37806d237e9f99df",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8843009272453463664"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacArm64"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[09:43:21.142] Scheduled build:
{
"id": "8677579210373359809",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"number": 3968,
"createdBy": "project:chromium",
"createTime": "2026-06-30T09:43:20.694188057Z",
"updateTime": "2026-06-30T09:43:20.694188057Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "42b2d99e42e984298c54a6ae37806d237e9f99df",
"ref": "refs/heads/main"
}
}
}
[09:43:21.143] Task URL: https://cr-buildbucket.appspot.com/build/8677579210373359809
[09:43:21.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:2:0) after 9m59s
[09:43:22.087] Received PubSub notification, asking Buildbucket for the build status
[09:43:22.102] Build status: SCHEDULED
[09:43:25.684] Received PubSub notification, asking Buildbucket for the build status
[09:43:25.698] Build status: STARTED
[09:53:20.217] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:2:0)
[09:53:20.234] Build status: STARTED
[09:53:20.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:5:0) after 9m29s
[10:02:49.253] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:5:0)
[10:02:49.275] Build status: STARTED
[10:02:49.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:6:0) after 9m26s
[10:12:15.295] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:6:0)
[10:12:15.313] Build status: STARTED
[10:12:15.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:7:0) after 9m57s
[10:22:12.338] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:7:0)
[10:22:12.355] Build status: STARTED
[10:22:12.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:8:0) after 3m21s
[10:25:33.378] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:8:0)
[10:25:33.437] Build status: STARTED
[10:25:33.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:9:0) after 3m42s
[10:29:15.482] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:9:0)
[10:29:15.504] Build status: STARTED
[10:29:15.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:10:0) after 8m44s
[10:37:59.521] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:10:0)
[10:37:59.546] Build status: STARTED
[10:37:59.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:11:0) after 1m50s
[10:39:49.571] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:11:0)
[10:39:49.586] Build status: STARTED
[10:39:49.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:12:0) after 6m32s
[10:46:21.612] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:12:0)
[10:46:21.662] Build status: STARTED
[10:46:21.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:13:0) after 2m52s
[10:49:13.690] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:13:0)
[10:49:13.709] Build status: STARTED
[10:49:13.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:14:0) after 6m23s
[10:55:36.726] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:14:0)
[10:55:36.743] Build status: STARTED
[10:55:36.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:15:0) after 5m51s
[11:01:27.856] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:15:0)
[11:01:27.873] Build status: STARTED
[11:01:27.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:16:0) after 2m50s
[11:04:17.939] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:16:0)
[11:04:17.956] Build status: STARTED
[11:04:17.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:17:0) after 8m17s
[11:12:34.982] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:17:0)
[11:12:34.998] Build status: STARTED
[11:12:34.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:18:0) after 9m25s
[11:22:00.073] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:18:0)
[11:22:00.095] Build status: STARTED
[11:22:00.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:19:0) after 6m24s
[11:28:24.161] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:19:0)
[11:28:24.177] Build status: STARTED
[11:28:24.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:20:0) after 6m14s
[11:34:38.247] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:20:0)
[11:34:38.275] Build status: STARTED
[11:34:38.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:21:0) after 9m52s
[11:44:30.331] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:21:0)
[11:44:30.351] Build status: STARTED
[11:44:30.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:22:0) after 7m10s
[11:51:40.515] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:22:0)
[11:51:40.535] Build status: STARTED
[11:51:40.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:23:0) after 3m50s
[11:55:30.563] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:23:0)
[11:55:30.578] Build status: STARTED
[11:55:30.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:24:0) after 1m15s
[11:56:45.596] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:24:0)
[11:56:45.625] Build status: STARTED
[11:56:45.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:25:0) after 8m40s
[12:05:25.674] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:25:0)
[12:05:25.700] Build status: STARTED
[12:05:25.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:26:0) after 9m57s
[12:15:22.715] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:26:0)
[12:15:22.732] Build status: STARTED
[12:15:22.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:27:0) after 6m58s
[12:22:20.851] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:27:0)
[12:22:20.868] Build status: STARTED
[12:22:20.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:28:0) after 6m49s
[12:29:09.883] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:28:0)
[12:29:09.944] Build status: STARTED
[12:29:09.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:29:0) after 5m9s
[12:34:18.964] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:29:0)
[12:34:18.983] Build status: STARTED
[12:34:18.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:30:0) after 7m37s
[12:41:56.050] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:30:0)
[12:41:56.074] Build status: STARTED
[12:41:56.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:31:0) after 8m26s
[12:50:22.095] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:31:0)
[12:50:22.114] Build status: STARTED
[12:50:22.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:32:0) after 5m30s
[12:55:52.114] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:32:0)
[12:55:52.249] Build status: STARTED
[12:55:52.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:33:0) after 1m7s
[12:56:59.270] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:33:0)
[12:56:59.285] Build status: STARTED
[12:56:59.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:34:0) after 9m24s
[13:06:23.308] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:34:0)
[13:06:23.328] Build status: STARTED
[13:06:23.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:35:0) after 3m55s
[13:10:18.606] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:35:0)
[13:10:18.623] Build status: STARTED
[13:10:18.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:36:0) after 9m37s
[13:19:55.649] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:36:0)
[13:19:55.711] Build status: STARTED
[13:19:55.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:37:0) after 3m13s
[13:23:08.815] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:37:0)
[13:23:08.830] Build status: STARTED
[13:23:08.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:38:0) after 9m34s
[13:32:42.846] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:38:0)
[13:32:42.865] Build status: STARTED
[13:32:42.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:39:0) after 9m26s
[13:42:08.881] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:39:0)
[13:42:08.900] Build status: STARTED
[13:42:08.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:40:0) after 8m16s
[13:50:24.919] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:40:0)
[13:50:24.938] Build status: STARTED
[13:50:24.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8843009272453463664:41:0) after 8m20s
[13:54:36.899] Received PubSub notification, asking Buildbucket for the build status
[13:54:36.914] Build:
{
"id": "8677579210373359809",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"number": 3968,
"createdBy": "project:chromium",
"createTime": "2026-06-30T09:43:20.694188057Z",
"startTime": "2026-06-30T09:43:25.489058715Z",
"endTime": "2026-06-30T13:54:36.334398513Z",
"updateTime": "2026-06-30T13:54:36.334398513Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "42b2d99e42e984298c54a6ae37806d237e9f99df",
"ref": "refs/heads/main"
}
}
}
[13:54:36.914] Invocation finished in 4h11m17.588488388s with status FAILED