[14:46:12.284] New invocation is queued and will start shortly
[14:46:13.379] Starting the invocation (attempt 1)
[14:46:13.405] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/b01d62a11f3b07e5cd754949abd04b1d879e56b4"
[14:46:13.405] Popped gitiles commit info from properties and tags
[14:46:13.405] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:46:13.405] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:46:13.406] Buildbucket request:
{
"requestId": "8851234540674004960",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b01d62a11f3b07e5cd754949abd04b1d879e56b4",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851234540674004960"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacArm64"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:46:14.071] Scheduled build:
{
"id": "8685804478781565905",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"number": 2372,
"createdBy": "project:chromium",
"createTime": "2026-03-31T14:46:13.467862894Z",
"updateTime": "2026-03-31T14:46:13.467862894Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b01d62a11f3b07e5cd754949abd04b1d879e56b4",
"ref": "refs/heads/main"
}
}
}
[14:46:14.071] Task URL: https://cr-buildbucket.appspot.com/build/8685804478781565905
[14:46:14.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:2:0) after 6m14s
[14:46:39.951] Received PubSub notification, asking Buildbucket for the build status
[14:46:39.974] Build status: STARTED
[14:46:52.274] Received PubSub notification, asking Buildbucket for the build status
[14:46:52.310] Build status: STARTED
[14:52:28.176] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:2:0)
[14:52:28.195] Build status: STARTED
[14:52:28.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:5:0) after 9m46s
[15:02:14.211] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:5:0)
[15:02:14.276] Build status: STARTED
[15:02:14.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:6:0) after 3m1s
[15:05:15.294] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:6:0)
[15:05:15.317] Build status: STARTED
[15:05:15.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:7:0) after 2m26s
[15:07:41.346] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:7:0)
[15:07:41.460] Build status: STARTED
[15:07:41.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:8:0) after 4m24s
[15:12:05.487] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:8:0)
[15:12:05.519] Build status: STARTED
[15:12:05.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:9:0) after 1m46s
[15:13:51.541] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:9:0)
[15:13:51.688] Build status: STARTED
[15:13:51.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:10:0) after 5m51s
[15:19:42.708] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:10:0)
[15:19:42.736] Build status: STARTED
[15:19:42.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:11:0) after 8m37s
[15:28:19.821] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:11:0)
[15:28:19.855] Build status: STARTED
[15:28:19.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:12:0) after 8m32s
[15:36:51.870] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:12:0)
[15:36:51.902] Build status: STARTED
[15:36:51.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:13:0) after 1m41s
[15:38:32.952] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:13:0)
[15:38:32.969] Build status: STARTED
[15:38:32.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:14:0) after 9m47s
[15:48:20.007] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:14:0)
[15:48:20.033] Build status: STARTED
[15:48:20.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:15:0) after 4m47s
[15:53:07.146] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:15:0)
[15:53:07.166] Build status: STARTED
[15:53:07.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:16:0) after 4m17s
[15:57:24.365] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:16:0)
[15:57:24.384] Build status: STARTED
[15:57:24.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:17:0) after 4m20s
[16:01:44.373] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:17:0)
[16:01:44.391] Build status: STARTED
[16:01:44.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:18:0) after 3m12s
[16:04:56.449] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:18:0)
[16:04:56.474] Build status: STARTED
[16:04:56.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:19:0) after 7m1s
[16:11:57.545] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:19:0)
[16:11:57.567] Build status: STARTED
[16:11:57.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:20:0) after 6m29s
[16:18:26.585] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:20:0)
[16:18:26.605] Build status: STARTED
[16:18:26.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:21:0) after 3m23s
[16:21:49.633] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:21:0)
[16:21:49.729] Build status: STARTED
[16:21:49.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:22:0) after 9m16s
[16:31:05.762] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:22:0)
[16:31:05.804] Build status: STARTED
[16:31:05.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:23:0) after 4m34s
[16:35:39.877] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:23:0)
[16:35:39.896] Build status: STARTED
[16:35:39.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:24:0) after 3m26s
[16:39:05.911] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:24:0)
[16:39:05.930] Build status: STARTED
[16:39:05.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:25:0) after 1m8s
[16:40:14.000] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:25:0)
[16:40:14.026] Build status: STARTED
[16:40:14.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:26:0) after 7m16s
[16:47:30.073] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:26:0)
[16:47:30.088] Build status: STARTED
[16:47:30.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:27:0) after 3m2s
[16:50:32.088] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:27:0)
[16:50:32.103] Build status: STARTED
[16:50:32.103] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:28:0) after 5m17s
[16:55:49.208] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:28:0)
[16:55:49.225] Build status: STARTED
[16:55:49.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:29:0) after 8m34s
[17:04:23.293] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:29:0)
[17:04:23.314] Build status: STARTED
[17:04:23.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:30:0) after 2m2s
[17:06:25.332] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:30:0)
[17:06:25.401] Build status: STARTED
[17:06:25.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:31:0) after 3m26s
[17:09:51.421] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:31:0)
[17:09:51.506] Build status: STARTED
[17:09:51.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:32:0) after 9m52s
[17:19:43.559] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:32:0)
[17:19:43.579] Build status: STARTED
[17:19:43.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:33:0) after 2m48s
[17:22:31.598] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:33:0)
[17:22:31.616] Build status: STARTED
[17:22:31.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:34:0) after 1m31s
[17:24:02.650] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:34:0)
[17:24:02.669] Build status: STARTED
[17:24:02.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:35:0) after 8m0s
[17:32:02.675] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:35:0)
[17:32:02.721] Build status: STARTED
[17:32:02.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:36:0) after 4m22s
[17:36:24.750] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:36:0)
[17:36:24.772] Build status: STARTED
[17:36:24.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:37:0) after 9m27s
[17:45:51.848] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:37:0)
[17:45:51.869] Build status: STARTED
[17:45:51.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:38:0) after 5m14s
[17:51:05.930] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:38:0)
[17:51:05.969] Build status: STARTED
[17:51:05.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:39:0) after 2m40s
[17:53:45.953] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:39:0)
[17:53:45.971] Build status: STARTED
[17:53:45.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:40:0) after 7m46s
[18:01:32.074] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:40:0)
[18:01:32.096] Build status: STARTED
[18:01:32.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:41:0) after 6m26s
[18:07:58.237] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:41:0)
[18:07:58.292] Build status: STARTED
[18:07:58.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:42:0) after 2m8s
[18:10:06.384] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:42:0)
[18:10:06.402] Build status: STARTED
[18:10:06.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:43:0) after 7m17s
[18:17:23.448] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:43:0)
[18:17:23.523] Build status: STARTED
[18:17:23.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:44:0) after 9m53s
[18:27:16.532] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:44:0)
[18:27:16.553] Build status: STARTED
[18:27:16.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:45:0) after 5m22s
[18:32:38.541] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:45:0)
[18:32:38.563] Build status: STARTED
[18:32:38.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:46:0) after 9m55s
[18:42:33.720] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:46:0)
[18:42:33.737] Build status: STARTED
[18:42:33.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:47:0) after 3m10s
[18:45:43.915] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:47:0)
[18:45:44.045] Build status: STARTED
[18:45:44.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:48:0) after 8m32s
[18:54:16.070] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:48:0)
[18:54:16.092] Build status: STARTED
[18:54:16.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:49:0) after 9m42s
[19:03:58.266] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:49:0)
[19:03:58.335] Build status: STARTED
[19:03:58.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:50:0) after 8m41s
[19:12:39.431] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:50:0)
[19:12:39.493] Build status: STARTED
[19:12:39.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:51:0) after 9m18s
[19:21:57.481] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:51:0)
[19:21:57.548] Build status: STARTED
[19:21:57.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:52:0) after 5m51s
[19:27:48.631] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:52:0)
[19:27:48.662] Build status: STARTED
[19:27:48.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8851234540674004960:53:0) after 6m9s
[19:30:42.602] Received PubSub notification, asking Buildbucket for the build status
[19:30:42.662] Build:
{
"id": "8685804478781565905",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"number": 2372,
"createdBy": "project:chromium",
"createTime": "2026-03-31T14:46:13.467862894Z",
"startTime": "2026-03-31T14:46:32.173190582Z",
"endTime": "2026-03-31T19:30:42.324516261Z",
"updateTime": "2026-03-31T19:30:42.324516261Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b01d62a11f3b07e5cd754949abd04b1d879e56b4",
"ref": "refs/heads/main"
}
}
}
[19:30:42.662] Invocation finished in 4h44m30.382429076s with status FAILED