[23:36:03.036] New invocation is queued and will start shortly
[23:36:04.169] Starting the invocation (attempt 1)
[23:36:04.194] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/ab724828a412533db8c09efa29d6c702d779851e"
[23:36:04.194] Popped gitiles commit info from properties and tags
[23:36:04.194] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:36:04.194] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:36:04.194] Buildbucket request:
{
"requestId": "8851472996560329840",
"builder": {
"project": "chromium",
"bucket": "build",
"builder": "mac-build-perf-ninja"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ab724828a412533db8c09efa29d6c702d779851e",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851472996560329840"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-build-perf-ninja"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:36:04.867] Scheduled build:
{
"id": "8686042934606189201",
"builder": {
"project": "chromium",
"bucket": "build",
"builder": "mac-build-perf-ninja"
},
"number": 16478,
"createdBy": "project:chromium",
"createTime": "2026-03-28T23:36:04.272934964Z",
"updateTime": "2026-03-28T23:36:04.272934964Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ab724828a412533db8c09efa29d6c702d779851e",
"ref": "refs/heads/main"
}
}
}
[23:36:04.867] Task URL: https://cr-buildbucket.appspot.com/build/8686042934606189201
[23:36:04.867] Scheduling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:2:0) after 6m29s
[23:36:17.697] Received PubSub notification, asking Buildbucket for the build status
[23:36:17.757] Build status: STARTED
[23:36:20.326] Received PubSub notification, asking Buildbucket for the build status
[23:36:20.343] Build status: STARTED
[23:42:33.938] Handling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:2:0)
[23:42:33.960] Build status: STARTED
[23:42:33.960] Scheduling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:5:0) after 7m9s
[23:49:42.999] Handling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:5:0)
[23:49:43.013] Build status: STARTED
[23:49:43.013] Scheduling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:6:0) after 5m35s
[23:55:18.033] Handling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:6:0)
[23:55:18.051] Build status: STARTED
[23:55:18.051] Scheduling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:7:0) after 5m47s
[00:01:05.054] Handling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:7:0)
[00:01:05.081] Build status: STARTED
[00:01:05.081] Scheduling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:8:0) after 6m56s
[00:08:01.113] Handling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:8:0)
[00:08:01.129] Build status: STARTED
[00:08:01.129] Scheduling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:9:0) after 3m58s
[00:11:59.108] Handling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:9:0)
[00:11:59.220] Build status: STARTED
[00:11:59.221] Scheduling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:10:0) after 5m54s
[00:17:53.262] Handling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:10:0)
[00:17:53.312] Build status: STARTED
[00:17:53.312] Scheduling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:11:0) after 8m17s
[00:26:10.471] Handling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:11:0)
[00:26:10.538] Build status: STARTED
[00:26:10.538] Scheduling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:12:0) after 6m10s
[00:32:20.551] Handling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:12:0)
[00:32:20.612] Build status: STARTED
[00:32:20.612] Scheduling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:13:0) after 4m41s
[00:37:01.697] Handling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:13:0)
[00:37:01.755] Build status: STARTED
[00:37:01.755] Scheduling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:14:0) after 7m40s
[00:44:41.801] Handling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:14:0)
[00:44:41.826] Build status: STARTED
[00:44:41.826] Scheduling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:15:0) after 3m29s
[00:48:11.041] Handling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:15:0)
[00:48:11.060] Build status: STARTED
[00:48:11.060] Scheduling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:16:0) after 4m3s
[00:52:14.074] Handling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:16:0)
[00:52:14.101] Build status: STARTED
[00:52:14.101] Scheduling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:17:0) after 6m30s
[00:58:44.114] Handling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:17:0)
[00:58:44.134] Build status: STARTED
[00:58:44.134] Scheduling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:18:0) after 6m41s
[01:05:25.278] Handling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:18:0)
[01:05:25.294] Build status: STARTED
[01:05:25.294] Scheduling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:19:0) after 8m40s
[01:14:05.597] Handling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:19:0)
[01:14:05.618] Build status: STARTED
[01:14:05.618] Scheduling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:20:0) after 7m7s
[01:21:12.636] Handling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:20:0)
[01:21:12.652] Build status: STARTED
[01:21:12.653] Scheduling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:21:0) after 4m37s
[01:25:49.669] Handling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:21:0)
[01:25:49.691] Build status: STARTED
[01:25:49.691] Scheduling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:22:0) after 3m40s
[01:29:29.708] Handling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:22:0)
[01:29:29.727] Build status: STARTED
[01:29:29.727] Scheduling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:23:0) after 6m38s
[01:36:07.746] Handling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:23:0)
[01:36:07.823] Build status: STARTED
[01:36:07.823] Scheduling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:24:0) after 1m9s
[01:37:16.888] Handling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:24:0)
[01:37:16.908] Build status: STARTED
[01:37:16.908] Scheduling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:25:0) after 5m10s
[01:42:27.059] Handling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:25:0)
[01:42:27.073] Build status: STARTED
[01:42:27.073] Scheduling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:26:0) after 9m2s
[01:51:29.070] Handling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:26:0)
[01:51:29.169] Build status: STARTED
[01:51:29.169] Scheduling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:27:0) after 6m32s
[01:58:01.591] Handling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:27:0)
[01:58:01.614] Build status: STARTED
[01:58:01.614] Scheduling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:28:0) after 9m51s
[02:07:52.718] Handling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:28:0)
[02:07:52.743] Build status: STARTED
[02:07:52.743] Scheduling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:29:0) after 4m1s
[02:11:53.800] Handling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:29:0)
[02:11:53.819] Build status: STARTED
[02:11:53.819] Scheduling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:30:0) after 9m2s
[02:20:55.815] Handling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:30:0)
[02:20:55.851] Build status: STARTED
[02:20:55.851] Scheduling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:31:0) after 1m1s
[02:21:56.856] Handling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:31:0)
[02:21:56.902] Build status: STARTED
[02:21:56.902] Scheduling timer "check-buildbucket-build-status" (chromium/mac-build-perf-ninja:8851472996560329840:32:0) after 7m48s
[02:23:46.570] Received PubSub notification, asking Buildbucket for the build status
[02:23:46.591] Build:
{
"id": "8686042934606189201",
"builder": {
"project": "chromium",
"bucket": "build",
"builder": "mac-build-perf-ninja"
},
"number": 16478,
"createdBy": "project:chromium",
"createTime": "2026-03-28T23:36:04.272934964Z",
"startTime": "2026-03-28T23:36:08.424732697Z",
"endTime": "2026-03-29T02:23:46.366601649Z",
"updateTime": "2026-03-29T02:23:46.366601649Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ab724828a412533db8c09efa29d6c702d779851e",
"ref": "refs/heads/main"
}
}
}
[02:23:46.591] Invocation finished in 2h47m43.567375499s with status FAILED