[14:02:21.247] New invocation is queued and will start shortly
[14:02:22.456] Starting the invocation (attempt 1)
[14:02:22.486] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/ace38859fcb3f8fe1e3c1923382a50ef2743f72f"
[14:02:22.486] Popped gitiles commit info from properties and tags
[14:02:22.486] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:02:22.486] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:02:22.487] Buildbucket request:
{
"requestId": "8851599687382351200",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ace38859fcb3f8fe1e3c1923382a50ef2743f72f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851599687382351200"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:02:23.106] Scheduled build:
{
"id": "8686169625360858145",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 39551,
"createdBy": "project:chromium",
"createTime": "2026-03-27T14:02:22.553816365Z",
"updateTime": "2026-03-27T14:02:22.553816365Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ace38859fcb3f8fe1e3c1923382a50ef2743f72f",
"ref": "refs/heads/main"
}
}
}
[14:02:23.106] Task URL: https://cr-buildbucket.appspot.com/build/8686169625360858145
[14:02:23.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:2:0) after 6m19s
[14:02:23.967] Received PubSub notification, asking Buildbucket for the build status
[14:02:23.989] Build status: SCHEDULED
[14:03:03.159] Received PubSub notification, asking Buildbucket for the build status
[14:03:03.221] Build status: STARTED
[14:08:42.084] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:2:0)
[14:08:42.110] Build status: STARTED
[14:08:42.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:5:0) after 9m8s
[14:17:50.102] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:5:0)
[14:17:50.167] Build status: STARTED
[14:17:50.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:6:0) after 4m46s
[14:22:36.199] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:6:0)
[14:22:36.233] Build status: STARTED
[14:22:36.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:7:0) after 2m46s
[14:25:22.302] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:7:0)
[14:25:22.355] Build status: STARTED
[14:25:22.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:8:0) after 6m18s
[14:31:40.439] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:8:0)
[14:31:40.457] Build status: STARTED
[14:31:40.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:9:0) after 3m51s
[14:35:31.480] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:9:0)
[14:35:31.556] Build status: STARTED
[14:35:31.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:10:0) after 9m32s
[14:45:03.586] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:10:0)
[14:45:03.616] Build status: STARTED
[14:45:03.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:11:0) after 2m44s
[14:47:47.601] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:11:0)
[14:47:47.619] Build status: STARTED
[14:47:47.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:12:0) after 6m9s
[14:53:56.637] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:12:0)
[14:53:56.661] Build status: STARTED
[14:53:56.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:13:0) after 2m16s
[14:56:12.677] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:13:0)
[14:56:12.723] Build status: STARTED
[14:56:12.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:14:0) after 1m25s
[14:57:37.894] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:14:0)
[14:57:37.915] Build status: STARTED
[14:57:37.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:15:0) after 7m23s
[15:05:00.936] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:15:0)
[15:05:00.956] Build status: STARTED
[15:05:00.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:16:0) after 5m25s
[15:10:26.052] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:16:0)
[15:10:26.076] Build status: STARTED
[15:10:26.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:17:0) after 4m36s
[15:15:02.108] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:17:0)
[15:15:02.157] Build status: STARTED
[15:15:02.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:18:0) after 2m19s
[15:17:21.230] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:18:0)
[15:17:21.249] Build status: STARTED
[15:17:21.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:19:0) after 9m21s
[15:26:42.403] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:19:0)
[15:26:42.483] Build status: STARTED
[15:26:42.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:20:0) after 1m14s
[15:27:56.454] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:20:0)
[15:27:56.475] Build status: STARTED
[15:27:56.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:21:0) after 4m27s
[15:32:23.545] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:21:0)
[15:32:23.583] Build status: STARTED
[15:32:23.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:22:0) after 2m48s
[15:35:11.629] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:22:0)
[15:35:11.659] Build status: STARTED
[15:35:11.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:23:0) after 2m27s
[15:37:38.771] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:23:0)
[15:37:38.789] Build status: STARTED
[15:37:38.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:24:0) after 1m11s
[15:38:49.775] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:24:0)
[15:38:49.805] Build status: STARTED
[15:38:49.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:25:0) after 4m40s
[15:43:29.801] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:25:0)
[15:43:29.818] Build status: STARTED
[15:43:29.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:26:0) after 1m15s
[15:44:44.838] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:26:0)
[15:44:44.853] Build status: STARTED
[15:44:44.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:27:0) after 3m9s
[15:47:53.875] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:27:0)
[15:47:53.891] Build status: STARTED
[15:47:53.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:28:0) after 8m46s
[15:56:39.910] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:28:0)
[15:56:39.925] Build status: STARTED
[15:56:39.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:29:0) after 9m49s
[16:06:29.180] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:29:0)
[16:06:29.199] Build status: STARTED
[16:06:29.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:30:0) after 8m31s
[16:15:00.301] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:30:0)
[16:15:00.319] Build status: STARTED
[16:15:00.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:31:0) after 9m38s
[16:24:38.366] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:31:0)
[16:24:38.383] Build status: STARTED
[16:24:38.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:32:0) after 7m8s
[16:31:46.487] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:32:0)
[16:31:46.507] Build status: STARTED
[16:31:46.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:33:0) after 8m49s
[16:40:35.542] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:33:0)
[16:40:35.561] Build status: STARTED
[16:40:35.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:34:0) after 4m38s
[16:45:13.586] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:34:0)
[16:45:13.642] Build status: STARTED
[16:45:13.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:35:0) after 7m38s
[16:52:51.617] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:35:0)
[16:52:51.639] Build status: STARTED
[16:52:51.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:36:0) after 1m47s
[16:54:38.675] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:36:0)
[16:54:38.698] Build status: STARTED
[16:54:38.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:37:0) after 2m29s
[16:57:07.722] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:37:0)
[16:57:07.742] Build status: STARTED
[16:57:07.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:38:0) after 9m41s
[17:06:48.797] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:38:0)
[17:06:48.815] Build status: STARTED
[17:06:48.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:39:0) after 9m13s
[17:16:01.889] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:39:0)
[17:16:01.963] Build status: STARTED
[17:16:01.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851599687382351200:40:0) after 5m0s
[17:17:06.988] Received PubSub notification, asking Buildbucket for the build status
[17:17:07.033] Build:
{
"id": "8686169625360858145",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 39551,
"createdBy": "project:chromium",
"createTime": "2026-03-27T14:02:22.553816365Z",
"startTime": "2026-03-27T14:03:02.964939866Z",
"endTime": "2026-03-27T17:17:05.449668187Z",
"updateTime": "2026-03-27T17:17:05.449668187Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ace38859fcb3f8fe1e3c1923382a50ef2743f72f",
"ref": "refs/heads/main"
}
}
}
[17:17:07.033] Invocation finished in 3h14m45.791999239s with status FAILED