[16:38:09.294] New invocation is queued and will start shortly
[16:38:10.384] Starting the invocation (attempt 1)
[16:38:10.411] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/11ed58c42b64e942ed4b6a65c76bce460a12296c"
[16:38:10.411] Popped gitiles commit info from properties and tags
[16:38:10.411] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:38:10.412] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:38:10.412] Buildbucket request:
{
"requestId": "8874963902578005616",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "11ed58c42b64e942ed4b6a65c76bce460a12296c",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8874963902578005616"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:38:10.925] Scheduled build:
{
"id": "8709533840681777857",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 35995,
"createdBy": "project:chromium",
"createTime": "2025-07-12T16:38:10.478041211Z",
"updateTime": "2025-07-12T16:38:10.478041211Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "11ed58c42b64e942ed4b6a65c76bce460a12296c",
"ref": "refs/heads/main"
}
}
}
[16:38:10.925] Task URL: https://cr-buildbucket.appspot.com/build/8709533840681777857
[16:38:10.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:2:0) after 3m12s
[16:38:11.937] Received PubSub notification, asking Buildbucket for the build status
[16:38:11.970] Build status: SCHEDULED
[16:38:14.313] Received PubSub notification, asking Buildbucket for the build status
[16:38:14.345] Build status: STARTED
[16:41:22.931] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:2:0)
[16:41:22.948] Build status: STARTED
[16:41:22.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:5:0) after 6m2s
[16:47:24.966] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:5:0)
[16:47:26.655] Build status: STARTED
[16:47:26.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:6:0) after 8m17s
[16:55:43.618] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:6:0)
[16:55:43.644] Build status: STARTED
[16:55:43.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:7:0) after 8m29s
[17:04:12.743] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:7:0)
[17:04:12.767] Build status: STARTED
[17:04:12.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:8:0) after 5m40s
[17:09:52.796] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:8:0)
[17:09:52.819] Build status: STARTED
[17:09:52.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:9:0) after 1m30s
[17:11:22.910] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:9:0)
[17:11:22.925] Build status: STARTED
[17:11:22.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:10:0) after 5m53s
[17:17:16.094] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:10:0)
[17:17:16.111] Build status: STARTED
[17:17:16.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:11:0) after 2m8s
[17:19:24.183] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:11:0)
[17:19:24.206] Build status: STARTED
[17:19:24.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:12:0) after 8m15s
[17:27:39.248] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:12:0)
[17:27:39.270] Build status: STARTED
[17:27:39.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:13:0) after 2m19s
[17:29:59.040] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:13:0)
[17:29:59.161] Build status: STARTED
[17:29:59.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:14:0) after 3m33s
[17:33:32.324] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:14:0)
[17:33:32.341] Build status: STARTED
[17:33:32.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:15:0) after 7m50s
[17:41:22.359] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:15:0)
[17:41:22.376] Build status: STARTED
[17:41:22.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:16:0) after 5m27s
[17:46:49.395] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:16:0)
[17:46:49.428] Build status: STARTED
[17:46:49.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:17:0) after 1m4s
[17:47:53.458] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:17:0)
[17:47:53.486] Build status: STARTED
[17:47:53.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:18:0) after 2m47s
[17:50:40.511] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:18:0)
[17:50:40.533] Build status: STARTED
[17:50:40.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:19:0) after 5m48s
[17:56:28.559] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:19:0)
[17:56:28.608] Build status: STARTED
[17:56:28.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:20:0) after 5m18s
[18:01:46.681] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:20:0)
[18:01:46.707] Build status: STARTED
[18:01:46.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:21:0) after 2m58s
[18:04:45.094] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:21:0)
[18:04:45.132] Build status: STARTED
[18:04:45.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:22:0) after 7m43s
[18:12:28.177] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:22:0)
[18:12:28.197] Build status: STARTED
[18:12:28.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:23:0) after 3m53s
[18:16:21.320] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:23:0)
[18:16:21.339] Build status: STARTED
[18:16:21.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:24:0) after 5m0s
[18:21:21.512] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:24:0)
[18:21:21.531] Build status: STARTED
[18:21:21.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:25:0) after 4m19s
[18:25:40.561] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:25:0)
[18:25:40.578] Build status: STARTED
[18:25:40.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:26:0) after 8m20s
[18:34:00.598] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:26:0)
[18:34:00.613] Build status: STARTED
[18:34:00.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:27:0) after 6m10s
[18:40:10.635] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:27:0)
[18:40:10.657] Build status: STARTED
[18:40:10.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:28:0) after 4m44s
[18:44:54.718] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:28:0)
[18:44:54.749] Build status: STARTED
[18:44:54.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:29:0) after 6m30s
[18:51:25.164] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:29:0)
[18:51:25.182] Build status: STARTED
[18:51:25.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:30:0) after 1m34s
[18:52:59.318] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:30:0)
[18:52:59.335] Build status: STARTED
[18:52:59.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:31:0) after 3m2s
[18:56:01.383] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:31:0)
[18:56:01.412] Build status: STARTED
[18:56:01.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:32:0) after 6m5s
[19:02:06.604] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:32:0)
[19:02:06.637] Build status: STARTED
[19:02:06.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:33:0) after 9m59s
[19:12:05.670] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:33:0)
[19:12:05.691] Build status: STARTED
[19:12:05.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:34:0) after 8m15s
[19:20:20.741] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:34:0)
[19:20:20.767] Build status: STARTED
[19:20:20.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:35:0) after 4m33s
[19:24:53.912] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:35:0)
[19:24:53.930] Build status: STARTED
[19:24:53.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:36:0) after 5m59s
[19:30:52.953] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:36:0)
[19:30:52.971] Build status: STARTED
[19:30:52.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:37:0) after 8m56s
[19:39:48.991] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:37:0)
[19:39:49.079] Build status: STARTED
[19:39:49.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:38:0) after 2m22s
[19:42:11.120] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:38:0)
[19:42:11.138] Build status: STARTED
[19:42:11.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:39:0) after 4m22s
[19:46:33.162] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:39:0)
[19:46:33.179] Build status: STARTED
[19:46:33.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:40:0) after 6m7s
[19:52:40.285] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:40:0)
[19:52:40.304] Build status: STARTED
[19:52:40.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:41:0) after 5m9s
[19:57:49.325] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:41:0)
[19:57:49.355] Build status: STARTED
[19:57:49.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:42:0) after 2m50s
[20:00:39.383] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:42:0)
[20:00:39.405] Build status: STARTED
[20:00:39.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:43:0) after 6m34s
[20:07:13.450] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:43:0)
[20:07:13.472] Build status: STARTED
[20:07:13.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:44:0) after 5m27s
[20:12:40.467] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:44:0)
[20:12:40.483] Build status: STARTED
[20:12:40.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:45:0) after 1m10s
[20:13:50.484] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:45:0)
[20:13:50.503] Build status: STARTED
[20:13:50.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:46:0) after 4m14s
[20:18:04.526] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:46:0)
[20:18:04.551] Build status: STARTED
[20:18:04.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:47:0) after 3m1s
[20:21:05.770] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:47:0)
[20:21:05.791] Build status: STARTED
[20:21:05.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:48:0) after 3m21s
[20:24:26.896] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:48:0)
[20:24:26.912] Build status: STARTED
[20:24:26.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874963902578005616:49:0) after 1m43s
[20:24:29.957] Received PubSub notification, asking Buildbucket for the build status
[20:24:29.974] Build:
{
"id": "8709533840681777857",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 35995,
"createdBy": "project:chromium",
"createTime": "2025-07-12T16:38:10.478041211Z",
"startTime": "2025-07-12T16:38:13.690687544Z",
"endTime": "2025-07-12T20:24:29.484599201Z",
"updateTime": "2025-07-12T20:24:29.484599201Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "11ed58c42b64e942ed4b6a65c76bce460a12296c",
"ref": "refs/heads/main"
}
}
}
[20:24:29.974] Invocation finished in 3h46m20.687816183s with status FAILED