[03:23:10.291] New invocation is queued and will start shortly
[03:23:11.454] Starting the invocation (attempt 1)
[03:23:11.477] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/32a096617715e232ac31c340e76dea4ff8826c21"
[03:23:11.477] Popped gitiles commit info from properties and tags
[03:23:11.477] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:23:11.478] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:23:11.479] Buildbucket request:
{
"requestId": "8861424373661228432",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "32a096617715e232ac31c340e76dea4ff8826c21",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8861424373661228432"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:23:12.064] Scheduled build:
{
"id": "8695994311674564561",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 30338,
"createdBy": "project:chromium",
"createTime": "2025-12-09T03:23:11.549130486Z",
"updateTime": "2025-12-09T03:23:11.549130486Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "32a096617715e232ac31c340e76dea4ff8826c21",
"ref": "refs/heads/main"
}
},
"canary": true
}
[03:23:12.064] Task URL: https://cr-buildbucket.appspot.com/build/8695994311674564561
[03:23:12.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:2:0) after 3m50s
[03:23:12.992] Received PubSub notification, asking Buildbucket for the build status
[03:23:13.020] Build status: SCHEDULED
[03:23:16.976] Received PubSub notification, asking Buildbucket for the build status
[03:23:17.006] Build status: STARTED
[03:27:02.106] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:2:0)
[03:27:02.120] Build status: STARTED
[03:27:02.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:5:0) after 6m25s
[03:33:27.187] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:5:0)
[03:33:27.281] Build status: STARTED
[03:33:27.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:6:0) after 9m37s
[03:43:04.394] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:6:0)
[03:43:04.468] Build status: STARTED
[03:43:04.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:7:0) after 1m39s
[03:44:43.482] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:7:0)
[03:44:43.508] Build status: STARTED
[03:44:43.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:8:0) after 2m19s
[03:47:02.527] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:8:0)
[03:47:02.543] Build status: STARTED
[03:47:02.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:9:0) after 7m19s
[03:54:21.564] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:9:0)
[03:54:21.578] Build status: STARTED
[03:54:21.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:10:0) after 3m36s
[03:57:57.601] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:10:0)
[03:57:57.624] Build status: STARTED
[03:57:57.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:11:0) after 2m58s
[04:00:55.642] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:11:0)
[04:00:55.658] Build status: STARTED
[04:00:55.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:12:0) after 5m37s
[04:06:32.667] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:12:0)
[04:06:32.691] Build status: STARTED
[04:06:32.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:13:0) after 9m35s
[04:16:07.712] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:13:0)
[04:16:07.728] Build status: STARTED
[04:16:07.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:14:0) after 7m17s
[04:23:24.796] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:14:0)
[04:23:24.816] Build status: STARTED
[04:23:24.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:15:0) after 1m10s
[04:24:34.821] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:15:0)
[04:24:34.841] Build status: STARTED
[04:24:34.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:16:0) after 1m34s
[04:26:08.857] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:16:0)
[04:26:08.950] Build status: STARTED
[04:26:08.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:17:0) after 9m35s
[04:35:43.945] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:17:0)
[04:35:43.968] Build status: STARTED
[04:35:43.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:18:0) after 3m2s
[04:38:45.978] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:18:0)
[04:38:45.992] Build status: STARTED
[04:38:45.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:19:0) after 7m24s
[04:46:09.978] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:19:0)
[04:46:09.994] Build status: STARTED
[04:46:09.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:20:0) after 2m35s
[04:48:45.008] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:20:0)
[04:48:45.061] Build status: STARTED
[04:48:45.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:21:0) after 2m26s
[04:51:11.078] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:21:0)
[04:51:11.102] Build status: STARTED
[04:51:11.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:22:0) after 8m27s
[04:59:38.073] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:22:0)
[04:59:38.106] Build status: STARTED
[04:59:38.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:23:0) after 7m19s
[05:06:57.198] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:23:0)
[05:06:57.244] Build status: STARTED
[05:06:57.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:24:0) after 3m37s
[05:10:34.261] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:24:0)
[05:10:34.278] Build status: STARTED
[05:10:34.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:25:0) after 7m26s
[05:18:00.297] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:25:0)
[05:18:00.315] Build status: STARTED
[05:18:00.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:26:0) after 4m10s
[05:22:10.369] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:26:0)
[05:22:10.385] Build status: STARTED
[05:22:10.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:27:0) after 9m5s
[05:31:15.397] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:27:0)
[05:31:15.416] Build status: STARTED
[05:31:15.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:28:0) after 5m22s
[05:36:37.434] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:28:0)
[05:36:37.515] Build status: STARTED
[05:36:37.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:29:0) after 8m3s
[05:44:40.533] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:29:0)
[05:44:40.547] Build status: STARTED
[05:44:40.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:30:0) after 9m33s
[05:54:13.521] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:30:0)
[05:54:13.605] Build status: STARTED
[05:54:13.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:31:0) after 6m24s
[06:00:37.641] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:31:0)
[06:00:37.949] Build status: STARTED
[06:00:37.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:32:0) after 2m23s
[06:03:01.003] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:32:0)
[06:03:01.019] Build status: STARTED
[06:03:01.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:33:0) after 5m28s
[06:08:29.717] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:33:0)
[06:08:29.775] Build status: STARTED
[06:08:29.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:34:0) after 4m54s
[06:13:23.792] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:34:0)
[06:13:23.808] Build status: STARTED
[06:13:23.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:35:0) after 8m49s
[06:22:12.835] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:35:0)
[06:22:12.850] Build status: STARTED
[06:22:12.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:36:0) after 1m52s
[06:24:04.866] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:36:0)
[06:24:04.894] Build status: STARTED
[06:24:04.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:37:0) after 6m15s
[06:30:19.940] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:37:0)
[06:30:19.954] Build status: STARTED
[06:30:19.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:38:0) after 6m30s
[06:36:50.143] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:38:0)
[06:36:50.252] Build status: STARTED
[06:36:50.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:39:0) after 9m36s
[06:46:26.267] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:39:0)
[06:46:26.322] Build status: STARTED
[06:46:26.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:40:0) after 7m46s
[06:54:12.378] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:40:0)
[06:54:12.396] Build status: STARTED
[06:54:12.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:41:0) after 6m21s
[07:00:33.408] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:41:0)
[07:00:33.421] Build status: STARTED
[07:00:33.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:42:0) after 3m7s
[07:03:40.414] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:42:0)
[07:03:40.487] Build status: STARTED
[07:03:40.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861424373661228432:43:0) after 9m32s
[07:10:23.200] Received PubSub notification, asking Buildbucket for the build status
[07:10:23.217] Build:
{
"id": "8695994311674564561",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 30338,
"createdBy": "project:chromium",
"createTime": "2025-12-09T03:23:11.549130486Z",
"startTime": "2025-12-09T03:23:16.715366980Z",
"endTime": "2025-12-09T07:10:22.919249216Z",
"updateTime": "2025-12-09T07:10:22.919249216Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "32a096617715e232ac31c340e76dea4ff8826c21",
"ref": "refs/heads/main"
}
},
"canary": true
}
[07:10:23.217] Invocation finished in 3h47m12.946731653s with status FAILED