[03:23:54.347] New invocation is queued and will start shortly
[03:23:55.423] Starting the invocation (attempt 1)
[03:23:55.443] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/099783167782ad56934300a25c118e9951298149"
[03:23:55.443] Popped gitiles commit info from properties and tags
[03:23:55.443] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:23:55.443] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:23:55.444] Buildbucket request:
{
"requestId": "8860880745657316944",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "099783167782ad56934300a25c118e9951298149",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8860880745657316944"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:23:55.897] Scheduled build:
{
"id": "8695450683802010833",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 30429,
"createdBy": "project:chromium",
"createTime": "2025-12-15T03:23:55.488660086Z",
"updateTime": "2025-12-15T03:23:55.488660086Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "099783167782ad56934300a25c118e9951298149",
"ref": "refs/heads/main"
}
}
}
[03:23:55.897] Task URL: https://cr-buildbucket.appspot.com/build/8695450683802010833
[03:23:55.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:2:0) after 6m40s
[03:23:56.196] Received PubSub notification, asking Buildbucket for the build status
[03:23:56.213] Build status: SCHEDULED
[03:24:03.641] Received PubSub notification, asking Buildbucket for the build status
[03:24:03.659] Build status: STARTED
[03:30:36.244] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:2:0)
[03:30:36.257] Build status: STARTED
[03:30:36.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:5:0) after 7m59s
[03:38:35.223] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:5:0)
[03:38:35.239] Build status: STARTED
[03:38:35.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:6:0) after 8m46s
[03:47:21.252] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:6:0)
[03:47:21.274] Build status: STARTED
[03:47:21.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:7:0) after 1m6s
[03:48:27.306] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:7:0)
[03:48:27.330] Build status: STARTED
[03:48:27.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:8:0) after 4m1s
[03:52:28.336] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:8:0)
[03:52:28.379] Build status: STARTED
[03:52:28.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:9:0) after 3m25s
[03:55:53.446] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:9:0)
[03:55:53.464] Build status: STARTED
[03:55:53.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:10:0) after 7m37s
[04:03:30.510] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:10:0)
[04:03:30.524] Build status: STARTED
[04:03:30.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:11:0) after 4m18s
[04:07:48.691] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:11:0)
[04:07:48.709] Build status: STARTED
[04:07:48.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:12:0) after 4m34s
[04:12:22.825] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:12:0)
[04:12:22.842] Build status: STARTED
[04:12:22.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:13:0) after 7m15s
[04:19:37.853] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:13:0)
[04:19:37.868] Build status: STARTED
[04:19:37.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:14:0) after 1m13s
[04:20:50.981] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:14:0)
[04:20:50.995] Build status: STARTED
[04:20:50.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:15:0) after 9m56s
[04:30:47.032] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:15:0)
[04:30:47.046] Build status: STARTED
[04:30:47.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:16:0) after 5m40s
[04:36:27.058] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:16:0)
[04:36:27.080] Build status: STARTED
[04:36:27.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:17:0) after 2m16s
[04:38:43.166] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:17:0)
[04:38:43.183] Build status: STARTED
[04:38:43.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:18:0) after 1m10s
[04:39:53.198] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:18:0)
[04:39:53.216] Build status: STARTED
[04:39:53.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:19:0) after 5m47s
[04:45:40.237] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:19:0)
[04:45:40.253] Build status: STARTED
[04:45:40.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:20:0) after 6m44s
[04:52:24.318] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:20:0)
[04:52:24.340] Build status: STARTED
[04:52:24.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:21:0) after 7m22s
[04:59:46.361] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:21:0)
[04:59:46.376] Build status: STARTED
[04:59:46.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:22:0) after 8m18s
[05:08:04.432] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:22:0)
[05:08:04.447] Build status: STARTED
[05:08:04.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:23:0) after 4m21s
[05:12:25.467] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:23:0)
[05:12:25.486] Build status: STARTED
[05:12:25.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:24:0) after 2m8s
[05:14:33.609] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:24:0)
[05:14:33.630] Build status: STARTED
[05:14:33.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:25:0) after 2m2s
[05:16:35.644] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:25:0)
[05:16:35.702] Build status: STARTED
[05:16:35.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:26:0) after 7m23s
[05:23:58.715] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:26:0)
[05:23:58.733] Build status: STARTED
[05:23:58.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:27:0) after 5m23s
[05:29:21.747] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:27:0)
[05:29:21.761] Build status: STARTED
[05:29:21.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:28:0) after 3m22s
[05:32:43.778] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:28:0)
[05:32:43.804] Build status: STARTED
[05:32:43.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:29:0) after 6m0s
[05:38:43.884] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:29:0)
[05:38:43.912] Build status: STARTED
[05:38:43.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:30:0) after 8m43s
[05:47:27.020] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:30:0)
[05:47:27.038] Build status: STARTED
[05:47:27.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:31:0) after 1m58s
[05:49:25.050] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:31:0)
[05:49:25.066] Build status: STARTED
[05:49:25.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:32:0) after 3m6s
[05:52:31.143] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:32:0)
[05:52:31.156] Build status: STARTED
[05:52:31.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:33:0) after 9m2s
[06:01:33.278] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:33:0)
[06:01:33.293] Build status: STARTED
[06:01:33.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:34:0) after 2m29s
[06:04:02.382] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:34:0)
[06:04:02.398] Build status: STARTED
[06:04:02.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:35:0) after 5m34s
[06:09:36.410] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:35:0)
[06:09:36.514] Build status: STARTED
[06:09:36.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:36:0) after 1m32s
[06:11:08.780] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:36:0)
[06:11:08.809] Build status: STARTED
[06:11:08.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:37:0) after 7m27s
[06:18:36.069] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:37:0)
[06:18:36.084] Build status: STARTED
[06:18:36.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:38:0) after 1m39s
[06:20:15.102] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:38:0)
[06:20:15.124] Build status: STARTED
[06:20:15.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:39:0) after 2m35s
[06:22:50.138] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:39:0)
[06:22:50.156] Build status: STARTED
[06:22:50.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:40:0) after 2m18s
[06:25:08.277] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:40:0)
[06:25:08.293] Build status: STARTED
[06:25:08.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:41:0) after 8m27s
[06:33:35.318] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:41:0)
[06:33:35.339] Build status: STARTED
[06:33:35.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:42:0) after 6m1s
[06:39:36.413] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:42:0)
[06:39:36.428] Build status: STARTED
[06:39:36.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:43:0) after 5m12s
[06:44:48.515] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:43:0)
[06:44:48.532] Build status: STARTED
[06:44:48.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:44:0) after 2m20s
[06:47:08.704] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:44:0)
[06:47:08.725] Build status: STARTED
[06:47:08.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:45:0) after 4m12s
[06:51:20.737] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:45:0)
[06:51:20.797] Build status: STARTED
[06:51:20.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:46:0) after 9m42s
[07:01:03.239] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:46:0)
[07:01:03.260] Build status: STARTED
[07:01:03.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:47:0) after 3m48s
[07:04:51.324] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:47:0)
[07:04:51.353] Build status: STARTED
[07:04:51.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:48:0) after 2m57s
[07:07:48.368] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:48:0)
[07:07:48.384] Build status: STARTED
[07:07:48.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860880745657316944:49:0) after 2m22s
[07:10:01.260] Received PubSub notification, asking Buildbucket for the build status
[07:10:01.272] Build:
{
"id": "8695450683802010833",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 30429,
"createdBy": "project:chromium",
"createTime": "2025-12-15T03:23:55.488660086Z",
"startTime": "2025-12-15T03:24:03.464288616Z",
"endTime": "2025-12-15T07:10:01.046048272Z",
"updateTime": "2025-12-15T07:10:01.046048272Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "099783167782ad56934300a25c118e9951298149",
"ref": "refs/heads/main"
}
}
}
[07:10:01.273] Invocation finished in 3h46m6.938003473s with status FAILED