[22:41:01.002] New invocation is queued and will start shortly
[22:41:02.645] Starting the invocation (attempt 1)
[22:41:02.672] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/76cc3614f9fbd794aa0abde5f3a0335d87370f3b"
[22:41:02.672] Popped gitiles commit info from properties and tags
[22:41:02.672] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:41:02.672] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:41:02.672] Buildbucket request:
{
"requestId": "8863163467660290944",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "76cc3614f9fbd794aa0abde5f3a0335d87370f3b",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8863163467660290944"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:41:03.322] Scheduled build:
{
"id": "8697733405147272017",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 29948,
"createdBy": "project:chromium",
"createTime": "2025-11-19T22:41:02.770386504Z",
"updateTime": "2025-11-19T22:41:02.770386504Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "76cc3614f9fbd794aa0abde5f3a0335d87370f3b",
"ref": "refs/heads/main"
}
}
}
[22:41:03.322] Task URL: https://cr-buildbucket.appspot.com/build/8697733405147272017
[22:41:03.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:2:0) after 3m40s
[22:41:04.384] Received PubSub notification, asking Buildbucket for the build status
[22:41:04.409] Build status: SCHEDULED
[22:41:08.153] Received PubSub notification, asking Buildbucket for the build status
[22:41:08.171] Build status: STARTED
[22:44:43.340] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:2:0)
[22:44:43.364] Build status: STARTED
[22:44:43.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:5:0) after 4m13s
[22:48:56.351] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:5:0)
[22:48:56.370] Build status: STARTED
[22:48:56.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:6:0) after 1m27s
[22:50:23.388] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:6:0)
[22:50:23.421] Build status: STARTED
[22:50:23.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:7:0) after 1m23s
[22:51:46.440] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:7:0)
[22:51:46.461] Build status: STARTED
[22:51:46.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:8:0) after 8m28s
[23:00:14.479] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:8:0)
[23:00:14.503] Build status: STARTED
[23:00:14.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:9:0) after 9m3s
[23:09:17.532] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:9:0)
[23:09:17.603] Build status: STARTED
[23:09:17.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:10:0) after 5m43s
[23:15:00.598] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:10:0)
[23:15:00.620] Build status: STARTED
[23:15:00.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:11:0) after 7m12s
[23:22:12.638] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:11:0)
[23:22:12.658] Build status: STARTED
[23:22:12.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:12:0) after 7m11s
[23:29:23.708] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:12:0)
[23:29:23.765] Build status: STARTED
[23:29:23.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:13:0) after 2m5s
[23:31:28.785] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:13:0)
[23:31:28.799] Build status: STARTED
[23:31:28.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:14:0) after 1m49s
[23:33:17.856] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:14:0)
[23:33:17.873] Build status: STARTED
[23:33:17.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:15:0) after 4m59s
[23:38:16.928] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:15:0)
[23:38:16.945] Build status: STARTED
[23:38:16.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:16:0) after 8m9s
[23:46:25.960] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:16:0)
[23:46:25.987] Build status: STARTED
[23:46:25.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:17:0) after 8m13s
[23:54:39.020] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:17:0)
[23:54:39.037] Build status: STARTED
[23:54:39.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:18:0) after 4m41s
[23:59:20.073] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:18:0)
[23:59:20.089] Build status: STARTED
[23:59:20.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:19:0) after 1m14s
[00:00:34.107] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:19:0)
[00:00:34.126] Build status: STARTED
[00:00:34.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:20:0) after 2m8s
[00:02:42.170] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:20:0)
[00:02:42.183] Build status: STARTED
[00:02:42.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:21:0) after 2m17s
[00:04:59.251] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:21:0)
[00:04:59.278] Build status: STARTED
[00:04:59.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:22:0) after 3m4s
[00:08:03.311] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:22:0)
[00:08:03.328] Build status: STARTED
[00:08:03.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:23:0) after 1m3s
[00:09:06.342] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:23:0)
[00:09:06.403] Build status: STARTED
[00:09:06.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:24:0) after 1m6s
[00:10:12.564] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:24:0)
[00:10:12.578] Build status: STARTED
[00:10:12.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:25:0) after 3m55s
[00:14:07.610] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:25:0)
[00:14:07.626] Build status: STARTED
[00:14:07.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:26:0) after 1m19s
[00:15:26.646] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:26:0)
[00:15:26.665] Build status: STARTED
[00:15:26.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:27:0) after 8m20s
[00:23:46.685] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:27:0)
[00:23:46.704] Build status: STARTED
[00:23:46.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:28:0) after 9m59s
[00:33:45.858] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:28:0)
[00:33:45.900] Build status: STARTED
[00:33:45.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:29:0) after 4m23s
[00:38:08.916] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:29:0)
[00:38:08.932] Build status: STARTED
[00:38:08.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:30:0) after 3m29s
[00:41:37.951] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:30:0)
[00:41:37.966] Build status: STARTED
[00:41:37.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:31:0) after 8m17s
[00:49:55.106] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:31:0)
[00:49:55.127] Build status: STARTED
[00:49:55.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:32:0) after 5m53s
[00:55:48.197] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:32:0)
[00:55:48.210] Build status: STARTED
[00:55:48.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:33:0) after 8m58s
[01:04:46.232] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:33:0)
[01:04:46.267] Build status: STARTED
[01:04:46.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:34:0) after 1m43s
[01:06:29.286] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:34:0)
[01:06:29.306] Build status: STARTED
[01:06:29.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:35:0) after 3m44s
[01:10:13.380] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:35:0)
[01:10:13.397] Build status: STARTED
[01:10:13.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:36:0) after 3m56s
[01:14:09.481] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:36:0)
[01:14:09.495] Build status: STARTED
[01:14:09.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:37:0) after 5m14s
[01:19:23.582] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:37:0)
[01:19:23.610] Build status: STARTED
[01:19:23.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:38:0) after 6m57s
[01:26:20.706] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:38:0)
[01:26:20.721] Build status: STARTED
[01:26:20.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:39:0) after 3m52s
[01:30:12.782] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:39:0)
[01:30:12.799] Build status: STARTED
[01:30:12.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:40:0) after 4m52s
[01:35:04.822] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:40:0)
[01:35:04.836] Build status: STARTED
[01:35:04.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:41:0) after 3m10s
[01:38:14.928] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:41:0)
[01:38:14.941] Build status: STARTED
[01:38:14.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:42:0) after 7m0s
[01:45:15.017] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:42:0)
[01:45:15.030] Build status: STARTED
[01:45:15.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:43:0) after 3m20s
[01:48:35.098] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:43:0)
[01:48:35.122] Build status: STARTED
[01:48:35.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:44:0) after 3m45s
[01:52:20.155] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:44:0)
[01:52:20.174] Build status: STARTED
[01:52:20.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:45:0) after 9m25s
[02:01:45.190] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:45:0)
[02:01:45.267] Build status: STARTED
[02:01:45.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:46:0) after 2m45s
[02:04:30.252] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:46:0)
[02:04:30.269] Build status: STARTED
[02:04:30.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:47:0) after 9m42s
[02:14:12.286] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:47:0)
[02:14:12.300] Build status: STARTED
[02:14:12.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:48:0) after 8m8s
[02:22:20.416] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:48:0)
[02:22:20.436] Build status: STARTED
[02:22:20.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:49:0) after 3m51s
[02:26:11.485] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:49:0)
[02:26:11.500] Build status: STARTED
[02:26:11.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:50:0) after 4m37s
[02:30:48.599] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:50:0)
[02:30:48.633] Build status: STARTED
[02:30:48.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:51:0) after 4m46s
[02:35:34.653] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:51:0)
[02:35:34.668] Build status: STARTED
[02:35:34.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:52:0) after 2m51s
[02:38:25.737] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:52:0)
[02:38:25.753] Build status: STARTED
[02:38:25.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:53:0) after 1m36s
[02:40:01.875] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:53:0)
[02:40:01.902] Build status: STARTED
[02:40:01.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:54:0) after 9m40s
[02:49:41.918] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:54:0)
[02:49:41.934] Build status: STARTED
[02:49:41.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863163467660290944:55:0) after 8m0s
[02:51:25.737] Received PubSub notification, asking Buildbucket for the build status
[02:51:25.828] Build:
{
"id": "8697733405147272017",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 29948,
"createdBy": "project:chromium",
"createTime": "2025-11-19T22:41:02.770386504Z",
"startTime": "2025-11-19T22:41:07.990374490Z",
"endTime": "2025-11-20T02:51:25.501695976Z",
"updateTime": "2025-11-20T02:51:25.501695976Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "76cc3614f9fbd794aa0abde5f3a0335d87370f3b",
"ref": "refs/heads/main"
}
}
}
[02:51:25.828] Invocation finished in 4h10m24.838304299s with status FAILED