[20:59:17.088] New invocation is queued and will start shortly
[20:59:18.223] Starting the invocation (attempt 1)
[20:59:18.248] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/23f6325a33f8b69536dcd9b933deb4264a22fc37"
[20:59:18.249] Popped gitiles commit info from properties and tags
[20:59:18.249] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:59:18.251] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:59:18.251] Buildbucket request:
{
"requestId": "8864438225599224512",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "23f6325a33f8b69536dcd9b933deb4264a22fc37",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8864438225599224512"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:59:18.784] Scheduled build:
{
"id": "8699008163677991137",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 29840,
"createdBy": "project:chromium",
"createTime": "2025-11-05T20:59:18.300608666Z",
"updateTime": "2025-11-05T20:59:18.300608666Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "23f6325a33f8b69536dcd9b933deb4264a22fc37",
"ref": "refs/heads/main"
}
}
}
[20:59:18.784] Task URL: https://cr-buildbucket.appspot.com/build/8699008163677991137
[20:59:18.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:2:0) after 8m18s
[20:59:19.763] Received PubSub notification, asking Buildbucket for the build status
[20:59:19.808] Build status: SCHEDULED
[21:03:31.408] Received PubSub notification, asking Buildbucket for the build status
[21:03:31.430] Build status: STARTED
[21:07:36.809] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:2:0)
[21:07:36.831] Build status: STARTED
[21:07:36.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:5:0) after 4m13s
[21:11:49.898] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:5:0)
[21:11:49.925] Build status: STARTED
[21:11:49.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:6:0) after 4m4s
[21:15:53.975] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:6:0)
[21:15:54.002] Build status: STARTED
[21:15:54.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:7:0) after 4m58s
[21:20:52.016] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:7:0)
[21:20:52.031] Build status: STARTED
[21:20:52.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:8:0) after 6m58s
[21:27:50.075] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:8:0)
[21:27:50.107] Build status: STARTED
[21:27:50.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:9:0) after 4m11s
[21:32:01.232] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:9:0)
[21:32:01.406] Build status: STARTED
[21:32:01.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:10:0) after 8m15s
[21:40:16.464] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:10:0)
[21:40:16.540] Build status: STARTED
[21:40:16.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:11:0) after 6m27s
[21:46:43.548] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:11:0)
[21:46:43.564] Build status: STARTED
[21:46:43.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:12:0) after 9m44s
[21:56:27.583] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:12:0)
[21:56:27.598] Build status: STARTED
[21:56:27.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:13:0) after 9m0s
[22:05:27.633] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:13:0)
[22:05:27.704] Build status: STARTED
[22:05:27.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:14:0) after 3m34s
[22:09:01.703] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:14:0)
[22:09:01.720] Build status: STARTED
[22:09:01.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:15:0) after 2m42s
[22:11:43.763] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:15:0)
[22:11:43.778] Build status: STARTED
[22:11:43.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:16:0) after 3m23s
[22:15:06.793] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:16:0)
[22:15:06.818] Build status: STARTED
[22:15:06.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:17:0) after 4m8s
[22:19:14.873] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:17:0)
[22:19:14.902] Build status: STARTED
[22:19:14.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:18:0) after 5m38s
[22:24:52.926] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:18:0)
[22:24:52.943] Build status: STARTED
[22:24:52.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:19:0) after 6m43s
[22:31:36.012] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:19:0)
[22:31:36.082] Build status: STARTED
[22:31:36.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:20:0) after 6m49s
[22:38:25.153] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:20:0)
[22:38:25.166] Build status: STARTED
[22:38:25.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:21:0) after 2m18s
[22:40:43.187] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:21:0)
[22:40:43.206] Build status: STARTED
[22:40:43.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:22:0) after 1m40s
[22:42:23.314] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:22:0)
[22:42:23.349] Build status: STARTED
[22:42:23.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:23:0) after 7m16s
[22:49:39.434] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:23:0)
[22:49:39.560] Build status: STARTED
[22:49:39.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:24:0) after 2m26s
[22:52:05.584] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:24:0)
[22:52:05.655] Build status: STARTED
[22:52:05.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:25:0) after 4m49s
[22:56:54.674] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:25:0)
[22:56:54.693] Build status: STARTED
[22:56:54.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:26:0) after 9m20s
[23:06:14.765] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:26:0)
[23:06:14.791] Build status: STARTED
[23:06:14.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:27:0) after 7m40s
[23:13:54.901] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:27:0)
[23:13:54.918] Build status: STARTED
[23:13:54.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:28:0) after 6m28s
[23:20:22.936] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:28:0)
[23:20:22.965] Build status: STARTED
[23:20:22.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:29:0) after 6m47s
[23:27:09.985] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:29:0)
[23:27:10.001] Build status: STARTED
[23:27:10.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:30:0) after 1m28s
[23:28:38.024] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:30:0)
[23:28:38.052] Build status: STARTED
[23:28:38.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:31:0) after 3m30s
[23:32:08.068] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:31:0)
[23:32:08.084] Build status: STARTED
[23:32:08.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:32:0) after 7m4s
[23:39:12.144] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:32:0)
[23:39:12.161] Build status: STARTED
[23:39:12.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:33:0) after 4m18s
[23:43:30.253] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:33:0)
[23:43:30.266] Build status: STARTED
[23:43:30.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:34:0) after 2m51s
[23:46:21.281] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:34:0)
[23:46:21.299] Build status: STARTED
[23:46:21.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:35:0) after 8m59s
[23:55:20.319] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:35:0)
[23:55:20.342] Build status: STARTED
[23:55:20.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:36:0) after 2m40s
[23:58:00.424] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:36:0)
[23:58:00.440] Build status: STARTED
[23:58:00.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:37:0) after 1m59s
[23:59:59.411] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:37:0)
[23:59:59.438] Build status: STARTED
[23:59:59.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:38:0) after 1m8s
[00:01:07.415] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:38:0)
[00:01:07.432] Build status: STARTED
[00:01:07.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:39:0) after 6m27s
[00:07:34.479] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:39:0)
[00:07:34.496] Build status: STARTED
[00:07:34.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:40:0) after 9m52s
[00:17:26.615] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:40:0)
[00:17:26.630] Build status: STARTED
[00:17:26.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:41:0) after 8m16s
[00:25:42.651] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:41:0)
[00:25:42.683] Build status: STARTED
[00:25:42.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:42:0) after 3m0s
[00:28:42.706] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:42:0)
[00:28:42.721] Build status: STARTED
[00:28:42.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:43:0) after 5m25s
[00:34:07.744] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:43:0)
[00:34:07.763] Build status: STARTED
[00:34:07.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:44:0) after 8m18s
[00:42:25.832] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:44:0)
[00:42:25.847] Build status: STARTED
[00:42:25.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:45:0) after 2m41s
[00:45:06.886] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:45:0)
[00:45:06.907] Build status: STARTED
[00:45:06.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8864438225599224512:46:0) after 9m35s
[00:50:43.965] Received PubSub notification, asking Buildbucket for the build status
[00:50:43.976] Build:
{
"id": "8699008163677991137",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 29840,
"createdBy": "project:chromium",
"createTime": "2025-11-05T20:59:18.300608666Z",
"startTime": "2025-11-05T21:03:31.173673402Z",
"endTime": "2025-11-06T00:50:43.741677625Z",
"updateTime": "2025-11-06T00:50:43.741677625Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "23f6325a33f8b69536dcd9b933deb4264a22fc37",
"ref": "refs/heads/main"
}
}
}
[00:50:43.976] Invocation finished in 3h51m26.892271428s with status FAILED