[19:41:57.645] New invocation is queued and will start shortly
[19:41:59.106] Starting the invocation (attempt 1)
[19:41:59.137] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/644333f4ba6ae4fe19247dc76c98d6e5caead94e"
[19:41:59.137] Popped gitiles commit info from properties and tags
[19:41:59.137] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:41:59.137] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:41:59.137] Buildbucket request:
{
"requestId": "8861906375354536448",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "644333f4ba6ae4fe19247dc76c98d6e5caead94e",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8861906375354536448"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:41:59.600] Scheduled build:
{
"id": "8696476313058292801",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 30281,
"createdBy": "project:chromium",
"createTime": "2025-12-03T19:41:59.208857121Z",
"updateTime": "2025-12-03T19:41:59.208857121Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "644333f4ba6ae4fe19247dc76c98d6e5caead94e",
"ref": "refs/heads/main"
}
}
}
[19:41:59.600] Task URL: https://cr-buildbucket.appspot.com/build/8696476313058292801
[19:41:59.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:2:0) after 3m48s
[19:42:00.544] Received PubSub notification, asking Buildbucket for the build status
[19:42:00.563] Build status: SCHEDULED
[19:42:03.735] Received PubSub notification, asking Buildbucket for the build status
[19:42:03.759] Build status: STARTED
[19:45:47.637] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:2:0)
[19:45:47.662] Build status: STARTED
[19:45:47.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:5:0) after 8m56s
[19:54:43.657] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:5:0)
[19:54:43.673] Build status: STARTED
[19:54:43.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:6:0) after 6m5s
[20:00:48.689] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:6:0)
[20:00:48.708] Build status: STARTED
[20:00:48.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:7:0) after 2m42s
[20:03:30.824] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:7:0)
[20:03:30.842] Build status: STARTED
[20:03:30.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:8:0) after 3m41s
[20:07:11.907] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:8:0)
[20:07:11.922] Build status: STARTED
[20:07:11.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:9:0) after 3m39s
[20:10:50.938] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:9:0)
[20:10:50.953] Build status: STARTED
[20:10:50.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:10:0) after 5m42s
[20:16:33.069] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:10:0)
[20:16:33.120] Build status: STARTED
[20:16:33.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:11:0) after 1m53s
[20:18:26.138] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:11:0)
[20:18:26.153] Build status: STARTED
[20:18:26.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:12:0) after 5m46s
[20:24:12.309] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:12:0)
[20:24:12.322] Build status: STARTED
[20:24:12.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:13:0) after 4m18s
[20:28:30.352] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:13:0)
[20:28:30.434] Build status: STARTED
[20:28:30.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:14:0) after 5m14s
[20:33:44.547] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:14:0)
[20:33:44.565] Build status: STARTED
[20:33:44.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:15:0) after 3m34s
[20:37:18.633] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:15:0)
[20:37:18.647] Build status: STARTED
[20:37:18.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:16:0) after 1m40s
[20:38:58.791] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:16:0)
[20:38:58.806] Build status: STARTED
[20:38:58.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:17:0) after 6m23s
[20:45:21.842] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:17:0)
[20:45:21.901] Build status: STARTED
[20:45:21.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:18:0) after 8m39s
[20:54:00.919] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:18:0)
[20:54:00.936] Build status: STARTED
[20:54:00.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:19:0) after 5m53s
[20:59:53.952] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:19:0)
[20:59:53.966] Build status: STARTED
[20:59:53.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:20:0) after 2m28s
[21:02:21.981] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:20:0)
[21:02:22.126] Build status: STARTED
[21:02:22.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:21:0) after 9m41s
[21:12:03.149] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:21:0)
[21:12:03.196] Build status: STARTED
[21:12:03.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:22:0) after 7m45s
[21:19:48.239] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:22:0)
[21:19:48.265] Build status: STARTED
[21:19:48.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:23:0) after 3m12s
[21:23:00.272] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:23:0)
[21:23:00.287] Build status: STARTED
[21:23:00.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:24:0) after 4m34s
[21:27:34.344] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:24:0)
[21:27:34.362] Build status: STARTED
[21:27:34.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:25:0) after 8m19s
[21:35:53.381] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:25:0)
[21:35:53.401] Build status: STARTED
[21:35:53.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:26:0) after 2m58s
[21:38:51.539] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:26:0)
[21:38:51.571] Build status: STARTED
[21:38:51.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:27:0) after 8m40s
[21:47:31.589] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:27:0)
[21:47:31.604] Build status: STARTED
[21:47:31.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:28:0) after 4m42s
[21:52:13.619] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:28:0)
[21:52:13.634] Build status: STARTED
[21:52:13.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:29:0) after 3m26s
[21:55:39.701] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:29:0)
[21:55:39.717] Build status: STARTED
[21:55:39.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:30:0) after 3m27s
[21:59:06.818] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:30:0)
[21:59:06.985] Build status: STARTED
[21:59:06.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:31:0) after 4m59s
[22:04:06.243] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:31:0)
[22:04:06.262] Build status: STARTED
[22:04:06.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:32:0) after 6m38s
[22:10:44.286] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:32:0)
[22:10:44.704] Build status: STARTED
[22:10:44.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:33:0) after 6m24s
[22:17:08.781] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:33:0)
[22:17:08.801] Build status: STARTED
[22:17:08.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:34:0) after 9m23s
[22:26:31.913] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:34:0)
[22:26:31.932] Build status: STARTED
[22:26:31.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:35:0) after 1m48s
[22:28:19.955] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:35:0)
[22:28:19.981] Build status: STARTED
[22:28:19.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:36:0) after 5m9s
[22:33:29.048] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:36:0)
[22:33:29.066] Build status: STARTED
[22:33:29.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:37:0) after 7m52s
[22:41:21.198] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:37:0)
[22:41:21.222] Build status: STARTED
[22:41:21.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:38:0) after 9m56s
[22:51:17.354] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:38:0)
[22:51:17.368] Build status: STARTED
[22:51:17.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:39:0) after 4m40s
[22:55:57.485] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:39:0)
[22:55:57.500] Build status: STARTED
[22:55:57.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:40:0) after 2m2s
[22:57:59.524] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:40:0)
[22:57:59.537] Build status: STARTED
[22:57:59.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:41:0) after 8m7s
[23:06:06.561] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:41:0)
[23:06:06.592] Build status: STARTED
[23:06:06.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:42:0) after 6m39s
[23:12:45.605] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:42:0)
[23:12:45.616] Build status: STARTED
[23:12:45.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:43:0) after 3m37s
[23:16:22.588] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:43:0)
[23:16:22.605] Build status: STARTED
[23:16:22.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:44:0) after 1m42s
[23:18:04.673] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:44:0)
[23:18:04.688] Build status: STARTED
[23:18:04.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:45:0) after 4m26s
[23:22:30.705] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:45:0)
[23:22:30.723] Build status: STARTED
[23:22:30.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:46:0) after 1m40s
[23:24:10.743] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:46:0)
[23:24:10.760] Build status: STARTED
[23:24:10.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:47:0) after 2m56s
[23:27:06.780] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:47:0)
[23:27:06.800] Build status: STARTED
[23:27:06.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:48:0) after 1m47s
[23:28:53.819] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:48:0)
[23:28:53.835] Build status: STARTED
[23:28:53.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:49:0) after 7m47s
[23:36:40.988] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:49:0)
[23:36:41.002] Build status: STARTED
[23:36:41.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:50:0) after 5m37s
[23:42:18.060] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:50:0)
[23:42:18.076] Build status: STARTED
[23:42:18.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861906375354536448:51:0) after 8m52s
[23:47:01.792] Received PubSub notification, asking Buildbucket for the build status
[23:47:01.812] Build:
{
"id": "8696476313058292801",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 30281,
"createdBy": "project:chromium",
"createTime": "2025-12-03T19:41:59.208857121Z",
"startTime": "2025-12-03T19:42:03.567133168Z",
"endTime": "2025-12-03T23:46:43.718467978Z",
"updateTime": "2025-12-03T23:46:43.718467978Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "644333f4ba6ae4fe19247dc76c98d6e5caead94e",
"ref": "refs/heads/main"
}
}
}
[23:47:01.812] Invocation finished in 4h5m4.177503114s with status FAILED