[15:02:47.263] New invocation is queued and will start shortly
[15:02:48.309] Starting the invocation (attempt 1)
[15:02:48.340] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/7f6bbd655cb6f64b8f924d6ebdd1d4f7b2046309"
[15:02:48.340] Popped gitiles commit info from properties and tags
[15:02:48.340] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:02:48.340] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:02:48.340] Buildbucket request:
{
"requestId": "8861380357604152896",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7f6bbd655cb6f64b8f924d6ebdd1d4f7b2046309",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8861380357604152896"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:02:48.828] Scheduled build:
{
"id": "8695950295716916369",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 30341,
"createdBy": "project:chromium",
"createTime": "2025-12-09T15:02:48.437354486Z",
"updateTime": "2025-12-09T15:02:48.437354486Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7f6bbd655cb6f64b8f924d6ebdd1d4f7b2046309",
"ref": "refs/heads/main"
}
}
}
[15:02:48.828] Task URL: https://cr-buildbucket.appspot.com/build/8695950295716916369
[15:02:48.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:2:0) after 6m22s
[15:02:49.808] Received PubSub notification, asking Buildbucket for the build status
[15:02:49.831] Build status: SCHEDULED
[15:02:54.661] Received PubSub notification, asking Buildbucket for the build status
[15:02:54.701] Build status: STARTED
[15:09:10.935] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:2:0)
[15:09:10.955] Build status: STARTED
[15:09:10.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:5:0) after 5m25s
[15:14:36.002] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:5:0)
[15:14:36.029] Build status: STARTED
[15:14:36.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:6:0) after 9m13s
[15:23:49.048] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:6:0)
[15:23:49.065] Build status: STARTED
[15:23:49.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:7:0) after 3m56s
[15:27:45.051] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:7:0)
[15:27:45.066] Build status: STARTED
[15:27:45.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:8:0) after 2m0s
[15:29:45.029] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:8:0)
[15:29:45.047] Build status: STARTED
[15:29:45.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:9:0) after 7m26s
[15:37:11.062] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:9:0)
[15:37:11.082] Build status: STARTED
[15:37:11.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:10:0) after 1m11s
[15:38:22.140] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:10:0)
[15:38:22.156] Build status: STARTED
[15:38:22.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:11:0) after 6m26s
[15:44:48.171] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:11:0)
[15:44:48.184] Build status: STARTED
[15:44:48.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:12:0) after 1m7s
[15:45:55.198] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:12:0)
[15:45:55.214] Build status: STARTED
[15:45:55.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:13:0) after 7m13s
[15:53:08.293] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:13:0)
[15:53:08.307] Build status: STARTED
[15:53:08.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:14:0) after 6m0s
[15:59:08.324] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:14:0)
[15:59:08.368] Build status: STARTED
[15:59:08.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:15:0) after 3m31s
[16:02:39.383] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:15:0)
[16:02:39.398] Build status: STARTED
[16:02:39.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:16:0) after 4m55s
[16:07:34.416] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:16:0)
[16:07:34.435] Build status: STARTED
[16:07:34.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:17:0) after 6m32s
[16:14:06.454] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:17:0)
[16:14:06.474] Build status: STARTED
[16:14:06.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:18:0) after 5m26s
[16:19:32.495] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:18:0)
[16:19:32.515] Build status: STARTED
[16:19:32.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:19:0) after 7m34s
[16:27:06.530] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:19:0)
[16:27:06.578] Build status: STARTED
[16:27:06.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:20:0) after 4m51s
[16:31:57.626] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:20:0)
[16:31:57.641] Build status: STARTED
[16:31:57.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:21:0) after 6m57s
[16:38:54.632] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:21:0)
[16:38:54.649] Build status: STARTED
[16:38:54.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:22:0) after 1m36s
[16:40:30.672] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:22:0)
[16:40:30.693] Build status: STARTED
[16:40:30.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:23:0) after 1m29s
[16:41:59.709] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:23:0)
[16:41:59.722] Build status: STARTED
[16:41:59.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:24:0) after 7m12s
[16:49:11.710] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:24:0)
[16:49:11.723] Build status: STARTED
[16:49:11.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:25:0) after 8m8s
[16:57:19.781] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:25:0)
[16:57:19.820] Build status: STARTED
[16:57:19.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:26:0) after 4m49s
[17:02:08.796] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:26:0)
[17:02:08.823] Build status: STARTED
[17:02:08.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:27:0) after 6m31s
[17:08:39.855] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:27:0)
[17:08:39.877] Build status: STARTED
[17:08:39.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:28:0) after 2m28s
[17:11:07.945] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:28:0)
[17:11:07.965] Build status: STARTED
[17:11:07.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:29:0) after 1m34s
[17:12:42.034] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:29:0)
[17:12:42.051] Build status: STARTED
[17:12:42.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:30:0) after 4m23s
[17:17:05.301] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:30:0)
[17:17:05.316] Build status: STARTED
[17:17:05.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:31:0) after 1m46s
[17:18:51.291] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:31:0)
[17:18:51.307] Build status: STARTED
[17:18:51.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:32:0) after 3m32s
[17:22:23.344] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:32:0)
[17:22:23.359] Build status: STARTED
[17:22:23.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:33:0) after 5m31s
[17:27:54.376] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:33:0)
[17:27:54.390] Build status: STARTED
[17:27:54.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:34:0) after 1m9s
[17:29:03.404] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:34:0)
[17:29:03.428] Build status: STARTED
[17:29:03.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:35:0) after 2m6s
[17:31:09.450] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:35:0)
[17:31:09.468] Build status: STARTED
[17:31:09.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:36:0) after 7m22s
[17:38:31.612] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:36:0)
[17:38:31.683] Build status: STARTED
[17:38:31.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:37:0) after 8m48s
[17:47:19.693] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:37:0)
[17:47:19.708] Build status: STARTED
[17:47:19.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:38:0) after 2m41s
[17:50:00.726] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:38:0)
[17:50:00.744] Build status: STARTED
[17:50:00.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:39:0) after 9m55s
[17:59:55.959] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:39:0)
[17:59:55.977] Build status: STARTED
[17:59:55.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:40:0) after 1m48s
[18:01:44.022] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:40:0)
[18:01:44.041] Build status: STARTED
[18:01:44.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:41:0) after 2m45s
[18:04:29.115] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:41:0)
[18:04:29.359] Build status: STARTED
[18:04:29.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:42:0) after 9m49s
[18:14:18.385] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:42:0)
[18:14:18.452] Build status: STARTED
[18:14:18.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:43:0) after 9m22s
[18:23:40.474] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:43:0)
[18:23:40.486] Build status: STARTED
[18:23:40.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:44:0) after 7m25s
[18:31:05.552] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:44:0)
[18:31:05.564] Build status: STARTED
[18:31:05.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:45:0) after 6m23s
[18:37:28.582] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:45:0)
[18:37:28.604] Build status: STARTED
[18:37:28.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:46:0) after 9m36s
[18:47:04.666] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:46:0)
[18:47:04.680] Build status: STARTED
[18:47:04.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:47:0) after 3m55s
[18:50:59.697] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:47:0)
[18:50:59.717] Build status: STARTED
[18:50:59.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:48:0) after 9m41s
[19:00:40.736] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:48:0)
[19:00:40.751] Build status: STARTED
[19:00:40.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:49:0) after 2m57s
[19:03:37.794] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:49:0)
[19:03:37.817] Build status: STARTED
[19:03:37.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:50:0) after 6m13s
[19:09:50.926] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:50:0)
[19:09:50.948] Build status: STARTED
[19:09:50.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:51:0) after 3m7s
[19:12:58.061] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:51:0)
[19:12:58.079] Build status: STARTED
[19:12:58.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:52:0) after 7m16s
[19:20:14.094] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:52:0)
[19:20:14.108] Build status: STARTED
[19:20:14.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:53:0) after 4m42s
[19:24:56.124] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:53:0)
[19:24:56.140] Build status: STARTED
[19:24:56.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:54:0) after 2m6s
[19:27:02.153] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:54:0)
[19:27:02.171] Build status: STARTED
[19:27:02.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:55:0) after 4m14s
[19:31:16.269] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:55:0)
[19:31:16.336] Build status: STARTED
[19:31:16.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:56:0) after 7m44s
[19:39:00.354] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:56:0)
[19:39:00.371] Build status: STARTED
[19:39:00.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8861380357604152896:57:0) after 4m10s
[19:40:05.264] Received PubSub notification, asking Buildbucket for the build status
[19:40:05.279] Build:
{
"id": "8695950295716916369",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 30341,
"createdBy": "project:chromium",
"createTime": "2025-12-09T15:02:48.437354486Z",
"startTime": "2025-12-09T15:02:54.479069778Z",
"endTime": "2025-12-09T19:40:04.860092677Z",
"updateTime": "2025-12-09T19:40:04.860092677Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7f6bbd655cb6f64b8f924d6ebdd1d4f7b2046309",
"ref": "refs/heads/main"
}
}
}
[19:40:05.279] Invocation finished in 4h37m18.025620686s with status FAILED