[12:40:54.062] New invocation is queued and will start shortly
[12:40:55.181] Starting the invocation (attempt 1)
[12:40:55.204] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f1fff4419cdda2f3ab34eb208135d2dbdde94767"
[12:40:55.204] Popped gitiles commit info from properties and tags
[12:40:55.205] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[12:40:55.205] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[12:40:55.205] Buildbucket request:
{
"requestId": "8862929432776938128",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f1fff4419cdda2f3ab34eb208135d2dbdde94767",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8862929432776938128"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[12:40:55.801] Scheduled build:
{
"id": "8697499370850701713",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 29966,
"createdBy": "project:chromium",
"createTime": "2025-11-22T12:40:55.268949149Z",
"updateTime": "2025-11-22T12:40:55.268949149Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f1fff4419cdda2f3ab34eb208135d2dbdde94767",
"ref": "refs/heads/main"
}
}
}
[12:40:55.801] Task URL: https://cr-buildbucket.appspot.com/build/8697499370850701713
[12:40:55.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:2:0) after 9m6s
[12:40:56.721] Received PubSub notification, asking Buildbucket for the build status
[12:40:56.736] Build status: SCHEDULED
[12:41:29.568] Received PubSub notification, asking Buildbucket for the build status
[12:41:29.608] Build status: STARTED
[12:50:01.943] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:2:0)
[12:50:01.966] Build status: STARTED
[12:50:01.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:5:0) after 6m0s
[12:56:01.993] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:5:0)
[12:56:02.009] Build status: STARTED
[12:56:02.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:6:0) after 7m55s
[13:03:57.380] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:6:0)
[13:03:57.395] Build status: STARTED
[13:03:57.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:7:0) after 3m7s
[13:07:04.623] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:7:0)
[13:07:04.640] Build status: STARTED
[13:07:04.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:8:0) after 4m23s
[13:11:27.860] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:8:0)
[13:11:27.885] Build status: STARTED
[13:11:27.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:9:0) after 8m26s
[13:19:53.947] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:9:0)
[13:19:54.005] Build status: STARTED
[13:19:54.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:10:0) after 5m30s
[13:25:24.060] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:10:0)
[13:25:24.076] Build status: STARTED
[13:25:24.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:11:0) after 4m21s
[13:29:45.086] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:11:0)
[13:29:45.154] Build status: STARTED
[13:29:45.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:12:0) after 8m59s
[13:38:44.169] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:12:0)
[13:38:44.189] Build status: STARTED
[13:38:44.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:13:0) after 1m40s
[13:40:24.585] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:13:0)
[13:40:24.600] Build status: STARTED
[13:40:24.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:14:0) after 8m21s
[13:48:45.612] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:14:0)
[13:48:45.630] Build status: STARTED
[13:48:45.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:15:0) after 6m31s
[13:55:16.625] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:15:0)
[13:55:16.806] Build status: STARTED
[13:55:16.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:16:0) after 3m38s
[13:58:55.406] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:16:0)
[13:58:55.420] Build status: STARTED
[13:58:55.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:17:0) after 1m57s
[14:00:52.767] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:17:0)
[14:00:52.787] Build status: STARTED
[14:00:52.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:18:0) after 9m21s
[14:10:13.801] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:18:0)
[14:10:13.843] Build status: STARTED
[14:10:13.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:19:0) after 8m36s
[14:18:49.935] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:19:0)
[14:18:49.957] Build status: STARTED
[14:18:49.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:20:0) after 2m26s
[14:21:16.019] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:20:0)
[14:21:16.037] Build status: STARTED
[14:21:16.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:21:0) after 5m46s
[14:27:02.055] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:21:0)
[14:27:02.071] Build status: STARTED
[14:27:02.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:22:0) after 9m52s
[14:36:54.184] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:22:0)
[14:36:54.197] Build status: STARTED
[14:36:54.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:23:0) after 5m44s
[14:42:38.352] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:23:0)
[14:42:38.371] Build status: STARTED
[14:42:38.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:24:0) after 6m7s
[14:48:45.483] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:24:0)
[14:48:45.508] Build status: STARTED
[14:48:45.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:25:0) after 8m57s
[14:57:42.987] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:25:0)
[14:57:43.001] Build status: STARTED
[14:57:43.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:26:0) after 3m34s
[15:01:17.096] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:26:0)
[15:01:17.118] Build status: STARTED
[15:01:17.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:27:0) after 5m59s
[15:07:16.133] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:27:0)
[15:07:16.147] Build status: STARTED
[15:07:16.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:28:0) after 4m5s
[15:11:21.254] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:28:0)
[15:11:21.274] Build status: STARTED
[15:11:21.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:29:0) after 1m9s
[15:12:30.290] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:29:0)
[15:12:30.302] Build status: STARTED
[15:12:30.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:30:0) after 6m48s
[15:19:18.302] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:30:0)
[15:19:18.319] Build status: STARTED
[15:19:18.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:31:0) after 7m35s
[15:26:53.364] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:31:0)
[15:26:53.390] Build status: STARTED
[15:26:53.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:32:0) after 5m19s
[15:32:12.688] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:32:0)
[15:32:12.713] Build status: STARTED
[15:32:12.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:33:0) after 3m24s
[15:35:36.780] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:33:0)
[15:35:36.973] Build status: STARTED
[15:35:36.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:34:0) after 3m8s
[15:38:44.988] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:34:0)
[15:38:45.002] Build status: STARTED
[15:38:45.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:35:0) after 7m44s
[15:46:29.016] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:35:0)
[15:46:29.039] Build status: STARTED
[15:46:29.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:36:0) after 6m15s
[15:52:44.393] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:36:0)
[15:52:44.599] Build status: STARTED
[15:52:44.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:37:0) after 9m30s
[16:02:14.614] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:37:0)
[16:02:14.652] Build status: STARTED
[16:02:14.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:38:0) after 1m29s
[16:03:43.831] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:38:0)
[16:03:43.850] Build status: STARTED
[16:03:43.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:39:0) after 9m37s
[16:13:20.866] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:39:0)
[16:13:20.892] Build status: STARTED
[16:13:20.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862929432776938128:40:0) after 8m23s
[16:16:00.072] Received PubSub notification, asking Buildbucket for the build status
[16:16:00.085] Build:
{
"id": "8697499370850701713",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 29966,
"createdBy": "project:chromium",
"createTime": "2025-11-22T12:40:55.268949149Z",
"startTime": "2025-11-22T12:41:29.051019669Z",
"endTime": "2025-11-22T16:15:59.800068529Z",
"updateTime": "2025-11-22T16:15:59.800068529Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f1fff4419cdda2f3ab34eb208135d2dbdde94767",
"ref": "refs/heads/main"
}
}
}
[16:16:00.085] Invocation finished in 3h35m6.037590893s with status FAILED