[06:50:22.486] New invocation is queued and will start shortly
[06:50:23.571] Starting the invocation (attempt 1)
[06:50:23.597] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/4c9f5c8991e4c4b51dca7c20717cd24871c0d0c4"
[06:50:23.597] Popped gitiles commit info from properties and tags
[06:50:23.597] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[06:50:23.597] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[06:50:23.597] Buildbucket request:
{
"requestId": "8863676261711371840",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4c9f5c8991e4c4b51dca7c20717cd24871c0d0c4",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8863676261711371840"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[06:50:24.075] Scheduled build:
{
"id": "8698246199831821857",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 29903,
"createdBy": "project:chromium",
"createTime": "2025-11-14T06:50:23.650824205Z",
"updateTime": "2025-11-14T06:50:23.650824205Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4c9f5c8991e4c4b51dca7c20717cd24871c0d0c4",
"ref": "refs/heads/main"
}
},
"canary": true
}
[06:50:24.075] Task URL: https://cr-buildbucket.appspot.com/build/8698246199831821857
[06:50:24.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:2:0) after 6m32s
[06:50:24.988] Received PubSub notification, asking Buildbucket for the build status
[06:50:25.004] Build status: SCHEDULED
[06:50:28.766] Received PubSub notification, asking Buildbucket for the build status
[06:50:28.780] Build status: STARTED
[06:56:56.190] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:2:0)
[06:56:56.228] Build status: STARTED
[06:56:56.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:5:0) after 4m55s
[07:01:51.240] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:5:0)
[07:01:51.254] Build status: STARTED
[07:01:51.254] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:6:0) after 2m27s
[07:04:18.356] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:6:0)
[07:04:18.385] Build status: STARTED
[07:04:18.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:7:0) after 1m58s
[07:06:16.409] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:7:0)
[07:06:16.425] Build status: STARTED
[07:06:16.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:8:0) after 7m21s
[07:13:37.449] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:8:0)
[07:13:37.481] Build status: STARTED
[07:13:37.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:9:0) after 2m45s
[07:16:22.462] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:9:0)
[07:16:22.533] Build status: STARTED
[07:16:22.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:10:0) after 2m2s
[07:18:24.546] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:10:0)
[07:18:24.570] Build status: STARTED
[07:18:24.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:11:0) after 4m18s
[07:22:42.561] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:11:0)
[07:22:42.672] Build status: STARTED
[07:22:42.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:12:0) after 4m42s
[07:27:24.691] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:12:0)
[07:27:24.783] Build status: STARTED
[07:27:24.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:13:0) after 5m25s
[07:32:50.394] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:13:0)
[07:32:50.410] Build status: STARTED
[07:32:50.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:14:0) after 2m6s
[07:34:56.423] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:14:0)
[07:34:56.436] Build status: STARTED
[07:34:56.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:15:0) after 4m37s
[07:39:33.499] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:15:0)
[07:39:33.576] Build status: STARTED
[07:39:33.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:16:0) after 8m20s
[07:47:53.845] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:16:0)
[07:47:53.857] Build status: STARTED
[07:47:53.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:17:0) after 3m30s
[07:51:23.918] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:17:0)
[07:51:23.937] Build status: STARTED
[07:51:23.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:18:0) after 4m4s
[07:55:28.019] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:18:0)
[07:55:28.037] Build status: STARTED
[07:55:28.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:19:0) after 1m18s
[07:56:46.015] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:19:0)
[07:56:46.031] Build status: STARTED
[07:56:46.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:20:0) after 5m35s
[08:02:21.049] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:20:0)
[08:02:21.068] Build status: STARTED
[08:02:21.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:21:0) after 5m20s
[08:07:41.146] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:21:0)
[08:07:41.167] Build status: STARTED
[08:07:41.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:22:0) after 9m23s
[08:17:04.183] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:22:0)
[08:17:04.199] Build status: STARTED
[08:17:04.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:23:0) after 7m19s
[08:24:23.210] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:23:0)
[08:24:23.226] Build status: STARTED
[08:24:23.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:24:0) after 9m32s
[08:33:55.322] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:24:0)
[08:33:55.339] Build status: STARTED
[08:33:55.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:25:0) after 5m16s
[08:39:11.351] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:25:0)
[08:39:11.439] Build status: STARTED
[08:39:11.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:26:0) after 7m41s
[08:46:52.416] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:26:0)
[08:46:52.433] Build status: STARTED
[08:46:52.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:27:0) after 6m10s
[08:53:02.446] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:27:0)
[08:53:02.461] Build status: STARTED
[08:53:02.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:28:0) after 8m26s
[09:01:28.658] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:28:0)
[09:01:28.693] Build status: STARTED
[09:01:28.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:29:0) after 2m10s
[09:03:38.759] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:29:0)
[09:03:38.787] Build status: STARTED
[09:03:38.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:30:0) after 4m12s
[09:07:50.799] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:30:0)
[09:07:50.814] Build status: STARTED
[09:07:50.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:31:0) after 8m35s
[09:16:25.883] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:31:0)
[09:16:25.901] Build status: STARTED
[09:16:25.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:32:0) after 5m57s
[09:22:22.921] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:32:0)
[09:22:22.961] Build status: STARTED
[09:22:22.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:33:0) after 9m23s
[09:31:45.979] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:33:0)
[09:31:45.994] Build status: STARTED
[09:31:45.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:34:0) after 5m58s
[09:37:43.972] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:34:0)
[09:37:43.989] Build status: STARTED
[09:37:43.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:35:0) after 9m34s
[09:47:17.970] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:35:0)
[09:47:17.986] Build status: STARTED
[09:47:17.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:36:0) after 1m17s
[09:48:35.025] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:36:0)
[09:48:35.039] Build status: STARTED
[09:48:35.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:37:0) after 5m55s
[09:54:30.056] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:37:0)
[09:54:30.076] Build status: STARTED
[09:54:30.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:38:0) after 1m37s
[09:56:07.097] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:38:0)
[09:56:07.109] Build status: STARTED
[09:56:07.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:39:0) after 6m34s
[10:02:41.169] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:39:0)
[10:02:41.191] Build status: STARTED
[10:02:41.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863676261711371840:40:0) after 8m21s
[10:07:57.521] Received PubSub notification, asking Buildbucket for the build status
[10:07:57.546] Build:
{
"id": "8698246199831821857",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 29903,
"createdBy": "project:chromium",
"createTime": "2025-11-14T06:50:23.650824205Z",
"startTime": "2025-11-14T06:50:28.625985610Z",
"endTime": "2025-11-14T10:07:55.992958602Z",
"updateTime": "2025-11-14T10:07:55.992958602Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4c9f5c8991e4c4b51dca7c20717cd24871c0d0c4",
"ref": "refs/heads/main"
}
},
"canary": true
}
[10:07:57.546] Invocation finished in 3h17m35.072122614s with status FAILED