[21:53:21.053] New invocation is queued and will start shortly
[21:53:22.132] Starting the invocation (attempt 1)
[21:53:22.160] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/422b5c641abcf8ba7f8e441b764816fa5cd70ecc"
[21:53:22.160] Popped gitiles commit info from properties and tags
[21:53:22.160] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:53:22.160] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:53:22.161] Buildbucket request:
{
"requestId": "8862985272591232000",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "422b5c641abcf8ba7f8e441b764816fa5cd70ecc",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8862985272591232000"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:53:23.032] Scheduled build:
{
"id": "8697555210692265185",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 29962,
"createdBy": "project:chromium",
"createTime": "2025-11-21T21:53:22.245670386Z",
"updateTime": "2025-11-21T21:53:22.245670386Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "422b5c641abcf8ba7f8e441b764816fa5cd70ecc",
"ref": "refs/heads/main"
}
},
"canary": true
}
[21:53:23.032] Task URL: https://cr-buildbucket.appspot.com/build/8697555210692265185
[21:53:23.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:2:0) after 3m20s
[21:53:24.012] Received PubSub notification, asking Buildbucket for the build status
[21:53:24.032] Build status: SCHEDULED
[21:53:28.735] Received PubSub notification, asking Buildbucket for the build status
[21:53:28.750] Build status: STARTED
[21:56:43.129] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:2:0)
[21:56:43.149] Build status: STARTED
[21:56:43.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:5:0) after 9m25s
[22:06:08.170] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:5:0)
[22:06:08.195] Build status: STARTED
[22:06:08.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:6:0) after 7m54s
[22:14:02.264] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:6:0)
[22:14:02.279] Build status: STARTED
[22:14:02.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:7:0) after 4m37s
[22:18:39.422] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:7:0)
[22:18:39.456] Build status: STARTED
[22:18:39.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:8:0) after 7m52s
[22:26:31.481] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:8:0)
[22:26:31.508] Build status: STARTED
[22:26:31.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:9:0) after 1m27s
[22:27:58.523] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:9:0)
[22:27:58.620] Build status: STARTED
[22:27:58.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:10:0) after 3m18s
[22:31:16.637] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:10:0)
[22:31:16.701] Build status: STARTED
[22:31:16.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:11:0) after 8m36s
[22:39:52.717] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:11:0)
[22:39:52.767] Build status: STARTED
[22:39:52.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:12:0) after 4m34s
[22:44:26.852] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:12:0)
[22:44:26.866] Build status: STARTED
[22:44:26.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:13:0) after 3m33s
[22:47:59.900] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:13:0)
[22:47:59.914] Build status: STARTED
[22:47:59.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:14:0) after 4m5s
[22:52:04.979] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:14:0)
[22:52:04.992] Build status: STARTED
[22:52:04.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:15:0) after 3m25s
[22:55:30.009] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:15:0)
[22:55:30.030] Build status: STARTED
[22:55:30.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:16:0) after 5m24s
[23:00:54.046] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:16:0)
[23:00:54.057] Build status: STARTED
[23:00:54.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:17:0) after 4m15s
[23:05:09.062] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:17:0)
[23:05:09.076] Build status: STARTED
[23:05:09.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:18:0) after 2m37s
[23:07:46.180] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:18:0)
[23:07:46.203] Build status: STARTED
[23:07:46.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:19:0) after 5m1s
[23:12:47.250] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:19:0)
[23:12:47.264] Build status: STARTED
[23:12:47.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:20:0) after 8m44s
[23:21:31.282] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:20:0)
[23:21:31.300] Build status: STARTED
[23:21:31.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:21:0) after 1m0s
[23:22:31.393] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:21:0)
[23:22:31.409] Build status: STARTED
[23:22:31.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:22:0) after 5m13s
[23:27:44.448] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:22:0)
[23:27:44.462] Build status: STARTED
[23:27:44.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:23:0) after 1m19s
[23:29:03.537] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:23:0)
[23:29:03.553] Build status: STARTED
[23:29:03.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:24:0) after 7m53s
[23:36:56.619] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:24:0)
[23:36:56.655] Build status: STARTED
[23:36:56.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:25:0) after 9m29s
[23:46:25.671] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:25:0)
[23:46:25.727] Build status: STARTED
[23:46:25.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:26:0) after 2m20s
[23:48:45.749] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:26:0)
[23:48:45.763] Build status: STARTED
[23:48:45.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:27:0) after 4m0s
[23:52:45.838] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:27:0)
[23:52:45.889] Build status: STARTED
[23:52:45.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:28:0) after 1m56s
[23:54:41.889] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:28:0)
[23:54:41.909] Build status: STARTED
[23:54:41.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:29:0) after 4m4s
[23:58:45.975] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:29:0)
[23:58:46.009] Build status: STARTED
[23:58:46.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:30:0) after 2m18s
[00:01:04.110] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:30:0)
[00:01:04.131] Build status: STARTED
[00:01:04.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:31:0) after 9m55s
[00:10:59.154] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:31:0)
[00:10:59.178] Build status: STARTED
[00:10:59.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:32:0) after 5m3s
[00:16:02.199] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:32:0)
[00:16:02.220] Build status: STARTED
[00:16:02.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:33:0) after 1m3s
[00:17:05.364] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:33:0)
[00:17:05.377] Build status: STARTED
[00:17:05.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:34:0) after 7m30s
[00:24:35.532] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:34:0)
[00:24:35.546] Build status: STARTED
[00:24:35.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:35:0) after 4m21s
[00:28:56.621] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:35:0)
[00:28:56.669] Build status: STARTED
[00:28:56.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:36:0) after 2m38s
[00:31:34.774] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:36:0)
[00:31:34.789] Build status: STARTED
[00:31:34.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:37:0) after 3m51s
[00:35:25.836] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:37:0)
[00:35:25.875] Build status: STARTED
[00:35:25.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:38:0) after 2m48s
[00:38:13.890] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:38:0)
[00:38:13.936] Build status: STARTED
[00:38:13.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:39:0) after 1m7s
[00:39:20.954] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:39:0)
[00:39:20.971] Build status: STARTED
[00:39:20.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:40:0) after 4m33s
[00:43:54.013] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:40:0)
[00:43:54.036] Build status: STARTED
[00:43:54.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:41:0) after 1m35s
[00:45:29.099] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:41:0)
[00:45:29.115] Build status: STARTED
[00:45:29.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:42:0) after 1m18s
[00:46:47.175] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:42:0)
[00:46:47.188] Build status: STARTED
[00:46:47.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:43:0) after 7m28s
[00:54:15.384] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:43:0)
[00:54:15.441] Build status: STARTED
[00:54:15.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:44:0) after 3m11s
[00:57:26.465] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:44:0)
[00:57:26.477] Build status: STARTED
[00:57:26.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:45:0) after 4m3s
[01:01:29.497] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:45:0)
[01:01:29.664] Build status: STARTED
[01:01:29.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:46:0) after 8m13s
[01:09:42.756] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:46:0)
[01:09:42.772] Build status: STARTED
[01:09:42.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:47:0) after 9m0s
[01:18:42.838] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:47:0)
[01:18:42.876] Build status: STARTED
[01:18:42.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:48:0) after 6m6s
[01:24:48.898] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:48:0)
[01:24:49.085] Build status: STARTED
[01:24:49.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:49:0) after 4m46s
[01:29:35.072] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:49:0)
[01:29:35.093] Build status: STARTED
[01:29:35.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:50:0) after 5m10s
[01:34:45.135] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:50:0)
[01:34:45.149] Build status: STARTED
[01:34:45.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:51:0) after 4m15s
[01:39:00.186] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:51:0)
[01:39:00.201] Build status: STARTED
[01:39:00.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862985272591232000:52:0) after 7m18s
[01:39:51.291] Received PubSub notification, asking Buildbucket for the build status
[01:39:51.304] Build:
{
"id": "8697555210692265185",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 29962,
"createdBy": "project:chromium",
"createTime": "2025-11-21T21:53:22.245670386Z",
"startTime": "2025-11-21T21:53:27.595901731Z",
"endTime": "2025-11-22T01:39:50.648009319Z",
"updateTime": "2025-11-22T01:39:50.648009319Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "422b5c641abcf8ba7f8e441b764816fa5cd70ecc",
"ref": "refs/heads/main"
}
},
"canary": true
}
[01:39:51.304] Invocation finished in 3h46m30.254034861s with status FAILED