[02:57:41.351] New invocation is queued and will start shortly
[02:57:42.594] Starting the invocation (attempt 1)
[02:57:42.619] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/80e288764853366da870ce585152ff22c763e128"
[02:57:42.619] Popped gitiles commit info from properties and tags
[02:57:42.619] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:57:42.620] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:57:42.620] Buildbucket request:
{
"requestId": "8862603737418025504",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "80e288764853366da870ce585152ff22c763e128",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8862603737418025504"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:57:43.099] Scheduled build:
{
"id": "8697173675378525137",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 30004,
"createdBy": "project:chromium",
"createTime": "2025-11-26T02:57:42.674729205Z",
"updateTime": "2025-11-26T02:57:42.674729205Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "80e288764853366da870ce585152ff22c763e128",
"ref": "refs/heads/main"
}
},
"canary": true
}
[02:57:43.099] Task URL: https://cr-buildbucket.appspot.com/build/8697173675378525137
[02:57:43.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:2:0) after 6m12s
[02:57:43.348] Received PubSub notification, asking Buildbucket for the build status
[02:57:43.368] Build status: SCHEDULED
[02:58:24.770] Received PubSub notification, asking Buildbucket for the build status
[02:58:24.828] Build status: STARTED
[03:03:55.136] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:2:0)
[03:03:55.163] Build status: STARTED
[03:03:55.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:5:0) after 8m51s
[03:12:46.175] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:5:0)
[03:12:46.194] Build status: STARTED
[03:12:46.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:6:0) after 8m57s
[03:21:43.256] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:6:0)
[03:21:43.271] Build status: STARTED
[03:21:43.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:7:0) after 7m23s
[03:29:06.287] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:7:0)
[03:29:07.991] Build status: STARTED
[03:29:07.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:8:0) after 7m3s
[03:36:11.181] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:8:0)
[03:36:11.234] Build status: STARTED
[03:36:11.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:9:0) after 4m13s
[03:40:24.325] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:9:0)
[03:40:24.344] Build status: STARTED
[03:40:24.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:10:0) after 6m28s
[03:46:52.356] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:10:0)
[03:46:52.374] Build status: STARTED
[03:46:52.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:11:0) after 2m17s
[03:49:09.387] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:11:0)
[03:49:09.411] Build status: STARTED
[03:49:09.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:12:0) after 3m10s
[03:52:19.422] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:12:0)
[03:52:19.536] Build status: STARTED
[03:52:19.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:13:0) after 1m36s
[03:53:55.548] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:13:0)
[03:53:55.569] Build status: STARTED
[03:53:55.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:14:0) after 4m9s
[03:58:04.582] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:14:0)
[03:58:04.606] Build status: STARTED
[03:58:04.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:15:0) after 5m35s
[04:03:39.624] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:15:0)
[04:03:39.753] Build status: STARTED
[04:03:39.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:16:0) after 2m53s
[04:06:32.852] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:16:0)
[04:06:32.868] Build status: STARTED
[04:06:32.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:17:0) after 3m12s
[04:09:44.880] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:17:0)
[04:09:44.900] Build status: STARTED
[04:09:44.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:18:0) after 3m16s
[04:13:00.917] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:18:0)
[04:13:00.933] Build status: STARTED
[04:13:00.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:19:0) after 4m44s
[04:17:44.945] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:19:0)
[04:17:44.961] Build status: STARTED
[04:17:44.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:20:0) after 1m25s
[04:19:09.974] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:20:0)
[04:19:09.990] Build status: STARTED
[04:19:09.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:21:0) after 6m57s
[04:26:07.002] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:21:0)
[04:26:07.110] Build status: STARTED
[04:26:07.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:22:0) after 2m30s
[04:28:37.124] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:22:0)
[04:28:37.150] Build status: STARTED
[04:28:37.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:23:0) after 6m50s
[04:35:27.165] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:23:0)
[04:35:27.181] Build status: STARTED
[04:35:27.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:24:0) after 7m48s
[04:43:15.196] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:24:0)
[04:43:15.214] Build status: STARTED
[04:43:15.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:25:0) after 2m48s
[04:46:03.295] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:25:0)
[04:46:03.376] Build status: STARTED
[04:46:03.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:26:0) after 8m36s
[04:54:39.511] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:26:0)
[04:54:39.535] Build status: STARTED
[04:54:39.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:27:0) after 7m27s
[05:02:06.570] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:27:0)
[05:02:06.584] Build status: STARTED
[05:02:06.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:28:0) after 2m4s
[05:04:10.600] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:28:0)
[05:04:10.615] Build status: STARTED
[05:04:10.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:29:0) after 9m27s
[05:13:37.804] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:29:0)
[05:13:37.822] Build status: STARTED
[05:13:37.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:30:0) after 6m30s
[05:20:07.882] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:30:0)
[05:20:07.898] Build status: STARTED
[05:20:07.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:31:0) after 5m45s
[05:25:52.953] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:31:0)
[05:25:52.971] Build status: STARTED
[05:25:52.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:32:0) after 4m55s
[05:30:48.020] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:32:0)
[05:30:48.044] Build status: STARTED
[05:30:48.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:33:0) after 2m49s
[05:33:37.141] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:33:0)
[05:33:37.159] Build status: STARTED
[05:33:37.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:34:0) after 9m18s
[05:42:55.183] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:34:0)
[05:42:55.203] Build status: STARTED
[05:42:55.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:35:0) after 6m13s
[05:49:08.244] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:35:0)
[05:49:08.266] Build status: STARTED
[05:49:08.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:36:0) after 7m4s
[05:56:12.286] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:36:0)
[05:56:12.301] Build status: STARTED
[05:56:12.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:37:0) after 3m19s
[05:59:31.293] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:37:0)
[05:59:31.309] Build status: STARTED
[05:59:31.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:38:0) after 6m47s
[06:06:18.377] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:38:0)
[06:06:18.391] Build status: STARTED
[06:06:18.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:39:0) after 6m10s
[06:12:28.393] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:39:0)
[06:12:28.482] Build status: STARTED
[06:12:28.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862603737418025504:40:0) after 7m46s
[06:16:08.704] Received PubSub notification, asking Buildbucket for the build status
[06:16:08.727] Build:
{
"id": "8697173675378525137",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 30004,
"createdBy": "project:chromium",
"createTime": "2025-11-26T02:57:42.674729205Z",
"startTime": "2025-11-26T02:58:24.600594691Z",
"endTime": "2025-11-26T06:16:08.386507353Z",
"updateTime": "2025-11-26T06:16:08.386507353Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "80e288764853366da870ce585152ff22c763e128",
"ref": "refs/heads/main"
}
},
"canary": true
}
[06:16:08.727] Invocation finished in 3h18m27.38078159s with status FAILED