[01:39:52.138] New invocation is queued and will start shortly
[01:39:53.217] Starting the invocation (attempt 1)
[01:39:53.240] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/3727dd4d9c38417ada22e3dde14c4fca3b2db893"
[01:39:53.240] Popped gitiles commit info from properties and tags
[01:39:53.240] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:39:53.241] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:39:53.241] Buildbucket request:
{
"requestId": "8862971021315874368",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3727dd4d9c38417ada22e3dde14c4fca3b2db893",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8862971021315874368"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:39:53.827] Scheduled build:
{
"id": "8697540959452040337",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 29963,
"createdBy": "project:chromium",
"createTime": "2025-11-22T01:39:53.287142576Z",
"updateTime": "2025-11-22T01:39:53.287142576Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3727dd4d9c38417ada22e3dde14c4fca3b2db893",
"ref": "refs/heads/main"
}
}
}
[01:39:53.827] Task URL: https://cr-buildbucket.appspot.com/build/8697540959452040337
[01:39:53.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:2:0) after 4m47s
[01:39:54.786] Received PubSub notification, asking Buildbucket for the build status
[01:39:54.809] Build status: SCHEDULED
[01:39:59.754] Received PubSub notification, asking Buildbucket for the build status
[01:39:59.786] Build status: STARTED
[01:44:40.845] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:2:0)
[01:44:40.874] Build status: STARTED
[01:44:40.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:5:0) after 2m9s
[01:46:50.023] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:5:0)
[01:46:50.043] Build status: STARTED
[01:46:50.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:6:0) after 2m20s
[01:49:10.204] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:6:0)
[01:49:10.219] Build status: STARTED
[01:49:10.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:7:0) after 1m18s
[01:50:28.319] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:7:0)
[01:50:28.524] Build status: STARTED
[01:50:28.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:8:0) after 1m7s
[01:51:35.536] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:8:0)
[01:51:35.554] Build status: STARTED
[01:51:35.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:9:0) after 5m13s
[01:56:48.570] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:9:0)
[01:56:48.609] Build status: STARTED
[01:56:48.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:10:0) after 6m56s
[02:03:44.575] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:10:0)
[02:03:44.591] Build status: STARTED
[02:03:44.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:11:0) after 5m46s
[02:09:30.655] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:11:0)
[02:09:30.673] Build status: STARTED
[02:09:30.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:12:0) after 2m44s
[02:12:14.686] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:12:0)
[02:12:14.715] Build status: STARTED
[02:12:14.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:13:0) after 5m28s
[02:17:42.767] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:13:0)
[02:17:42.801] Build status: STARTED
[02:17:42.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:14:0) after 3m42s
[02:21:24.817] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:14:0)
[02:21:24.831] Build status: STARTED
[02:21:24.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:15:0) after 9m10s
[02:30:34.901] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:15:0)
[02:30:34.925] Build status: STARTED
[02:30:34.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:16:0) after 8m54s
[02:39:28.945] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:16:0)
[02:39:28.961] Build status: STARTED
[02:39:28.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:17:0) after 1m40s
[02:41:09.067] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:17:0)
[02:41:09.087] Build status: STARTED
[02:41:09.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:18:0) after 1m40s
[02:42:49.134] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:18:0)
[02:42:49.160] Build status: STARTED
[02:42:49.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:19:0) after 3m9s
[02:45:58.176] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:19:0)
[02:45:58.192] Build status: STARTED
[02:45:58.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:20:0) after 6m13s
[02:52:11.223] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:20:0)
[02:52:11.256] Build status: STARTED
[02:52:11.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:21:0) after 7m10s
[02:59:21.273] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:21:0)
[02:59:21.330] Build status: STARTED
[02:59:21.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:22:0) after 6m40s
[03:06:01.392] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:22:0)
[03:06:01.464] Build status: STARTED
[03:06:01.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:23:0) after 1m37s
[03:07:38.492] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:23:0)
[03:07:38.512] Build status: STARTED
[03:07:38.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:24:0) after 2m5s
[03:09:43.547] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:24:0)
[03:09:43.565] Build status: STARTED
[03:09:43.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:25:0) after 8m22s
[03:18:05.659] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:25:0)
[03:18:05.723] Build status: STARTED
[03:18:05.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:26:0) after 5m3s
[03:23:08.726] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:26:0)
[03:23:08.762] Build status: STARTED
[03:23:08.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:27:0) after 2m27s
[03:25:35.830] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:27:0)
[03:25:35.844] Build status: STARTED
[03:25:35.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:28:0) after 3m9s
[03:28:44.861] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:28:0)
[03:28:44.874] Build status: STARTED
[03:28:44.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:29:0) after 4m13s
[03:32:57.860] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:29:0)
[03:32:57.876] Build status: STARTED
[03:32:57.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:30:0) after 2m35s
[03:35:32.933] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:30:0)
[03:35:32.977] Build status: STARTED
[03:35:32.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:31:0) after 4m46s
[03:40:19.003] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:31:0)
[03:40:19.016] Build status: STARTED
[03:40:19.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:32:0) after 1m7s
[03:41:26.044] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:32:0)
[03:41:26.067] Build status: STARTED
[03:41:26.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:33:0) after 7m35s
[03:49:01.089] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:33:0)
[03:49:01.102] Build status: STARTED
[03:49:01.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:34:0) after 1m24s
[03:50:25.221] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:34:0)
[03:50:25.236] Build status: STARTED
[03:50:25.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:35:0) after 8m25s
[03:58:50.258] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:35:0)
[03:58:50.435] Build status: STARTED
[03:58:50.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:36:0) after 6m17s
[04:05:07.498] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:36:0)
[04:05:07.516] Build status: STARTED
[04:05:07.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:37:0) after 3m0s
[04:08:07.670] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:37:0)
[04:08:07.691] Build status: STARTED
[04:08:07.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:38:0) after 3m33s
[04:11:40.706] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:38:0)
[04:11:40.760] Build status: STARTED
[04:11:40.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:39:0) after 6m26s
[04:18:06.779] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:39:0)
[04:18:06.807] Build status: STARTED
[04:18:06.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:40:0) after 6m32s
[04:24:38.887] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:40:0)
[04:24:38.958] Build status: STARTED
[04:24:38.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:41:0) after 8m59s
[04:33:38.315] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:41:0)
[04:33:38.338] Build status: STARTED
[04:33:38.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:42:0) after 7m30s
[04:41:08.396] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:42:0)
[04:41:08.410] Build status: STARTED
[04:41:08.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:43:0) after 3m39s
[04:44:47.784] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:43:0)
[04:44:47.806] Build status: STARTED
[04:44:47.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:44:0) after 9m48s
[04:54:36.126] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:44:0)
[04:54:36.168] Build status: STARTED
[04:54:36.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:45:0) after 2m12s
[04:56:48.342] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:45:0)
[04:56:48.360] Build status: STARTED
[04:56:48.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:46:0) after 8m2s
[05:04:50.433] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:46:0)
[05:04:50.451] Build status: STARTED
[05:04:50.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:47:0) after 2m44s
[05:07:34.518] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:47:0)
[05:07:34.535] Build status: STARTED
[05:07:34.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:48:0) after 2m59s
[05:10:33.561] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:48:0)
[05:10:33.653] Build status: STARTED
[05:10:33.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8862971021315874368:49:0) after 6m32s
[05:16:28.811] Received PubSub notification, asking Buildbucket for the build status
[05:16:28.869] Build:
{
"id": "8697540959452040337",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 29963,
"createdBy": "project:chromium",
"createTime": "2025-11-22T01:39:53.287142576Z",
"startTime": "2025-11-22T01:39:57.922831738Z",
"endTime": "2025-11-22T05:16:28.503064793Z",
"updateTime": "2025-11-22T05:16:28.503064793Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3727dd4d9c38417ada22e3dde14c4fca3b2db893",
"ref": "refs/heads/main"
}
}
}
[05:16:28.869] Invocation finished in 3h36m36.742509787s with status FAILED