[18:15:32.843] New invocation is queued and will start shortly
[18:15:33.961] Starting the invocation (attempt 1)
[18:15:33.983] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/604ca97080e54a3aa8f59f79c2d1e7aa9c6fbd9a"
[18:15:33.983] Popped gitiles commit info from properties and tags
[18:15:33.983] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:15:33.984] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:15:33.984] Buildbucket request:
{
"requestId": "8863180169539087488",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "604ca97080e54a3aa8f59f79c2d1e7aa9c6fbd9a",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8863180169539087488"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:15:34.404] Scheduled build:
{
"id": "8697750107641367873",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 29947,
"createdBy": "project:chromium",
"createTime": "2025-11-19T18:15:34.030588070Z",
"updateTime": "2025-11-19T18:15:34.030588070Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "604ca97080e54a3aa8f59f79c2d1e7aa9c6fbd9a",
"ref": "refs/heads/main"
}
}
}
[18:15:34.404] Task URL: https://cr-buildbucket.appspot.com/build/8697750107641367873
[18:15:34.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:2:0) after 9m56s
[18:15:35.433] Received PubSub notification, asking Buildbucket for the build status
[18:15:35.454] Build status: SCHEDULED
[18:15:39.495] Received PubSub notification, asking Buildbucket for the build status
[18:15:39.569] Build status: STARTED
[18:25:30.420] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:2:0)
[18:25:30.439] Build status: STARTED
[18:25:30.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:5:0) after 5m38s
[18:31:08.585] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:5:0)
[18:31:08.670] Build status: STARTED
[18:31:08.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:6:0) after 3m12s
[18:34:20.738] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:6:0)
[18:34:20.759] Build status: STARTED
[18:34:20.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:7:0) after 4m31s
[18:38:51.775] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:7:0)
[18:38:51.801] Build status: STARTED
[18:38:51.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:8:0) after 8m27s
[18:47:18.903] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:8:0)
[18:47:18.920] Build status: STARTED
[18:47:18.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:9:0) after 7m14s
[18:54:32.986] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:9:0)
[18:54:33.001] Build status: STARTED
[18:54:33.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:10:0) after 8m55s
[19:03:28.077] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:10:0)
[19:03:28.095] Build status: STARTED
[19:03:28.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:11:0) after 6m30s
[19:09:58.124] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:11:0)
[19:09:58.143] Build status: STARTED
[19:09:58.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:12:0) after 9m29s
[19:19:27.224] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:12:0)
[19:19:27.249] Build status: STARTED
[19:19:27.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:13:0) after 6m14s
[19:25:41.286] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:13:0)
[19:25:41.317] Build status: STARTED
[19:25:41.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:14:0) after 4m44s
[19:30:25.321] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:14:0)
[19:30:25.336] Build status: STARTED
[19:30:25.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:15:0) after 6m26s
[19:36:51.433] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:15:0)
[19:36:51.453] Build status: STARTED
[19:36:51.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:16:0) after 6m38s
[19:43:29.619] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:16:0)
[19:43:29.680] Build status: STARTED
[19:43:29.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:17:0) after 5m49s
[19:49:18.750] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:17:0)
[19:49:18.767] Build status: STARTED
[19:49:18.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:18:0) after 1m14s
[19:50:32.790] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:18:0)
[19:50:32.826] Build status: STARTED
[19:50:32.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:19:0) after 4m9s
[19:54:41.883] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:19:0)
[19:54:41.899] Build status: STARTED
[19:54:41.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:20:0) after 1m20s
[19:56:01.949] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:20:0)
[19:56:01.987] Build status: STARTED
[19:56:01.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:21:0) after 7m40s
[20:03:42.007] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:21:0)
[20:03:42.108] Build status: STARTED
[20:03:42.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:22:0) after 6m5s
[20:09:47.088] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:22:0)
[20:09:47.101] Build status: STARTED
[20:09:47.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:23:0) after 6m40s
[20:16:27.119] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:23:0)
[20:16:27.134] Build status: STARTED
[20:16:27.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:24:0) after 6m55s
[20:23:22.262] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:24:0)
[20:23:22.277] Build status: STARTED
[20:23:22.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:25:0) after 8m35s
[20:31:57.345] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:25:0)
[20:31:57.409] Build status: STARTED
[20:31:57.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:26:0) after 6m24s
[20:38:21.477] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:26:0)
[20:38:21.498] Build status: STARTED
[20:38:21.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:27:0) after 6m45s
[20:45:06.517] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:27:0)
[20:45:06.535] Build status: STARTED
[20:45:06.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:28:0) after 1m35s
[20:46:41.597] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:28:0)
[20:46:41.610] Build status: STARTED
[20:46:41.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:29:0) after 3m42s
[20:50:23.603] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:29:0)
[20:50:23.623] Build status: STARTED
[20:50:23.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:30:0) after 5m16s
[20:55:39.740] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:30:0)
[20:55:39.756] Build status: STARTED
[20:55:39.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:31:0) after 7m55s
[21:03:34.849] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:31:0)
[21:03:34.863] Build status: STARTED
[21:03:34.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:32:0) after 7m59s
[21:11:33.882] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:32:0)
[21:11:33.898] Build status: STARTED
[21:11:33.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:33:0) after 4m48s
[21:16:21.975] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:33:0)
[21:16:21.988] Build status: STARTED
[21:16:21.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:34:0) after 1m44s
[21:18:06.005] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:34:0)
[21:18:06.020] Build status: STARTED
[21:18:06.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:35:0) after 7m57s
[21:26:03.081] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:35:0)
[21:26:03.097] Build status: STARTED
[21:26:03.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:36:0) after 9m45s
[21:35:48.128] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:36:0)
[21:35:48.143] Build status: STARTED
[21:35:48.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:37:0) after 4m14s
[21:40:02.157] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:37:0)
[21:40:02.174] Build status: STARTED
[21:40:02.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:38:0) after 9m26s
[21:49:28.191] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:38:0)
[21:49:28.209] Build status: STARTED
[21:49:28.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:39:0) after 9m25s
[21:58:53.225] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:39:0)
[21:58:53.238] Build status: STARTED
[21:58:53.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:40:0) after 2m58s
[22:01:51.473] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:40:0)
[22:01:51.487] Build status: STARTED
[22:01:51.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:41:0) after 8m29s
[22:10:20.504] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:41:0)
[22:10:20.517] Build status: STARTED
[22:10:20.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:42:0) after 4m19s
[22:14:39.632] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:42:0)
[22:14:39.650] Build status: STARTED
[22:14:39.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:43:0) after 8m4s
[22:22:43.898] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:43:0)
[22:22:43.914] Build status: STARTED
[22:22:43.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:44:0) after 3m3s
[22:25:46.925] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:44:0)
[22:25:46.944] Build status: STARTED
[22:25:46.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:45:0) after 2m37s
[22:28:24.087] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:45:0)
[22:28:24.102] Build status: STARTED
[22:28:24.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:46:0) after 9m25s
[22:37:49.155] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:46:0)
[22:37:49.169] Build status: STARTED
[22:37:49.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8863180169539087488:47:0) after 9m56s
[22:40:59.663] Received PubSub notification, asking Buildbucket for the build status
[22:40:59.682] Build:
{
"id": "8697750107641367873",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 29947,
"createdBy": "project:chromium",
"createTime": "2025-11-19T18:15:34.030588070Z",
"startTime": "2025-11-19T18:15:39.310785523Z",
"endTime": "2025-11-19T22:40:59.180512888Z",
"updateTime": "2025-11-19T22:40:59.180512888Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "604ca97080e54a3aa8f59f79c2d1e7aa9c6fbd9a",
"ref": "refs/heads/main"
}
}
}
[22:40:59.682] Invocation finished in 4h25m26.844951898s with status FAILED