[21:21:29.101] New invocation is queued and will start shortly
[21:21:30.179] Starting the invocation (attempt 1)
[21:21:30.202] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/1de7092c9263f0423c4f872f1d4227cb3a11c0a5"
[21:21:30.202] Popped gitiles commit info from properties and tags
[21:21:30.202] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:21:30.203] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:21:30.204] Buildbucket request:
{
"requestId": "8860450562362711488",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1de7092c9263f0423c4f872f1d4227cb3a11c0a5",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8860450562362711488"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:21:30.676] Scheduled build:
{
"id": "8695020500498064209",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 30507,
"createdBy": "project:chromium",
"createTime": "2025-12-19T21:21:30.257700033Z",
"updateTime": "2025-12-19T21:21:30.257700033Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1de7092c9263f0423c4f872f1d4227cb3a11c0a5",
"ref": "refs/heads/main"
}
}
}
[21:21:30.676] Task URL: https://cr-buildbucket.appspot.com/build/8695020500498064209
[21:21:30.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:2:0) after 1m4s
[21:21:31.619] Received PubSub notification, asking Buildbucket for the build status
[21:21:31.634] Build status: SCHEDULED
[21:21:37.178] Received PubSub notification, asking Buildbucket for the build status
[21:21:37.202] Build status: STARTED
[21:22:34.695] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:2:0)
[21:22:34.710] Build status: STARTED
[21:22:34.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:5:0) after 8m46s
[21:31:20.792] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:5:0)
[21:31:20.815] Build status: STARTED
[21:31:20.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:6:0) after 9m50s
[21:41:10.898] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:6:0)
[21:41:10.910] Build status: STARTED
[21:41:10.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:7:0) after 6m12s
[21:47:22.959] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:7:0)
[21:47:22.975] Build status: STARTED
[21:47:22.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:8:0) after 3m33s
[21:50:56.032] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:8:0)
[21:50:56.049] Build status: STARTED
[21:50:56.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:9:0) after 4m37s
[21:55:33.109] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:9:0)
[21:55:33.132] Build status: STARTED
[21:55:33.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:10:0) after 9m44s
[22:05:17.147] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:10:0)
[22:05:17.190] Build status: STARTED
[22:05:17.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:11:0) after 5m11s
[22:10:28.208] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:11:0)
[22:10:28.222] Build status: STARTED
[22:10:28.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:12:0) after 9m3s
[22:19:31.370] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:12:0)
[22:19:31.384] Build status: STARTED
[22:19:31.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:13:0) after 2m38s
[22:22:09.410] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:13:0)
[22:22:09.426] Build status: STARTED
[22:22:09.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:14:0) after 2m19s
[22:24:28.446] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:14:0)
[22:24:28.467] Build status: STARTED
[22:24:28.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:15:0) after 5m9s
[22:29:37.508] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:15:0)
[22:29:37.522] Build status: STARTED
[22:29:37.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:16:0) after 7m25s
[22:37:02.539] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:16:0)
[22:37:02.563] Build status: STARTED
[22:37:02.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:17:0) after 3m26s
[22:40:28.597] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:17:0)
[22:40:28.611] Build status: STARTED
[22:40:28.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:18:0) after 4m2s
[22:44:30.628] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:18:0)
[22:44:30.655] Build status: STARTED
[22:44:30.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:19:0) after 8m1s
[22:52:31.690] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:19:0)
[22:52:31.718] Build status: STARTED
[22:52:31.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:20:0) after 2m55s
[22:55:26.695] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:20:0)
[22:55:26.746] Build status: STARTED
[22:55:26.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:21:0) after 1m39s
[22:57:05.836] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:21:0)
[22:57:05.853] Build status: STARTED
[22:57:05.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:22:0) after 2m40s
[22:59:45.861] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:22:0)
[22:59:45.876] Build status: STARTED
[22:59:45.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:23:0) after 1m50s
[23:01:35.976] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:23:0)
[23:01:35.996] Build status: STARTED
[23:01:35.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:24:0) after 6m37s
[23:08:13.155] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:24:0)
[23:08:13.171] Build status: STARTED
[23:08:13.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:25:0) after 7m4s
[23:15:17.215] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:25:0)
[23:15:17.230] Build status: STARTED
[23:15:17.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:26:0) after 6m9s
[23:21:26.216] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:26:0)
[23:21:26.249] Build status: STARTED
[23:21:26.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:27:0) after 1m12s
[23:22:38.268] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:27:0)
[23:22:38.281] Build status: STARTED
[23:22:38.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:28:0) after 6m6s
[23:28:44.297] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:28:0)
[23:28:44.330] Build status: STARTED
[23:28:44.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:29:0) after 2m32s
[23:31:16.482] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:29:0)
[23:31:16.504] Build status: STARTED
[23:31:16.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:30:0) after 2m13s
[23:33:29.632] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:30:0)
[23:33:29.646] Build status: STARTED
[23:33:29.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:31:0) after 1m56s
[23:35:25.666] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:31:0)
[23:35:25.737] Build status: STARTED
[23:35:25.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:32:0) after 6m0s
[23:41:25.869] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:32:0)
[23:41:25.885] Build status: STARTED
[23:41:25.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:33:0) after 4m24s
[23:45:49.908] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:33:0)
[23:45:49.939] Build status: STARTED
[23:45:49.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:34:0) after 9m31s
[23:55:20.957] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:34:0)
[23:55:20.993] Build status: STARTED
[23:55:20.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:35:0) after 6m42s
[00:02:03.009] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:35:0)
[00:02:03.033] Build status: STARTED
[00:02:03.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:36:0) after 7m46s
[00:09:49.093] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:36:0)
[00:09:49.108] Build status: STARTED
[00:09:49.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:37:0) after 9m13s
[00:19:02.182] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:37:0)
[00:19:02.203] Build status: STARTED
[00:19:02.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:38:0) after 7m42s
[00:26:44.260] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:38:0)
[00:26:44.277] Build status: STARTED
[00:26:44.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:39:0) after 2m9s
[00:28:53.318] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:39:0)
[00:28:53.367] Build status: STARTED
[00:28:53.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:40:0) after 3m15s
[00:32:08.393] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:40:0)
[00:32:08.438] Build status: STARTED
[00:32:08.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:41:0) after 4m49s
[00:36:57.604] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:41:0)
[00:36:57.664] Build status: STARTED
[00:36:57.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:42:0) after 6m38s
[00:43:35.738] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:42:0)
[00:43:35.758] Build status: STARTED
[00:43:35.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:43:0) after 8m24s
[00:51:59.773] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:43:0)
[00:51:59.920] Build status: STARTED
[00:51:59.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:44:0) after 1m13s
[00:53:12.934] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:44:0)
[00:53:12.986] Build status: STARTED
[00:53:12.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:45:0) after 9m56s
[01:03:09.092] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:45:0)
[01:03:09.126] Build status: STARTED
[01:03:09.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:46:0) after 2m11s
[01:05:20.145] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:46:0)
[01:05:20.164] Build status: STARTED
[01:05:20.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:47:0) after 6m46s
[01:12:06.250] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:47:0)
[01:12:06.272] Build status: STARTED
[01:12:06.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:48:0) after 4m47s
[01:16:53.290] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:48:0)
[01:16:53.306] Build status: STARTED
[01:16:53.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:49:0) after 5m4s
[01:21:57.330] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:49:0)
[01:21:57.343] Build status: STARTED
[01:21:57.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:50:0) after 5m58s
[01:27:55.414] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:50:0)
[01:27:55.426] Build status: STARTED
[01:27:55.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:51:0) after 2m3s
[01:29:58.453] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:51:0)
[01:29:58.501] Build status: STARTED
[01:29:58.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:52:0) after 8m17s
[01:38:15.569] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:52:0)
[01:38:15.582] Build status: STARTED
[01:38:15.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:53:0) after 6m11s
[01:44:26.675] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:53:0)
[01:44:26.711] Build status: STARTED
[01:44:26.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:54:0) after 3m48s
[01:48:14.731] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:54:0)
[01:48:14.748] Build status: STARTED
[01:48:14.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8860450562362711488:55:0) after 9m8s
[01:53:42.527] Received PubSub notification, asking Buildbucket for the build status
[01:53:42.543] Build:
{
"id": "8695020500498064209",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 30507,
"createdBy": "project:chromium",
"createTime": "2025-12-19T21:21:30.257700033Z",
"startTime": "2025-12-19T21:21:35.255873262Z",
"endTime": "2025-12-20T01:53:42.301885002Z",
"updateTime": "2025-12-20T01:53:42.301885002Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1de7092c9263f0423c4f872f1d4227cb3a11c0a5",
"ref": "refs/heads/main"
}
}
}
[01:53:42.543] Invocation finished in 4h32m13.44779349s with status FAILED