[20:43:45.502] New invocation is queued and will start shortly
[20:43:46.915] Starting the invocation (attempt 1)
[20:43:46.942] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9415609237a0de2647e015f3065f0930b8943cec"
[20:43:46.942] Popped gitiles commit info from properties and tags
[20:43:46.942] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:43:46.943] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:43:46.943] Buildbucket request:
{
"requestId": "8932477524213142944",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9415609237a0de2647e015f3065f0930b8943cec",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8932477524213142944"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:43:47.539] Scheduled build:
{
"id": "8767047461987171921",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 20898,
"createdBy": "project:chromium",
"createTime": "2023-10-16T20:43:46.996231902Z",
"updateTime": "2023-10-16T20:43:46.996231902Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9415609237a0de2647e015f3065f0930b8943cec",
"ref": "refs/heads/main"
}
}
}
[20:43:47.539] Task URL: https://cr-buildbucket.appspot.com/build/8767047461987171921
[20:43:47.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:2:0) after 9m37s
[20:43:48.523] Received PubSub notification, asking Buildbucket for the build status
[20:43:48.541] Build status: SCHEDULED
[20:45:39.724] Received PubSub notification, asking Buildbucket for the build status
[20:45:39.750] Build status: STARTED
[20:53:24.710] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:2:0)
[20:53:24.770] Build status: STARTED
[20:53:24.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:5:0) after 8m35s
[21:01:59.803] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:5:0)
[21:01:59.826] Build status: STARTED
[21:01:59.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:6:0) after 3m34s
[21:05:33.854] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:6:0)
[21:05:33.878] Build status: STARTED
[21:05:33.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:7:0) after 3m13s
[21:08:46.895] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:7:0)
[21:08:46.924] Build status: STARTED
[21:08:46.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:8:0) after 5m21s
[21:14:08.007] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:8:0)
[21:14:08.072] Build status: STARTED
[21:14:08.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:9:0) after 1m30s
[21:15:38.167] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:9:0)
[21:15:38.186] Build status: STARTED
[21:15:38.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:10:0) after 2m13s
[21:17:51.226] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:10:0)
[21:17:51.246] Build status: STARTED
[21:17:51.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:11:0) after 7m14s
[21:25:05.514] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:11:0)
[21:25:05.532] Build status: STARTED
[21:25:05.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:12:0) after 6m20s
[21:31:25.643] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:12:0)
[21:31:25.660] Build status: STARTED
[21:31:25.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:13:0) after 2m11s
[21:33:36.683] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:13:0)
[21:33:36.700] Build status: STARTED
[21:33:36.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:14:0) after 9m32s
[21:43:08.790] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:14:0)
[21:43:08.814] Build status: STARTED
[21:43:08.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:15:0) after 1m55s
[21:45:04.358] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:15:0)
[21:45:04.383] Build status: STARTED
[21:45:04.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:16:0) after 7m39s
[21:52:43.503] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:16:0)
[21:52:43.521] Build status: STARTED
[21:52:43.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:17:0) after 7m21s
[22:00:04.788] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:17:0)
[22:00:04.892] Build status: STARTED
[22:00:04.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:18:0) after 3m42s
[22:03:47.004] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:18:0)
[22:03:47.025] Build status: STARTED
[22:03:47.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:19:0) after 6m3s
[22:09:50.048] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:19:0)
[22:09:50.069] Build status: STARTED
[22:09:50.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:20:0) after 6m23s
[22:16:13.092] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:20:0)
[22:16:13.109] Build status: STARTED
[22:16:13.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:21:0) after 5m26s
[22:21:39.240] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:21:0)
[22:21:39.276] Build status: STARTED
[22:21:39.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:22:0) after 5m3s
[22:26:42.321] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:22:0)
[22:26:42.355] Build status: STARTED
[22:26:42.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:23:0) after 9m54s
[22:36:36.373] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:23:0)
[22:36:36.432] Build status: STARTED
[22:36:36.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:24:0) after 2m21s
[22:38:57.499] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:24:0)
[22:38:57.634] Build status: STARTED
[22:38:57.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:25:0) after 4m11s
[22:43:08.677] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:25:0)
[22:43:08.696] Build status: STARTED
[22:43:08.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:26:0) after 2m22s
[22:45:30.778] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:26:0)
[22:45:30.802] Build status: STARTED
[22:45:30.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:27:0) after 3m6s
[22:48:36.903] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:27:0)
[22:48:36.926] Build status: STARTED
[22:48:36.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:28:0) after 6m55s
[22:55:31.943] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:28:0)
[22:55:31.961] Build status: STARTED
[22:55:31.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:29:0) after 5m59s
[23:01:30.989] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:29:0)
[23:01:31.566] Build status: STARTED
[23:01:31.566] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:30:0) after 1m46s
[23:03:17.825] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:30:0)
[23:03:17.846] Build status: STARTED
[23:03:17.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:31:0) after 6m33s
[23:09:50.868] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:31:0)
[23:09:50.940] Build status: STARTED
[23:09:50.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:32:0) after 5m33s
[23:15:24.057] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:32:0)
[23:15:24.093] Build status: STARTED
[23:15:24.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:33:0) after 9m30s
[23:24:54.137] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:33:0)
[23:24:54.161] Build status: STARTED
[23:24:54.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:34:0) after 8m2s
[23:32:56.417] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:34:0)
[23:32:56.444] Build status: STARTED
[23:32:56.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:35:0) after 4m23s
[23:37:19.541] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:35:0)
[23:37:19.561] Build status: STARTED
[23:37:19.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:36:0) after 9m40s
[23:46:59.682] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:36:0)
[23:46:59.707] Build status: STARTED
[23:46:59.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:37:0) after 7m47s
[23:54:46.728] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:37:0)
[23:54:46.744] Build status: STARTED
[23:54:46.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:38:0) after 8m20s
[00:03:06.870] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:38:0)
[00:03:06.899] Build status: STARTED
[00:03:06.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:39:0) after 5m25s
[00:08:32.159] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:39:0)
[00:08:32.175] Build status: STARTED
[00:08:32.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:40:0) after 6m28s
[00:15:00.198] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:40:0)
[00:15:00.218] Build status: STARTED
[00:15:00.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:41:0) after 2m44s
[00:17:44.706] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:41:0)
[00:17:44.819] Build status: STARTED
[00:17:44.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:42:0) after 2m31s
[00:20:15.931] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:42:0)
[00:20:15.991] Build status: STARTED
[00:20:15.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:43:0) after 6m2s
[00:26:18.087] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:43:0)
[00:26:18.114] Build status: STARTED
[00:26:18.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:44:0) after 4m20s
[00:30:38.390] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:44:0)
[00:30:38.421] Build status: STARTED
[00:30:38.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:45:0) after 1m53s
[00:32:31.487] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:45:0)
[00:32:31.503] Build status: STARTED
[00:32:31.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:46:0) after 8m51s
[00:41:23.260] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:46:0)
[00:41:23.281] Build status: STARTED
[00:41:23.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:47:0) after 2m23s
[00:43:46.311] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:47:0)
[00:43:46.350] Build status: STARTED
[00:43:46.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:48:0) after 9m44s
[00:53:30.747] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:48:0)
[00:53:30.849] Build status: STARTED
[00:53:30.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:49:0) after 7m20s
[01:00:51.489] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:49:0)
[01:00:51.515] Build status: STARTED
[01:00:51.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:50:0) after 8m9s
[01:09:00.864] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:50:0)
[01:09:00.881] Build status: STARTED
[01:09:00.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:51:0) after 4m29s
[01:13:30.095] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:51:0)
[01:13:30.135] Build status: STARTED
[01:13:30.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:52:0) after 5m19s
[01:18:49.133] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:52:0)
[01:18:49.158] Build status: STARTED
[01:18:49.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:53:0) after 9m1s
[01:27:50.389] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:53:0)
[01:27:50.404] Build status: STARTED
[01:27:50.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:54:0) after 7m3s
[01:34:53.427] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:54:0)
[01:34:53.443] Build status: STARTED
[01:34:53.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:55:0) after 6m1s
[01:40:54.494] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:55:0)
[01:40:54.516] Build status: STARTED
[01:40:54.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:56:0) after 2m6s
[01:43:00.505] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:56:0)
[01:43:00.522] Build status: STARTED
[01:43:00.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:57:0) after 4m16s
[01:47:16.613] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:57:0)
[01:47:16.704] Build status: STARTED
[01:47:16.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:58:0) after 4m52s
[01:52:08.723] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:58:0)
[01:52:08.747] Build status: STARTED
[01:52:08.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:59:0) after 9m59s
[02:02:07.771] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:59:0)
[02:02:07.845] Build status: STARTED
[02:02:07.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:60:0) after 1m32s
[02:03:40.469] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:60:0)
[02:03:40.489] Build status: STARTED
[02:03:40.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:61:0) after 7m37s
[02:11:17.572] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:61:0)
[02:11:17.591] Build status: STARTED
[02:11:17.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:62:0) after 6m24s
[02:17:41.716] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:62:0)
[02:17:41.741] Build status: STARTED
[02:17:41.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:63:0) after 1m53s
[02:19:35.118] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:63:0)
[02:19:35.158] Build status: STARTED
[02:19:35.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:64:0) after 9m48s
[02:29:23.184] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:64:0)
[02:29:23.201] Build status: STARTED
[02:29:23.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932477524213142944:65:0) after 4m57s
[02:31:52.095] Received PubSub notification, asking Buildbucket for the build status
[02:31:52.115] Build:
{
"id": "8767047461987171921",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 20898,
"createdBy": "project:chromium",
"createTime": "2023-10-16T20:43:46.996231902Z",
"startTime": "2023-10-16T20:45:39.501426096Z",
"endTime": "2023-10-17T02:31:51.701444542Z",
"updateTime": "2023-10-17T02:31:51.701444542Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9415609237a0de2647e015f3065f0930b8943cec",
"ref": "refs/heads/main"
}
}
}
[02:31:52.115] Invocation finished in 5h48m6.626504577s with status FAILED