[07:35:06.291] New invocation is queued and will start shortly
[07:35:07.397] Starting the invocation (attempt 1)
[07:35:07.426] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/0207a292136d07b72e0337a61c042d9a3301ae90"
[07:35:07.426] Popped gitiles commit info from properties and tags
[07:35:07.426] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[07:35:07.426] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[07:35:07.426] Buildbucket request:
{
"requestId": "8932436545029626592",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0207a292136d07b72e0337a61c042d9a3301ae90",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8932436545029626592"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[07:35:08.024] Scheduled build:
{
"id": "8767006483054920529",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 20900,
"createdBy": "project:chromium",
"createTime": "2023-10-17T07:35:07.551740024Z",
"updateTime": "2023-10-17T07:35:07.551740024Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0207a292136d07b72e0337a61c042d9a3301ae90",
"ref": "refs/heads/main"
}
}
}
[07:35:08.024] Task URL: https://cr-buildbucket.appspot.com/build/8767006483054920529
[07:35:08.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:2:0) after 5m10s
[07:35:09.132] Received PubSub notification, asking Buildbucket for the build status
[07:35:09.302] Build status: SCHEDULED
[07:35:10.040] Received PubSub notification, asking Buildbucket for the build status
[07:35:10.072] Build status: STARTED
[07:40:18.159] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:2:0)
[07:40:18.186] Build status: STARTED
[07:40:18.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:5:0) after 1m34s
[07:41:52.445] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:5:0)
[07:41:52.462] Build status: STARTED
[07:41:52.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:6:0) after 8m52s
[07:50:44.527] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:6:0)
[07:50:44.555] Build status: STARTED
[07:50:44.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:7:0) after 2m13s
[07:52:57.693] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:7:0)
[07:52:57.790] Build status: STARTED
[07:52:57.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:8:0) after 5m55s
[07:58:53.311] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:8:0)
[07:58:53.327] Build status: STARTED
[07:58:53.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:9:0) after 8m4s
[08:06:57.385] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:9:0)
[08:06:57.399] Build status: STARTED
[08:06:57.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:10:0) after 9m50s
[08:16:47.567] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:10:0)
[08:16:47.747] Build status: STARTED
[08:16:47.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:11:0) after 9m14s
[08:26:02.307] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:11:0)
[08:26:02.325] Build status: STARTED
[08:26:02.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:12:0) after 8m20s
[08:34:22.423] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:12:0)
[08:34:22.514] Build status: STARTED
[08:34:22.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:13:0) after 3m33s
[08:37:55.862] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:13:0)
[08:37:55.882] Build status: STARTED
[08:37:55.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:14:0) after 7m53s
[08:45:49.153] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:14:0)
[08:45:49.171] Build status: STARTED
[08:45:49.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:15:0) after 5m15s
[08:51:04.302] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:15:0)
[08:51:04.356] Build status: STARTED
[08:51:04.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:16:0) after 3m34s
[08:54:38.477] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:16:0)
[08:54:38.507] Build status: STARTED
[08:54:38.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:17:0) after 6m39s
[09:01:17.969] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:17:0)
[09:01:17.986] Build status: STARTED
[09:01:17.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:18:0) after 2m28s
[09:03:46.108] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:18:0)
[09:03:46.134] Build status: STARTED
[09:03:46.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:19:0) after 3m15s
[09:07:01.299] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:19:0)
[09:07:01.322] Build status: STARTED
[09:07:01.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:20:0) after 2m46s
[09:09:47.499] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:20:0)
[09:09:47.579] Build status: STARTED
[09:09:47.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:21:0) after 7m9s
[09:16:56.654] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:21:0)
[09:16:56.690] Build status: STARTED
[09:16:56.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:22:0) after 6m14s
[09:23:11.056] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:22:0)
[09:23:11.152] Build status: STARTED
[09:23:11.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:23:0) after 6m29s
[09:29:40.146] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:23:0)
[09:29:40.164] Build status: STARTED
[09:29:40.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:24:0) after 6m14s
[09:35:54.189] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:24:0)
[09:35:54.207] Build status: STARTED
[09:35:54.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:25:0) after 9m11s
[09:45:05.405] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:25:0)
[09:45:05.443] Build status: STARTED
[09:45:05.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:26:0) after 3m19s
[09:48:24.638] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:26:0)
[09:48:24.656] Build status: STARTED
[09:48:24.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:27:0) after 4m11s
[09:52:35.724] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:27:0)
[09:52:35.744] Build status: STARTED
[09:52:35.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:28:0) after 7m55s
[10:00:30.828] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:28:0)
[10:00:30.855] Build status: STARTED
[10:00:30.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:29:0) after 2m57s
[10:03:27.875] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:29:0)
[10:03:27.896] Build status: STARTED
[10:03:27.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:30:0) after 1m59s
[10:05:27.065] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:30:0)
[10:05:27.105] Build status: STARTED
[10:05:27.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:31:0) after 7m49s
[10:13:16.546] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:31:0)
[10:13:16.561] Build status: STARTED
[10:13:16.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:32:0) after 8m48s
[10:22:04.937] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:32:0)
[10:22:04.973] Build status: STARTED
[10:22:04.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:33:0) after 1m12s
[10:23:17.119] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:33:0)
[10:23:17.201] Build status: STARTED
[10:23:17.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:34:0) after 6m39s
[10:29:56.230] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:34:0)
[10:29:56.246] Build status: STARTED
[10:29:56.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:35:0) after 1m50s
[10:31:46.274] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:35:0)
[10:31:46.292] Build status: STARTED
[10:31:46.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:36:0) after 8m25s
[10:40:11.315] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:36:0)
[10:40:11.417] Build status: STARTED
[10:40:11.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:37:0) after 4m13s
[10:44:24.457] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:37:0)
[10:44:24.544] Build status: STARTED
[10:44:24.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:38:0) after 6m41s
[10:51:05.791] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:38:0)
[10:51:05.850] Build status: STARTED
[10:51:05.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:39:0) after 4m4s
[10:55:09.968] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:39:0)
[10:55:09.989] Build status: STARTED
[10:55:09.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:40:0) after 7m0s
[11:02:09.977] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:40:0)
[11:02:09.995] Build status: STARTED
[11:02:09.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:41:0) after 8m32s
[11:10:42.137] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:41:0)
[11:10:42.165] Build status: STARTED
[11:10:42.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:42:0) after 5m41s
[11:16:23.312] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:42:0)
[11:16:23.333] Build status: STARTED
[11:16:23.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:43:0) after 5m21s
[11:21:44.700] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:43:0)
[11:21:44.745] Build status: STARTED
[11:21:44.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:44:0) after 5m47s
[11:27:32.442] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:44:0)
[11:27:32.459] Build status: STARTED
[11:27:32.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:45:0) after 7m52s
[11:35:24.774] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:45:0)
[11:35:24.804] Build status: STARTED
[11:35:24.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:46:0) after 8m33s
[11:43:58.136] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:46:0)
[11:43:58.154] Build status: STARTED
[11:43:58.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:47:0) after 7m20s
[11:51:18.327] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:47:0)
[11:51:18.349] Build status: STARTED
[11:51:18.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:48:0) after 8m52s
[12:00:10.450] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:48:0)
[12:00:10.470] Build status: STARTED
[12:00:10.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:49:0) after 2m6s
[12:02:16.779] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:49:0)
[12:02:16.795] Build status: STARTED
[12:02:16.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:50:0) after 8m15s
[12:10:31.817] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:50:0)
[12:10:31.835] Build status: STARTED
[12:10:31.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:51:0) after 2m58s
[12:13:29.951] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:51:0)
[12:13:29.973] Build status: STARTED
[12:13:29.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:52:0) after 3m26s
[12:16:56.126] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:52:0)
[12:16:56.153] Build status: STARTED
[12:16:56.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:53:0) after 3m56s
[12:20:52.176] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:53:0)
[12:20:52.193] Build status: STARTED
[12:20:52.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:54:0) after 7m29s
[12:28:21.297] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:54:0)
[12:28:21.322] Build status: STARTED
[12:28:21.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:55:0) after 9m53s
[12:38:14.447] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:55:0)
[12:38:14.489] Build status: STARTED
[12:38:14.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:56:0) after 6m42s
[12:44:56.503] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:56:0)
[12:44:56.517] Build status: STARTED
[12:44:56.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:57:0) after 1m10s
[12:46:06.576] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:57:0)
[12:46:06.610] Build status: STARTED
[12:46:06.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:58:0) after 7m22s
[12:53:29.009] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:58:0)
[12:53:29.025] Build status: STARTED
[12:53:29.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:59:0) after 2m19s
[12:55:48.051] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:59:0)
[12:55:48.083] Build status: STARTED
[12:55:48.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:60:0) after 8m21s
[13:04:09.340] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:60:0)
[13:04:09.420] Build status: STARTED
[13:04:09.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:61:0) after 8m30s
[13:12:39.489] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:61:0)
[13:12:39.511] Build status: STARTED
[13:12:39.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:62:0) after 2m32s
[13:15:11.534] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:62:0)
[13:15:11.700] Build status: STARTED
[13:15:11.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:63:0) after 3m31s
[13:18:43.071] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:63:0)
[13:18:43.138] Build status: STARTED
[13:18:43.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8932436545029626592:64:0) after 8m23s
[13:20:28.386] Received PubSub notification, asking Buildbucket for the build status
[13:20:28.445] Build:
{
"id": "8767006483054920529",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 20900,
"createdBy": "project:chromium",
"createTime": "2023-10-17T07:35:07.551740024Z",
"startTime": "2023-10-17T07:35:08.941302Z",
"endTime": "2023-10-17T13:20:27.912245492Z",
"updateTime": "2023-10-17T13:20:27.912245492Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0207a292136d07b72e0337a61c042d9a3301ae90",
"ref": "refs/heads/main"
}
}
}
[13:20:28.445] Invocation finished in 5h45m22.160871901s with status FAILED