[08:10:51.192] New invocation is queued and will start shortly
[08:10:52.710] Starting the invocation (attempt 1)
[08:10:52.740] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e86ef9949d4b01b06fe70cf2d7732a44663c0462"
[08:10:52.740] Popped gitiles commit info from properties and tags
[08:10:52.740] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:10:52.740] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:10:52.740] Buildbucket request:
{
"requestId": "8968944873425113920",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e86ef9949d4b01b06fe70cf2d7732a44663c0462",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8968944873425113920"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:10:53.370] Scheduled build:
{
"id": "8803514811065607441",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 17531,
"createdBy": "project:chromium",
"createTime": "2022-09-09T08:10:52.792971410Z",
"updateTime": "2022-09-09T08:10:52.792971410Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e86ef9949d4b01b06fe70cf2d7732a44663c0462",
"ref": "refs/heads/main"
}
}
}
[08:10:53.370] Task URL: https://cr-buildbucket.appspot.com/build/8803514811065607441
[08:10:53.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:2:0) after 7m12s
[08:11:05.396] Received PubSub notification, asking Buildbucket for the build status
[08:11:05.418] Build status: STARTED
[08:18:05.520] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:2:0)
[08:18:05.542] Build status: STARTED
[08:18:05.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:4:0) after 3m4s
[08:21:09.565] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:4:0)
[08:21:09.589] Build status: STARTED
[08:21:09.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:5:0) after 2m27s
[08:23:36.764] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:5:0)
[08:23:36.821] Build status: STARTED
[08:23:36.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:6:0) after 4m50s
[08:28:26.840] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:6:0)
[08:28:26.866] Build status: STARTED
[08:28:26.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:7:0) after 6m26s
[08:34:52.889] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:7:0)
[08:34:52.913] Build status: STARTED
[08:34:52.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:8:0) after 1m4s
[08:35:57.027] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:8:0)
[08:35:57.050] Build status: STARTED
[08:35:57.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:9:0) after 2m48s
[08:38:45.070] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:9:0)
[08:38:45.096] Build status: STARTED
[08:38:45.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:10:0) after 4m19s
[08:43:04.594] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:10:0)
[08:43:04.617] Build status: STARTED
[08:43:04.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:11:0) after 7m18s
[08:50:22.691] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:11:0)
[08:50:22.714] Build status: STARTED
[08:50:22.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:12:0) after 5m51s
[08:56:13.782] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:12:0)
[08:56:13.806] Build status: STARTED
[08:56:13.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:13:0) after 5m49s
[09:02:02.797] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:13:0)
[09:02:02.820] Build status: STARTED
[09:02:02.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:14:0) after 6m46s
[09:08:48.840] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:14:0)
[09:08:48.870] Build status: STARTED
[09:08:48.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:15:0) after 3m0s
[09:11:49.036] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:15:0)
[09:11:49.065] Build status: STARTED
[09:11:49.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:16:0) after 8m27s
[09:20:16.711] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:16:0)
[09:20:16.741] Build status: STARTED
[09:20:16.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:17:0) after 3m2s
[09:23:18.772] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:17:0)
[09:23:18.799] Build status: STARTED
[09:23:18.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:18:0) after 9m55s
[09:33:13.821] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:18:0)
[09:33:13.844] Build status: STARTED
[09:33:13.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:19:0) after 3m40s
[09:36:54.139] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:19:0)
[09:36:54.165] Build status: STARTED
[09:36:54.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:20:0) after 7m36s
[09:44:30.504] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:20:0)
[09:44:30.525] Build status: STARTED
[09:44:30.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:21:0) after 5m6s
[09:49:36.764] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:21:0)
[09:49:36.789] Build status: STARTED
[09:49:36.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:22:0) after 7m45s
[09:57:22.109] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:22:0)
[09:57:22.144] Build status: STARTED
[09:57:22.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:23:0) after 2m38s
[10:00:00.225] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:23:0)
[10:00:00.253] Build status: STARTED
[10:00:00.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:24:0) after 5m33s
[10:05:33.450] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:24:0)
[10:05:33.484] Build status: STARTED
[10:05:33.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:25:0) after 2m59s
[10:08:32.651] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:25:0)
[10:08:32.674] Build status: STARTED
[10:08:32.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:26:0) after 5m30s
[10:14:02.692] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:26:0)
[10:14:02.714] Build status: STARTED
[10:14:02.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:27:0) after 9m35s
[10:23:37.940] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:27:0)
[10:23:37.963] Build status: STARTED
[10:23:37.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:28:0) after 2m57s
[10:26:35.009] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:28:0)
[10:26:35.040] Build status: STARTED
[10:26:35.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:29:0) after 5m44s
[10:32:19.074] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:29:0)
[10:32:19.103] Build status: STARTED
[10:32:19.103] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:30:0) after 5m59s
[10:38:18.121] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:30:0)
[10:38:18.147] Build status: STARTED
[10:38:18.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:31:0) after 9m19s
[10:47:37.301] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:31:0)
[10:47:37.326] Build status: STARTED
[10:47:37.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:32:0) after 5m15s
[10:52:52.482] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:32:0)
[10:52:52.510] Build status: STARTED
[10:52:52.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:33:0) after 5m26s
[10:58:18.617] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:33:0)
[10:58:18.647] Build status: STARTED
[10:58:18.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:34:0) after 5m48s
[11:04:06.869] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:34:0)
[11:04:06.898] Build status: STARTED
[11:04:06.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:35:0) after 1m56s
[11:06:03.450] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:35:0)
[11:06:03.475] Build status: STARTED
[11:06:03.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:36:0) after 1m25s
[11:07:28.501] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:36:0)
[11:07:28.524] Build status: STARTED
[11:07:28.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:37:0) after 4m51s
[11:12:19.552] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:37:0)
[11:12:19.593] Build status: STARTED
[11:12:19.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:38:0) after 9m43s
[11:22:02.649] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:38:0)
[11:22:02.764] Build status: STARTED
[11:22:02.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:39:0) after 8m21s
[11:30:23.785] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:39:0)
[11:30:23.812] Build status: STARTED
[11:30:23.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:40:0) after 6m24s
[11:36:47.895] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:40:0)
[11:36:47.918] Build status: STARTED
[11:36:47.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:41:0) after 4m36s
[11:41:23.941] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:41:0)
[11:41:23.969] Build status: STARTED
[11:41:23.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:42:0) after 6m58s
[11:48:21.989] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:42:0)
[11:48:22.015] Build status: STARTED
[11:48:22.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:43:0) after 7m33s
[11:55:55.188] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:43:0)
[11:55:55.213] Build status: STARTED
[11:55:55.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:44:0) after 4m32s
[12:00:27.289] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:44:0)
[12:00:27.360] Build status: STARTED
[12:00:27.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:45:0) after 1m2s
[12:01:29.440] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:45:0)
[12:01:29.465] Build status: STARTED
[12:01:29.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:46:0) after 4m30s
[12:05:59.732] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:46:0)
[12:05:59.804] Build status: STARTED
[12:05:59.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:47:0) after 4m22s
[12:10:21.924] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:47:0)
[12:10:21.957] Build status: STARTED
[12:10:21.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:48:0) after 9m1s
[12:19:23.037] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:48:0)
[12:19:23.062] Build status: STARTED
[12:19:23.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:49:0) after 6m56s
[12:26:19.262] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:49:0)
[12:26:19.284] Build status: STARTED
[12:26:19.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:50:0) after 9m1s
[12:35:20.499] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:50:0)
[12:35:20.520] Build status: STARTED
[12:35:20.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:51:0) after 2m34s
[12:37:54.548] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:51:0)
[12:37:54.576] Build status: STARTED
[12:37:54.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:52:0) after 6m25s
[12:44:19.568] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:52:0)
[12:44:19.595] Build status: STARTED
[12:44:19.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:53:0) after 6m51s
[12:51:10.697] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:53:0)
[12:51:10.722] Build status: STARTED
[12:51:10.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:54:0) after 3m12s
[12:54:22.722] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:54:0)
[12:54:22.840] Build status: STARTED
[12:54:22.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:55:0) after 6m28s
[13:00:51.032] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:55:0)
[13:00:51.106] Build status: STARTED
[13:00:51.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:56:0) after 6m45s
[13:07:36.114] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:56:0)
[13:07:36.142] Build status: STARTED
[13:07:36.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:57:0) after 6m42s
[13:14:18.200] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:57:0)
[13:14:18.223] Build status: STARTED
[13:14:18.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:58:0) after 3m8s
[13:17:26.329] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:58:0)
[13:17:26.356] Build status: STARTED
[13:17:26.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:59:0) after 7m34s
[13:25:00.552] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:59:0)
[13:25:00.579] Build status: STARTED
[13:25:00.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:60:0) after 2m51s
[13:27:51.718] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:60:0)
[13:27:51.753] Build status: STARTED
[13:27:51.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:61:0) after 5m15s
[13:33:06.948] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:61:0)
[13:33:06.972] Build status: STARTED
[13:33:06.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:62:0) after 3m10s
[13:36:17.089] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:62:0)
[13:36:17.111] Build status: STARTED
[13:36:17.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:63:0) after 7m26s
[13:43:43.245] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:63:0)
[13:43:43.269] Build status: STARTED
[13:43:43.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:64:0) after 1m23s
[13:45:06.343] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:64:0)
[13:45:06.363] Build status: STARTED
[13:45:06.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:65:0) after 8m42s
[13:53:48.489] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:65:0)
[13:53:48.514] Build status: STARTED
[13:53:48.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:66:0) after 1m41s
[13:55:29.888] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:66:0)
[13:55:29.913] Build status: STARTED
[13:55:29.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8968944873425113920:67:0) after 7m49s
[13:56:41.278] Received PubSub notification, asking Buildbucket for the build status
[13:56:41.305] Build:
{
"id": "8803514811065607441",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 17531,
"createdBy": "project:chromium",
"createTime": "2022-09-09T08:10:52.792971410Z",
"startTime": "2022-09-09T08:11:04.544389Z",
"endTime": "2022-09-09T13:56:40.989597764Z",
"updateTime": "2022-09-09T13:56:40.989597764Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e86ef9949d4b01b06fe70cf2d7732a44663c0462",
"ref": "refs/heads/main"
}
}
}
[13:56:41.305] Invocation finished in 5h45m50.147416843s with status FAILED