[23:27:43.001] New invocation is queued and will start shortly
[23:27:44.967] Starting the invocation (attempt 1)
[23:27:45.003] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d253671505c730f79dd067bfa4936f3bff1bb042"
[23:27:45.003] Popped gitiles commit info from properties and tags
[23:27:45.003] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:27:45.003] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:27:45.004] Buildbucket request:
{
"requestId": "8981661361604363536",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d253671505c730f79dd067bfa4936f3bff1bb042",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8981661361604363536"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:27:46.179] Scheduled build:
{
"id": "8816231298748084097",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 15973,
"createdBy": "project:chromium",
"createTime": "2022-04-21T23:27:45.095630943Z",
"updateTime": "2022-04-21T23:27:45.095630943Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d253671505c730f79dd067bfa4936f3bff1bb042",
"ref": "refs/heads/main"
}
}
}
[23:27:46.179] Task URL: https://cr-buildbucket.appspot.com/build/8816231298748084097
[23:27:46.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:2:0) after 6m30s
[23:29:19.683] Received PubSub notification, asking Buildbucket for the build status
[23:29:19.706] Build status: STARTED
[23:34:16.278] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:2:0)
[23:34:16.298] Build status: STARTED
[23:34:16.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:4:0) after 2m41s
[23:36:57.382] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:4:0)
[23:36:57.403] Build status: STARTED
[23:36:57.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:5:0) after 4m52s
[23:41:49.454] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:5:0)
[23:41:49.561] Build status: STARTED
[23:41:49.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:6:0) after 2m1s
[23:43:50.582] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:6:0)
[23:43:50.607] Build status: STARTED
[23:43:50.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:7:0) after 1m18s
[23:45:08.881] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:7:0)
[23:45:08.933] Build status: STARTED
[23:45:08.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:8:0) after 8m25s
[23:53:34.028] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:8:0)
[23:53:34.073] Build status: STARTED
[23:53:34.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:9:0) after 1m12s
[23:54:46.220] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:9:0)
[23:54:46.238] Build status: STARTED
[23:54:46.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:10:0) after 1m12s
[23:55:58.535] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:10:0)
[23:55:58.558] Build status: STARTED
[23:55:58.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:11:0) after 1m5s
[23:57:03.736] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:11:0)
[23:57:03.770] Build status: STARTED
[23:57:03.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:12:0) after 8m52s
[00:05:55.921] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:12:0)
[00:05:55.939] Build status: STARTED
[00:05:55.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:13:0) after 5m9s
[00:11:05.051] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:13:0)
[00:11:05.124] Build status: STARTED
[00:11:05.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:14:0) after 7m11s
[00:18:16.500] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:14:0)
[00:18:16.520] Build status: STARTED
[00:18:16.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:15:0) after 2m20s
[00:20:36.765] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:15:0)
[00:20:36.796] Build status: STARTED
[00:20:36.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:16:0) after 2m34s
[00:23:11.018] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:16:0)
[00:23:11.049] Build status: STARTED
[00:23:11.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:17:0) after 7m2s
[00:30:13.181] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:17:0)
[00:30:13.210] Build status: STARTED
[00:30:13.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:18:0) after 8m33s
[00:38:46.339] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:18:0)
[00:38:46.375] Build status: STARTED
[00:38:46.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:19:0) after 3m22s
[00:42:08.559] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:19:0)
[00:42:08.582] Build status: STARTED
[00:42:08.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:20:0) after 1m18s
[00:43:26.687] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:20:0)
[00:43:26.720] Build status: STARTED
[00:43:26.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:21:0) after 8m54s
[00:52:20.980] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:21:0)
[00:52:21.019] Build status: STARTED
[00:52:21.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:22:0) after 3m43s
[00:56:04.198] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:22:0)
[00:56:04.235] Build status: STARTED
[00:56:04.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:23:0) after 4m59s
[01:01:03.261] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:23:0)
[01:01:03.332] Build status: STARTED
[01:01:03.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:24:0) after 7m59s
[01:09:02.588] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:24:0)
[01:09:02.674] Build status: STARTED
[01:09:02.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:25:0) after 8m35s
[01:17:37.746] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:25:0)
[01:17:37.767] Build status: STARTED
[01:17:37.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:26:0) after 9m10s
[01:26:47.839] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:26:0)
[01:26:47.869] Build status: STARTED
[01:26:47.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:27:0) after 7m54s
[01:34:42.158] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:27:0)
[01:34:42.180] Build status: STARTED
[01:34:42.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:28:0) after 2m51s
[01:37:33.209] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:28:0)
[01:37:33.232] Build status: STARTED
[01:37:33.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:29:0) after 6m45s
[01:44:18.376] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:29:0)
[01:44:18.405] Build status: STARTED
[01:44:18.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:30:0) after 2m19s
[01:46:37.616] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:30:0)
[01:46:37.638] Build status: STARTED
[01:46:37.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:31:0) after 9m8s
[01:55:45.708] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:31:0)
[01:55:45.740] Build status: STARTED
[01:55:45.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:32:0) after 4m44s
[02:00:30.126] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:32:0)
[02:00:30.162] Build status: STARTED
[02:00:30.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:33:0) after 3m32s
[02:04:02.354] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:33:0)
[02:04:02.382] Build status: STARTED
[02:04:02.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:34:0) after 7m16s
[02:11:18.679] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:34:0)
[02:11:18.699] Build status: STARTED
[02:11:18.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:35:0) after 6m23s
[02:17:41.950] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:35:0)
[02:17:41.972] Build status: STARTED
[02:17:41.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:36:0) after 6m46s
[02:24:27.998] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:36:0)
[02:24:28.021] Build status: STARTED
[02:24:28.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:37:0) after 2m37s
[02:27:05.209] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:37:0)
[02:27:05.233] Build status: STARTED
[02:27:05.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:38:0) after 6m56s
[02:34:01.928] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:38:0)
[02:34:01.951] Build status: STARTED
[02:34:01.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:39:0) after 2m31s
[02:36:32.999] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:39:0)
[02:36:33.166] Build status: STARTED
[02:36:33.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:40:0) after 6m50s
[02:43:23.268] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:40:0)
[02:43:23.289] Build status: STARTED
[02:43:23.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:41:0) after 3m23s
[02:46:46.296] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:41:0)
[02:46:46.326] Build status: STARTED
[02:46:46.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:42:0) after 7m32s
[02:54:18.487] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:42:0)
[02:54:18.509] Build status: STARTED
[02:54:18.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:43:0) after 9m47s
[03:04:05.642] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:43:0)
[03:04:05.666] Build status: STARTED
[03:04:05.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:44:0) after 2m37s
[03:06:42.761] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:44:0)
[03:06:42.785] Build status: STARTED
[03:06:42.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:45:0) after 3m11s
[03:09:53.909] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:45:0)
[03:09:53.932] Build status: STARTED
[03:09:53.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:46:0) after 2m46s
[03:12:39.965] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:46:0)
[03:12:39.990] Build status: STARTED
[03:12:39.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:47:0) after 4m4s
[03:16:44.130] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:47:0)
[03:16:44.154] Build status: STARTED
[03:16:44.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:48:0) after 8m51s
[03:25:35.322] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:48:0)
[03:25:35.345] Build status: STARTED
[03:25:35.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:49:0) after 3m2s
[03:28:37.610] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:49:0)
[03:28:37.639] Build status: STARTED
[03:28:37.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:50:0) after 7m44s
[03:36:21.671] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:50:0)
[03:36:21.691] Build status: STARTED
[03:36:21.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:51:0) after 5m22s
[03:41:43.813] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:51:0)
[03:41:43.834] Build status: STARTED
[03:41:43.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:52:0) after 1m56s
[03:43:39.937] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:52:0)
[03:43:39.977] Build status: STARTED
[03:43:39.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:53:0) after 6m15s
[03:49:55.012] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:53:0)
[03:49:55.032] Build status: STARTED
[03:49:55.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:54:0) after 9m20s
[03:59:15.069] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:54:0)
[03:59:15.098] Build status: STARTED
[03:59:15.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:55:0) after 3m46s
[04:03:01.182] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:55:0)
[04:03:01.206] Build status: STARTED
[04:03:01.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:56:0) after 4m12s
[04:07:13.385] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:56:0)
[04:07:13.414] Build status: STARTED
[04:07:13.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:57:0) after 2m54s
[04:10:07.447] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:57:0)
[04:10:07.469] Build status: STARTED
[04:10:07.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:58:0) after 6m53s
[04:17:00.765] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:58:0)
[04:17:00.787] Build status: STARTED
[04:17:00.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:59:0) after 1m43s
[04:18:43.922] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:59:0)
[04:18:43.946] Build status: STARTED
[04:18:43.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:60:0) after 7m39s
[04:26:22.972] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:60:0)
[04:26:22.994] Build status: STARTED
[04:26:22.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:61:0) after 6m55s
[04:33:18.024] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:61:0)
[04:33:18.061] Build status: STARTED
[04:33:18.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:62:0) after 6m54s
[04:40:12.356] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:62:0)
[04:40:12.382] Build status: STARTED
[04:40:12.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:63:0) after 5m24s
[04:45:36.873] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:63:0)
[04:45:36.967] Build status: STARTED
[04:45:36.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:64:0) after 8m39s
[04:54:16.027] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:64:0)
[04:54:16.077] Build status: STARTED
[04:54:16.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:65:0) after 1m36s
[04:55:52.176] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:65:0)
[04:55:52.198] Build status: STARTED
[04:55:52.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:66:0) after 6m43s
[05:02:35.206] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:66:0)
[05:02:35.238] Build status: STARTED
[05:02:35.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:67:0) after 9m59s
[05:12:34.337] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:67:0)
[05:12:34.361] Build status: STARTED
[05:12:34.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981661361604363536:68:0) after 7m1s
[05:18:26.133] Received PubSub notification, asking Buildbucket for the build status
[05:18:26.156] Build:
{
"id": "8816231298748084097",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 15973,
"createdBy": "project:chromium",
"createTime": "2022-04-21T23:27:45.095630943Z",
"startTime": "2022-04-21T23:29:18.528329Z",
"endTime": "2022-04-22T05:18:25.788996825Z",
"updateTime": "2022-04-22T05:18:25.788996825Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d253671505c730f79dd067bfa4936f3bff1bb042",
"ref": "refs/heads/main"
}
}
}
[05:18:26.156] Invocation finished in 5h50m43.168897035s with status FAILED