[09:53:10.305] New invocation is queued and will start shortly
[09:53:11.511] Starting the invocation (attempt 1)
[09:53:11.543] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e1994a2f65b054b260bc45389a1d71bd3009e688"
[09:53:11.543] Popped gitiles commit info from properties and tags
[09:53:11.543] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[09:53:11.543] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[09:53:11.543] Buildbucket request:
{
"requestId": "8990228723187718944",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-fyi-x64-asan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e1994a2f65b054b260bc45389a1d71bd3009e688",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8990228723187718944"
},
{
"key": "scheduler_job_id",
"value": "chromium/fuchsia-fyi-x64-asan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[09:53:11.980] Scheduled build:
{
"id": "8824798661160665073",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-fyi-x64-asan"
},
"number": 353,
"createdBy": "project:chromium",
"createTime": "2022-01-17T09:53:11.602794490Z",
"updateTime": "2022-01-17T09:53:11.602794490Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e1994a2f65b054b260bc45389a1d71bd3009e688",
"ref": "refs/heads/main"
}
}
}
[09:53:11.980] Task URL: https://cr-buildbucket.appspot.com/build/8824798661160665073
[09:53:11.980] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:2:0) after 1m29s
[09:54:40.999] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:2:0)
[09:54:41.053] Build status: SCHEDULED
[09:54:41.053] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:3:0) after 7m50s
[09:56:17.651] Received PubSub notification, asking Buildbucket for the build status
[09:56:17.670] Build status: STARTED
[10:02:31.224] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:3:0)
[10:02:31.253] Build status: STARTED
[10:02:31.253] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:5:0) after 4m2s
[10:06:33.385] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:5:0)
[10:06:33.414] Build status: STARTED
[10:06:33.414] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:6:0) after 5m30s
[10:12:03.573] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:6:0)
[10:12:03.610] Build status: STARTED
[10:12:03.610] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:7:0) after 7m55s
[10:19:58.741] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:7:0)
[10:19:58.762] Build status: STARTED
[10:19:58.762] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:8:0) after 5m6s
[10:25:04.993] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:8:0)
[10:25:05.026] Build status: STARTED
[10:25:05.026] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:9:0) after 7m12s
[10:32:17.293] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:9:0)
[10:32:17.311] Build status: STARTED
[10:32:17.311] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:10:0) after 9m54s
[10:42:11.331] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:10:0)
[10:42:11.396] Build status: STARTED
[10:42:11.396] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:11:0) after 7m50s
[10:50:01.613] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:11:0)
[10:50:01.632] Build status: STARTED
[10:50:01.632] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:12:0) after 3m25s
[10:53:26.721] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:12:0)
[10:53:26.792] Build status: STARTED
[10:53:26.792] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:13:0) after 3m42s
[10:57:08.848] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:13:0)
[10:57:08.867] Build status: STARTED
[10:57:08.867] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:14:0) after 5m30s
[11:02:38.892] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:14:0)
[11:02:38.913] Build status: STARTED
[11:02:38.913] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:15:0) after 8m46s
[11:11:24.991] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:15:0)
[11:11:25.038] Build status: STARTED
[11:11:25.038] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:16:0) after 3m14s
[11:14:39.021] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:16:0)
[11:14:39.057] Build status: STARTED
[11:14:39.058] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:17:0) after 2m18s
[11:16:57.085] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:17:0)
[11:16:57.105] Build status: STARTED
[11:16:57.105] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:18:0) after 9m28s
[11:26:25.141] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:18:0)
[11:26:25.173] Build status: STARTED
[11:26:25.173] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:19:0) after 6m30s
[11:32:55.269] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:19:0)
[11:32:55.307] Build status: STARTED
[11:32:55.307] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:20:0) after 7m11s
[11:40:06.330] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:20:0)
[11:40:06.359] Build status: STARTED
[11:40:06.359] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:21:0) after 5m47s
[11:45:53.386] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:21:0)
[11:45:53.407] Build status: STARTED
[11:45:53.407] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:22:0) after 6m34s
[11:52:27.459] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:22:0)
[11:52:27.492] Build status: STARTED
[11:52:27.492] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:23:0) after 6m41s
[11:59:08.514] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:23:0)
[11:59:08.547] Build status: STARTED
[11:59:08.547] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:24:0) after 6m13s
[12:05:21.674] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:24:0)
[12:05:21.699] Build status: STARTED
[12:05:21.699] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:25:0) after 9m44s
[12:15:05.745] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:25:0)
[12:15:05.786] Build status: STARTED
[12:15:05.786] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:26:0) after 5m15s
[12:20:20.917] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:26:0)
[12:20:20.934] Build status: STARTED
[12:20:20.934] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:27:0) after 1m31s
[12:21:51.941] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:27:0)
[12:21:51.962] Build status: STARTED
[12:21:51.962] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:28:0) after 8m25s
[12:30:17.085] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:28:0)
[12:30:17.137] Build status: STARTED
[12:30:17.137] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:29:0) after 8m13s
[12:38:30.157] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:29:0)
[12:38:30.248] Build status: STARTED
[12:38:30.248] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:30:0) after 2m41s
[12:41:11.519] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:30:0)
[12:41:11.542] Build status: STARTED
[12:41:11.542] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:31:0) after 2m7s
[12:43:18.621] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:31:0)
[12:43:18.648] Build status: STARTED
[12:43:18.648] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:32:0) after 9m2s
[12:52:20.668] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:32:0)
[12:52:20.735] Build status: STARTED
[12:52:20.735] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:33:0) after 6m41s
[12:59:01.762] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:33:0)
[12:59:01.783] Build status: STARTED
[12:59:01.783] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:34:0) after 4m24s
[13:03:26.120] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:34:0)
[13:03:26.153] Build status: STARTED
[13:03:26.153] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:35:0) after 1m36s
[13:05:02.426] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:35:0)
[13:05:02.449] Build status: STARTED
[13:05:02.449] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:36:0) after 6m51s
[13:11:53.623] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:36:0)
[13:11:53.645] Build status: STARTED
[13:11:53.645] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:37:0) after 7m38s
[13:19:31.832] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:37:0)
[13:19:31.863] Build status: STARTED
[13:19:31.863] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:38:0) after 2m15s
[13:21:46.995] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:38:0)
[13:21:47.039] Build status: STARTED
[13:21:47.039] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:39:0) after 9m23s
[13:31:10.061] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:39:0)
[13:31:10.099] Build status: STARTED
[13:31:10.099] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:40:0) after 4m10s
[13:35:20.123] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:40:0)
[13:35:20.146] Build status: STARTED
[13:35:20.146] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:41:0) after 2m37s
[13:37:57.138] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:41:0)
[13:37:57.178] Build status: STARTED
[13:37:57.178] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:42:0) after 4m39s
[13:42:36.386] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:42:0)
[13:42:36.489] Build status: STARTED
[13:42:36.489] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:43:0) after 3m18s
[13:45:54.468] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:43:0)
[13:45:54.493] Build status: STARTED
[13:45:54.493] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:44:0) after 9m56s
[13:55:50.510] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:44:0)
[13:55:50.561] Build status: STARTED
[13:55:50.561] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:45:0) after 4m25s
[14:00:15.607] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:45:0)
[14:00:15.636] Build status: STARTED
[14:00:15.636] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:46:0) after 5m57s
[14:06:12.706] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:46:0)
[14:06:12.742] Build status: STARTED
[14:06:12.742] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:47:0) after 4m3s
[14:10:15.953] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:47:0)
[14:10:15.978] Build status: STARTED
[14:10:15.978] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:48:0) after 1m11s
[14:11:26.985] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:48:0)
[14:11:27.032] Build status: STARTED
[14:11:27.032] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:49:0) after 3m28s
[14:14:55.061] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:49:0)
[14:14:55.103] Build status: STARTED
[14:14:55.104] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:50:0) after 2m30s
[14:17:25.131] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:50:0)
[14:17:25.156] Build status: STARTED
[14:17:25.156] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:51:0) after 4m41s
[14:22:06.139] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:51:0)
[14:22:06.169] Build status: STARTED
[14:22:06.169] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:52:0) after 7m56s
[14:30:02.286] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:52:0)
[14:30:02.314] Build status: STARTED
[14:30:02.314] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:53:0) after 2m20s
[14:32:22.332] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:53:0)
[14:32:22.358] Build status: STARTED
[14:32:22.358] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:54:0) after 7m57s
[14:40:19.417] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:54:0)
[14:40:19.441] Build status: STARTED
[14:40:19.441] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:55:0) after 8m35s
[14:48:54.462] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:55:0)
[14:48:54.491] Build status: STARTED
[14:48:54.491] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:56:0) after 4m57s
[14:53:51.617] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:56:0)
[14:53:51.644] Build status: STARTED
[14:53:51.644] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:57:0) after 9m5s
[15:02:56.670] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:57:0)
[15:02:56.693] Build status: STARTED
[15:02:56.693] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8990228723187718944:58:0) after 6m32s
[15:04:21.050] Received PubSub notification, asking Buildbucket for the build status
[15:04:21.070] Build:
{
"id": "8824798661160665073",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-fyi-x64-asan"
},
"number": 353,
"createdBy": "project:chromium",
"createTime": "2022-01-17T09:53:11.602794490Z",
"startTime": "2022-01-17T09:56:17.096437Z",
"endTime": "2022-01-17T15:04:20.488895049Z",
"updateTime": "2022-01-17T15:04:20.488895049Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e1994a2f65b054b260bc45389a1d71bd3009e688",
"ref": "refs/heads/main"
}
}
}
[15:04:21.070] Invocation finished in 5h11m10.783795935s with status FAILED