[07:51:45.156] New invocation is queued and will start shortly
[07:51:46.692] Starting the invocation (attempt 1)
[07:51:46.723] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/96870c660bc82d6cbefdb22a33f4cfb56d842c17"
[07:51:46.723] Popped gitiles commit info from properties and tags
[07:51:46.723] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[07:51:46.723] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[07:51:46.723] Buildbucket request:
{
"requestId": "8989420989531887776",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-fyi-x64-asan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "96870c660bc82d6cbefdb22a33f4cfb56d842c17",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8989420989531887776"
},
{
"key": "scheduler_job_id",
"value": "chromium/fuchsia-fyi-x64-asan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[07:51:47.450] Scheduled build:
{
"id": "8823990927153093041",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-fyi-x64-asan"
},
"number": 399,
"createdBy": "project:chromium",
"createTime": "2022-01-26T07:51:46.780697231Z",
"updateTime": "2022-01-26T07:51:46.780697231Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "96870c660bc82d6cbefdb22a33f4cfb56d842c17",
"ref": "refs/heads/main"
}
}
}
[07:51:47.450] Task URL: https://cr-buildbucket.appspot.com/build/8823990927153093041
[07:51:47.450] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:2:0) after 3m29s
[07:54:45.246] Received PubSub notification, asking Buildbucket for the build status
[07:54:45.269] Build status: STARTED
[07:55:16.519] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:2:0)
[07:55:16.537] Build status: STARTED
[07:55:16.537] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:4:0) after 1m55s
[07:57:11.559] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:4:0)
[07:57:11.677] Build status: STARTED
[07:57:11.677] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:5:0) after 9m15s
[08:06:26.830] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:5:0)
[08:06:26.852] Build status: STARTED
[08:06:26.852] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:6:0) after 8m40s
[08:15:07.041] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:6:0)
[08:15:07.061] Build status: STARTED
[08:15:07.061] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:7:0) after 5m46s
[08:20:53.464] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:7:0)
[08:20:53.489] Build status: STARTED
[08:20:53.489] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:8:0) after 1m35s
[08:22:28.620] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:8:0)
[08:22:28.649] Build status: STARTED
[08:22:28.649] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:9:0) after 3m23s
[08:25:51.931] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:9:0)
[08:25:51.956] Build status: STARTED
[08:25:51.956] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:10:0) after 9m20s
[08:35:11.975] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:10:0)
[08:35:11.998] Build status: STARTED
[08:35:11.998] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:11:0) after 6m46s
[08:41:58.003] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:11:0)
[08:41:58.181] Build status: STARTED
[08:41:58.181] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:12:0) after 7m1s
[08:48:59.278] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:12:0)
[08:48:59.311] Build status: STARTED
[08:48:59.311] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:13:0) after 8m13s
[08:57:12.351] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:13:0)
[08:57:12.393] Build status: STARTED
[08:57:12.393] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:14:0) after 2m0s
[08:59:12.412] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:14:0)
[08:59:12.442] Build status: STARTED
[08:59:12.442] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:15:0) after 2m5s
[09:01:17.470] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:15:0)
[09:01:17.495] Build status: STARTED
[09:01:17.495] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:16:0) after 5m16s
[09:06:33.522] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:16:0)
[09:06:33.565] Build status: STARTED
[09:06:33.565] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:17:0) after 6m6s
[09:12:39.549] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:17:0)
[09:12:39.666] Build status: STARTED
[09:12:39.666] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:18:0) after 4m21s
[09:17:01.030] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:18:0)
[09:17:01.049] Build status: STARTED
[09:17:01.049] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:19:0) after 3m11s
[09:20:12.169] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:19:0)
[09:20:12.196] Build status: STARTED
[09:20:12.196] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:20:0) after 7m38s
[09:27:50.375] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:20:0)
[09:27:50.397] Build status: STARTED
[09:27:50.397] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:21:0) after 5m19s
[09:33:09.517] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:21:0)
[09:33:09.536] Build status: STARTED
[09:33:09.536] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:22:0) after 7m54s
[09:41:03.558] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:22:0)
[09:41:03.586] Build status: STARTED
[09:41:03.586] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:23:0) after 6m42s
[09:47:45.607] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:23:0)
[09:47:45.629] Build status: STARTED
[09:47:45.629] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:24:0) after 2m21s
[09:50:06.626] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:24:0)
[09:50:06.645] Build status: STARTED
[09:50:06.645] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:25:0) after 8m11s
[09:58:17.677] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:25:0)
[09:58:17.749] Build status: STARTED
[09:58:17.749] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:26:0) after 9m47s
[10:08:04.870] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:26:0)
[10:08:04.891] Build status: STARTED
[10:08:04.891] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:27:0) after 6m21s
[10:14:25.947] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:27:0)
[10:14:26.054] Build status: STARTED
[10:14:26.054] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:28:0) after 6m48s
[10:21:14.077] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:28:0)
[10:21:14.099] Build status: STARTED
[10:21:14.099] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:29:0) after 5m19s
[10:26:33.142] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:29:0)
[10:26:33.164] Build status: STARTED
[10:26:33.164] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:30:0) after 2m44s
[10:29:17.185] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:30:0)
[10:29:17.227] Build status: STARTED
[10:29:17.227] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:31:0) after 3m7s
[10:32:24.248] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:31:0)
[10:32:24.268] Build status: STARTED
[10:32:24.268] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:32:0) after 6m39s
[10:39:03.292] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:32:0)
[10:39:03.318] Build status: STARTED
[10:39:03.318] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:33:0) after 1m30s
[10:40:33.339] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:33:0)
[10:40:33.361] Build status: STARTED
[10:40:33.361] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:34:0) after 7m37s
[10:48:10.480] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:34:0)
[10:48:10.509] Build status: STARTED
[10:48:10.509] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:35:0) after 9m27s
[10:57:37.547] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:35:0)
[10:57:37.567] Build status: STARTED
[10:57:37.568] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:36:0) after 8m7s
[11:05:44.643] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:36:0)
[11:05:44.665] Build status: STARTED
[11:05:44.665] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:37:0) after 9m57s
[11:15:41.982] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:37:0)
[11:15:42.003] Build status: STARTED
[11:15:42.003] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:38:0) after 5m58s
[11:21:40.413] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:38:0)
[11:21:40.439] Build status: STARTED
[11:21:40.439] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:39:0) after 4m22s
[11:26:02.462] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:39:0)
[11:26:02.484] Build status: STARTED
[11:26:02.484] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:40:0) after 2m17s
[11:28:19.912] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:40:0)
[11:28:19.954] Build status: STARTED
[11:28:19.954] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:41:0) after 9m13s
[11:37:33.288] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:41:0)
[11:37:33.312] Build status: STARTED
[11:37:33.312] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:42:0) after 7m14s
[11:44:47.437] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:42:0)
[11:44:47.470] Build status: STARTED
[11:44:47.470] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:43:0) after 9m22s
[11:54:09.494] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:43:0)
[11:54:09.515] Build status: STARTED
[11:54:09.515] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:44:0) after 4m18s
[11:58:27.564] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:44:0)
[11:58:27.599] Build status: STARTED
[11:58:27.599] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:45:0) after 8m56s
[12:07:23.622] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:45:0)
[12:07:23.644] Build status: STARTED
[12:07:23.644] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:46:0) after 1m50s
[12:09:13.701] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:46:0)
[12:09:13.723] Build status: STARTED
[12:09:13.723] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:47:0) after 6m10s
[12:15:23.905] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:47:0)
[12:15:23.928] Build status: STARTED
[12:15:23.928] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:48:0) after 1m4s
[12:16:27.953] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:48:0)
[12:16:27.986] Build status: STARTED
[12:16:27.986] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:49:0) after 6m59s
[12:23:27.006] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:49:0)
[12:23:27.032] Build status: STARTED
[12:23:27.032] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:50:0) after 2m12s
[12:25:39.081] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:50:0)
[12:25:39.111] Build status: STARTED
[12:25:39.112] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:51:0) after 4m26s
[12:30:05.467] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:51:0)
[12:30:05.500] Build status: STARTED
[12:30:05.500] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:52:0) after 1m11s
[12:31:16.849] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:52:0)
[12:31:16.881] Build status: STARTED
[12:31:16.881] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:53:0) after 9m12s
[12:40:28.932] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:53:0)
[12:40:28.950] Build status: STARTED
[12:40:28.950] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:54:0) after 5m20s
[12:45:48.986] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:54:0)
[12:45:49.056] Build status: STARTED
[12:45:49.056] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:55:0) after 4m12s
[12:50:01.114] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:55:0)
[12:50:01.134] Build status: STARTED
[12:50:01.134] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:56:0) after 1m38s
[12:51:39.159] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:56:0)
[12:51:39.204] Build status: STARTED
[12:51:39.204] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:57:0) after 1m0s
[12:52:39.413] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:57:0)
[12:52:39.439] Build status: STARTED
[12:52:39.439] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:58:0) after 3m35s
[12:56:14.722] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:58:0)
[12:56:14.741] Build status: STARTED
[12:56:14.741] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:59:0) after 4m7s
[13:00:21.768] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:59:0)
[13:00:21.795] Build status: STARTED
[13:00:21.795] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:60:0) after 2m3s
[13:02:25.019] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:60:0)
[13:02:25.046] Build status: STARTED
[13:02:25.046] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:61:0) after 5m0s
[13:07:25.165] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:61:0)
[13:07:25.186] Build status: STARTED
[13:07:25.186] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8989420989531887776:62:0) after 7m6s
[13:10:52.990] Received PubSub notification, asking Buildbucket for the build status
[13:10:53.018] Build:
{
"id": "8823990927153093041",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-fyi-x64-asan"
},
"number": 399,
"createdBy": "project:chromium",
"createTime": "2022-01-26T07:51:46.780697231Z",
"startTime": "2022-01-26T07:54:44.158165Z",
"endTime": "2022-01-26T13:10:52.453386030Z",
"updateTime": "2022-01-26T13:10:52.453386030Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "96870c660bc82d6cbefdb22a33f4cfb56d842c17",
"ref": "refs/heads/main"
}
}
}
[13:10:53.018] Invocation finished in 5h19m7.890138626s with status FAILED