[14:00:32.145] New invocation is queued and will start shortly
[14:00:33.183] Starting the invocation (attempt 1)
[14:00:33.256] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/3423a6e47f56c91ba7e36435e4779989f345da5f"
[14:00:33.256] Popped gitiles commit info from properties and tags
[14:00:33.256] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:00:33.256] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:00:33.257] Buildbucket request:
{
"requestId": "8988854205892552432",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-fyi-x64-asan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3423a6e47f56c91ba7e36435e4779989f345da5f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8988854205892552432"
},
{
"key": "scheduler_job_id",
"value": "chromium/fuchsia-fyi-x64-asan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:00:34.862] Scheduled build:
{
"id": "8823424143978577313",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-fyi-x64-asan"
},
"number": 535,
"createdBy": "project:chromium",
"createTime": "2022-02-01T14:00:33.336005186Z",
"updateTime": "2022-02-01T14:00:33.336005186Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3423a6e47f56c91ba7e36435e4779989f345da5f",
"ref": "refs/heads/main"
}
},
"canary": true
}
[14:00:34.862] Task URL: https://cr-buildbucket.appspot.com/build/8823424143978577313
[14:00:34.862] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:2:0) after 5m10s
[14:01:00.754] Received PubSub notification, asking Buildbucket for the build status
[14:01:00.778] Build status: STARTED
[14:05:44.884] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:2:0)
[14:05:44.903] Build status: STARTED
[14:05:44.903] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:4:0) after 7m14s
[14:12:59.058] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:4:0)
[14:12:59.081] Build status: STARTED
[14:12:59.081] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:5:0) after 5m29s
[14:18:28.104] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:5:0)
[14:18:28.124] Build status: STARTED
[14:18:28.124] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:6:0) after 1m22s
[14:19:50.145] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:6:0)
[14:19:50.165] Build status: STARTED
[14:19:50.165] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:7:0) after 6m41s
[14:26:31.425] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:7:0)
[14:26:31.443] Build status: STARTED
[14:26:31.443] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:8:0) after 5m29s
[14:32:00.563] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:8:0)
[14:32:00.623] Build status: STARTED
[14:32:00.623] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:9:0) after 1m0s
[14:33:00.645] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:9:0)
[14:33:00.677] Build status: STARTED
[14:33:00.677] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:10:0) after 8m17s
[14:41:17.846] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:10:0)
[14:41:17.908] Build status: STARTED
[14:41:17.908] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:11:0) after 1m43s
[14:43:00.961] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:11:0)
[14:43:00.994] Build status: STARTED
[14:43:00.994] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:12:0) after 2m35s
[14:45:36.025] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:12:0)
[14:45:36.044] Build status: STARTED
[14:45:36.044] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:13:0) after 9m18s
[14:54:54.256] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:13:0)
[14:54:54.297] Build status: STARTED
[14:54:54.297] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:14:0) after 4m37s
[14:59:31.479] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:14:0)
[14:59:31.501] Build status: STARTED
[14:59:31.501] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:15:0) after 6m34s
[15:06:05.651] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:15:0)
[15:06:05.690] Build status: STARTED
[15:06:05.690] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:16:0) after 1m50s
[15:07:55.808] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:16:0)
[15:07:55.828] Build status: STARTED
[15:07:55.828] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:17:0) after 2m27s
[15:10:22.846] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:17:0)
[15:10:22.901] Build status: STARTED
[15:10:22.901] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:18:0) after 7m28s
[15:17:50.921] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:18:0)
[15:17:50.950] Build status: STARTED
[15:17:50.950] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:19:0) after 6m49s
[15:24:39.975] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:19:0)
[15:24:39.994] Build status: STARTED
[15:24:39.994] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:20:0) after 3m41s
[15:28:21.024] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:20:0)
[15:28:21.046] Build status: STARTED
[15:28:21.046] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:21:0) after 8m0s
[15:36:21.076] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:21:0)
[15:36:21.104] Build status: STARTED
[15:36:21.105] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:22:0) after 3m48s
[15:40:09.184] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:22:0)
[15:40:09.206] Build status: STARTED
[15:40:09.206] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:23:0) after 3m39s
[15:43:48.235] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:23:0)
[15:43:48.258] Build status: STARTED
[15:43:48.258] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:24:0) after 2m1s
[15:45:49.278] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:24:0)
[15:45:49.296] Build status: STARTED
[15:45:49.296] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:25:0) after 6m9s
[15:51:58.371] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:25:0)
[15:51:58.394] Build status: STARTED
[15:51:58.394] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:26:0) after 2m28s
[15:54:26.442] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:26:0)
[15:54:26.467] Build status: STARTED
[15:54:26.467] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:27:0) after 6m57s
[16:01:23.589] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:27:0)
[16:01:23.625] Build status: STARTED
[16:01:23.625] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:28:0) after 5m25s
[16:06:48.795] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:28:0)
[16:06:48.815] Build status: STARTED
[16:06:48.815] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:29:0) after 5m12s
[16:12:00.894] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:29:0)
[16:12:00.921] Build status: STARTED
[16:12:00.921] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:30:0) after 7m52s
[16:19:52.985] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:30:0)
[16:19:53.015] Build status: STARTED
[16:19:53.015] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:31:0) after 5m47s
[16:25:40.073] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:31:0)
[16:25:40.101] Build status: STARTED
[16:25:40.101] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:32:0) after 2m34s
[16:28:14.375] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:32:0)
[16:28:14.437] Build status: STARTED
[16:28:14.437] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:33:0) after 8m36s
[16:36:50.554] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:33:0)
[16:36:50.582] Build status: STARTED
[16:36:50.582] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:34:0) after 2m48s
[16:39:38.603] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:34:0)
[16:39:38.650] Build status: STARTED
[16:39:38.650] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:35:0) after 9m20s
[16:48:58.700] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:35:0)
[16:48:58.741] Build status: STARTED
[16:48:58.741] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:36:0) after 2m56s
[16:51:54.793] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:36:0)
[16:51:54.829] Build status: STARTED
[16:51:54.829] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:37:0) after 2m0s
[16:53:55.171] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:37:0)
[16:53:55.211] Build status: STARTED
[16:53:55.211] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:38:0) after 7m58s
[17:01:53.263] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:38:0)
[17:01:53.345] Build status: STARTED
[17:01:53.347] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:39:0) after 2m41s
[17:04:34.538] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:39:0)
[17:04:34.604] Build status: STARTED
[17:04:34.604] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:40:0) after 1m42s
[17:06:16.638] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:40:0)
[17:06:16.690] Build status: STARTED
[17:06:16.690] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:41:0) after 2m30s
[17:08:46.916] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:41:0)
[17:08:46.935] Build status: STARTED
[17:08:46.935] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:42:0) after 5m55s
[17:14:42.100] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:42:0)
[17:14:42.125] Build status: STARTED
[17:14:42.125] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:43:0) after 3m31s
[17:18:13.254] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:43:0)
[17:18:13.276] Build status: STARTED
[17:18:13.276] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:44:0) after 7m8s
[17:25:21.423] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:44:0)
[17:25:21.455] Build status: STARTED
[17:25:21.455] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:45:0) after 1m5s
[17:26:26.505] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:45:0)
[17:26:26.683] Build status: STARTED
[17:26:26.683] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:46:0) after 2m34s
[17:29:00.718] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:46:0)
[17:29:00.751] Build status: STARTED
[17:29:00.751] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:47:0) after 9m56s
[17:38:56.837] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:47:0)
[17:38:57.052] Build status: STARTED
[17:38:57.052] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:48:0) after 2m57s
[17:41:54.122] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:48:0)
[17:41:54.167] Build status: STARTED
[17:41:54.167] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:49:0) after 8m7s
[17:50:01.200] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:49:0)
[17:50:01.231] Build status: STARTED
[17:50:01.231] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:50:0) after 8m41s
[18:00:21.647] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:50:0)
[18:00:21.679] Build status: STARTED
[18:00:21.679] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:51:0) after 6m28s
[18:06:49.783] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:51:0)
[18:06:49.826] Build status: STARTED
[18:06:49.826] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:52:0) after 7m29s
[18:14:19.064] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:52:0)
[18:14:19.095] Build status: STARTED
[18:14:19.095] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:53:0) after 9m34s
[18:23:53.151] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:53:0)
[18:23:53.182] Build status: STARTED
[18:23:53.182] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:54:0) after 3m16s
[18:27:09.334] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:54:0)
[18:27:09.370] Build status: STARTED
[18:27:09.370] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:55:0) after 8m18s
[18:35:27.396] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:55:0)
[18:35:27.448] Build status: STARTED
[18:35:27.448] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:56:0) after 7m12s
[18:42:39.673] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:56:0)
[18:42:39.779] Build status: STARTED
[18:42:39.779] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:57:0) after 2m21s
[18:45:00.800] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:57:0)
[18:45:00.892] Build status: STARTED
[18:45:00.892] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:58:0) after 5m31s
[18:50:31.926] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:58:0)
[18:50:31.949] Build status: STARTED
[18:50:31.949] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:59:0) after 3m59s
[18:54:30.979] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:59:0)
[18:54:31.076] Build status: STARTED
[18:54:31.076] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8988854205892552432:60:0) after 8m39s
[18:57:47.158] Received PubSub notification, asking Buildbucket for the build status
[18:57:47.179] Build:
{
"id": "8823424143978577313",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-fyi-x64-asan"
},
"number": 535,
"createdBy": "project:chromium",
"createTime": "2022-02-01T14:00:33.336005186Z",
"startTime": "2022-02-01T14:00:59.709572Z",
"endTime": "2022-02-01T18:57:46.439776544Z",
"updateTime": "2022-02-01T18:57:46.439776544Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3423a6e47f56c91ba7e36435e4779989f345da5f",
"ref": "refs/heads/main"
}
},
"canary": true
}
[18:57:47.179] Invocation finished in 4h57m15.051918454s with status FAILED