[23:22:54.808] New invocation is queued and will start shortly
[23:22:55.925] Starting the invocation (attempt 1)
[23:22:55.964] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/6840b693becd59f9159577d7d0d7ae5e5fdb8cb1"
[23:22:55.964] Popped gitiles commit info from properties and tags
[23:22:55.964] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:22:55.964] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:22:55.964] Buildbucket request:
{
"requestId": "8985647930319252512",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-fyi-x64-asan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6840b693becd59f9159577d7d0d7ae5e5fdb8cb1",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8985647930319252512"
},
{
"key": "scheduler_job_id",
"value": "chromium/fuchsia-fyi-x64-asan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:22:56.678] Scheduled build:
{
"id": "8820217868329601281",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-fyi-x64-asan"
},
"number": 695,
"createdBy": "project:chromium",
"createTime": "2022-03-08T23:22:56.074057082Z",
"updateTime": "2022-03-08T23:22:56.074057082Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6840b693becd59f9159577d7d0d7ae5e5fdb8cb1",
"ref": "refs/heads/main"
}
}
}
[23:22:56.678] Task URL: https://cr-buildbucket.appspot.com/build/8820217868329601281
[23:22:56.678] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:2:0) after 8m3s
[23:25:22.621] Received PubSub notification, asking Buildbucket for the build status
[23:25:22.641] Build status: STARTED
[23:30:59.852] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:2:0)
[23:30:59.873] Build status: STARTED
[23:30:59.873] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:4:0) after 4m48s
[23:35:47.926] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:4:0)
[23:35:47.960] Build status: STARTED
[23:35:47.960] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:5:0) after 7m0s
[23:42:48.096] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:5:0)
[23:42:48.243] Build status: STARTED
[23:42:48.244] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:6:0) after 3m20s
[23:46:08.272] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:6:0)
[23:46:08.302] Build status: STARTED
[23:46:08.302] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:7:0) after 2m16s
[23:48:24.424] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:7:0)
[23:48:24.475] Build status: STARTED
[23:48:24.475] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:8:0) after 6m52s
[23:55:16.958] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:8:0)
[23:55:17.056] Build status: STARTED
[23:55:17.056] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:9:0) after 3m25s
[23:58:42.075] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:9:0)
[23:58:42.098] Build status: STARTED
[23:58:42.098] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:10:0) after 9m52s
[00:08:34.139] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:10:0)
[00:08:34.174] Build status: STARTED
[00:08:34.174] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:11:0) after 5m20s
[00:13:54.277] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:11:0)
[00:13:54.299] Build status: STARTED
[00:13:54.299] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:12:0) after 2m1s
[00:15:55.949] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:12:0)
[00:15:55.968] Build status: STARTED
[00:15:55.968] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:13:0) after 6m6s
[00:22:02.124] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:13:0)
[00:22:02.275] Build status: STARTED
[00:22:02.275] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:14:0) after 5m39s
[00:27:41.875] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:14:0)
[00:27:41.956] Build status: STARTED
[00:27:41.956] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:15:0) after 5m54s
[00:33:36.296] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:15:0)
[00:33:36.338] Build status: STARTED
[00:33:36.338] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:16:0) after 2m7s
[00:35:43.363] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:16:0)
[00:35:43.394] Build status: STARTED
[00:35:43.394] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:17:0) after 6m35s
[00:42:18.441] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:17:0)
[00:42:18.466] Build status: STARTED
[00:42:18.466] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:18:0) after 6m34s
[00:48:52.603] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:18:0)
[00:48:52.636] Build status: STARTED
[00:48:52.636] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:19:0) after 1m51s
[00:50:44.017] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:19:0)
[00:50:44.065] Build status: STARTED
[00:50:44.065] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:20:0) after 6m8s
[00:56:52.145] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:20:0)
[00:56:52.168] Build status: STARTED
[00:56:52.168] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:21:0) after 6m23s
[01:03:15.196] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:21:0)
[01:03:15.301] Build status: STARTED
[01:03:15.301] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:22:0) after 8m10s
[01:11:25.355] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:22:0)
[01:11:25.383] Build status: STARTED
[01:11:25.383] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:23:0) after 2m46s
[01:14:11.584] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:23:0)
[01:14:11.619] Build status: STARTED
[01:14:11.619] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:24:0) after 3m2s
[01:17:13.870] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:24:0)
[01:17:13.895] Build status: STARTED
[01:17:13.895] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:25:0) after 9m18s
[01:26:31.944] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:25:0)
[01:26:31.967] Build status: STARTED
[01:26:31.967] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:26:0) after 3m47s
[01:30:19.018] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:26:0)
[01:30:19.050] Build status: STARTED
[01:30:19.050] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:27:0) after 2m49s
[01:33:08.150] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:27:0)
[01:33:08.185] Build status: STARTED
[01:33:08.185] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:28:0) after 5m37s
[01:38:45.239] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:28:0)
[01:38:45.264] Build status: STARTED
[01:38:45.264] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:29:0) after 7m17s
[01:46:02.576] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:29:0)
[01:46:02.663] Build status: STARTED
[01:46:02.663] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:30:0) after 8m22s
[01:54:24.746] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:30:0)
[01:54:24.771] Build status: STARTED
[01:54:24.771] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:31:0) after 5m24s
[01:59:48.853] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:31:0)
[01:59:48.885] Build status: STARTED
[01:59:48.885] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:32:0) after 7m27s
[02:07:15.969] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:32:0)
[02:07:16.003] Build status: STARTED
[02:07:16.003] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:33:0) after 9m0s
[02:16:16.002] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:33:0)
[02:16:16.026] Build status: STARTED
[02:16:16.026] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:34:0) after 9m51s
[02:26:07.097] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:34:0)
[02:26:07.119] Build status: STARTED
[02:26:07.119] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:35:0) after 9m2s
[02:35:09.147] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:35:0)
[02:35:09.171] Build status: STARTED
[02:35:09.171] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:36:0) after 7m51s
[02:43:00.359] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:36:0)
[02:43:00.385] Build status: STARTED
[02:43:00.385] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:37:0) after 8m19s
[02:51:19.413] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:37:0)
[02:51:19.437] Build status: STARTED
[02:51:19.437] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:38:0) after 7m25s
[02:58:44.603] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:38:0)
[02:58:44.638] Build status: STARTED
[02:58:44.638] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:39:0) after 3m44s
[03:02:28.671] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:39:0)
[03:02:28.692] Build status: STARTED
[03:02:28.692] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:40:0) after 8m43s
[03:11:11.717] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:40:0)
[03:11:11.741] Build status: STARTED
[03:11:11.741] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:41:0) after 7m24s
[03:18:35.933] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:41:0)
[03:18:35.957] Build status: STARTED
[03:18:35.957] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:42:0) after 1m40s
[03:20:16.052] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:42:0)
[03:20:16.075] Build status: STARTED
[03:20:16.075] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:43:0) after 6m59s
[03:27:15.112] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:43:0)
[03:27:15.152] Build status: STARTED
[03:27:15.152] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:44:0) after 7m49s
[03:35:04.200] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:44:0)
[03:35:04.247] Build status: STARTED
[03:35:04.247] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:45:0) after 6m59s
[03:42:03.588] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:45:0)
[03:42:03.624] Build status: STARTED
[03:42:03.624] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:46:0) after 6m3s
[03:48:06.649] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:46:0)
[03:48:06.672] Build status: STARTED
[03:48:06.672] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:47:0) after 1m43s
[03:49:49.747] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:47:0)
[03:49:49.774] Build status: STARTED
[03:49:49.774] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:48:0) after 7m35s
[03:57:24.896] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:48:0)
[03:57:24.922] Build status: STARTED
[03:57:24.922] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:49:0) after 4m38s
[04:02:03.130] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:49:0)
[04:02:03.156] Build status: STARTED
[04:02:03.156] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:50:0) after 8m42s
[04:10:45.152] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:50:0)
[04:10:45.303] Build status: STARTED
[04:10:45.303] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:51:0) after 6m19s
[04:17:04.451] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:51:0)
[04:17:04.480] Build status: STARTED
[04:17:04.480] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:52:0) after 4m51s
[04:21:55.613] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:52:0)
[04:21:55.640] Build status: STARTED
[04:21:55.640] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:53:0) after 2m19s
[04:24:14.667] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:53:0)
[04:24:14.743] Build status: STARTED
[04:24:14.743] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:54:0) after 1m40s
[04:25:54.770] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:54:0)
[04:25:54.792] Build status: STARTED
[04:25:54.792] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:55:0) after 1m48s
[04:27:42.819] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:55:0)
[04:27:42.871] Build status: STARTED
[04:27:42.871] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:56:0) after 9m33s
[04:37:16.149] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:56:0)
[04:37:16.264] Build status: STARTED
[04:37:16.264] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:57:0) after 3m16s
[04:40:32.330] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:57:0)
[04:40:32.361] Build status: STARTED
[04:40:32.361] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:58:0) after 9m16s
[04:49:48.386] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:58:0)
[04:49:48.422] Build status: STARTED
[04:49:48.422] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:59:0) after 5m10s
[04:54:58.450] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:59:0)
[04:54:58.544] Build status: STARTED
[04:54:58.544] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8985647930319252512:60:0) after 4m47s
[04:57:45.436] Received PubSub notification, asking Buildbucket for the build status
[04:57:45.487] Build:
{
"id": "8820217868329601281",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-fyi-x64-asan"
},
"number": 695,
"createdBy": "project:chromium",
"createTime": "2022-03-08T23:22:56.074057082Z",
"startTime": "2022-03-08T23:25:15.468275Z",
"endTime": "2022-03-09T04:57:45.094427822Z",
"updateTime": "2022-03-09T04:57:45.094427822Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6840b693becd59f9159577d7d0d7ae5e5fdb8cb1",
"ref": "refs/heads/main"
}
}
}
[04:57:45.487] Invocation finished in 5h34m50.69395729s with status FAILED