[08:36:56.129] New invocation is queued and will start shortly
[08:36:57.246] Starting the invocation (attempt 1)
[08:36:57.283] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d77cdeaf17a543de22bc215619e5019f6c774289"
[08:36:57.283] Popped gitiles commit info from properties and tags
[08:36:57.283] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:36:57.283] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:36:57.284] Buildbucket request:
{
"requestId": "8977006362459536768",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-fyi-x64-asan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d77cdeaf17a543de22bc215619e5019f6c774289",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8977006362459536768"
},
{
"key": "scheduler_job_id",
"value": "chromium/fuchsia-fyi-x64-asan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:36:57.849] Scheduled build:
{
"id": "8811576300497931777",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-fyi-x64-asan"
},
"number": 1136,
"createdBy": "project:chromium",
"createTime": "2022-06-12T08:36:57.369956538Z",
"updateTime": "2022-06-12T08:36:57.369956538Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d77cdeaf17a543de22bc215619e5019f6c774289",
"ref": "refs/heads/main"
}
},
"canary": true
}
[08:36:57.849] Task URL: https://cr-buildbucket.appspot.com/build/8811576300497931777
[08:36:57.849] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:2:0) after 2m2s
[08:37:12.173] Received PubSub notification, asking Buildbucket for the build status
[08:37:12.219] Build status: STARTED
[08:38:59.867] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:2:0)
[08:38:59.896] Build status: STARTED
[08:38:59.896] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:4:0) after 6m44s
[08:45:43.918] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:4:0)
[08:45:43.950] Build status: STARTED
[08:45:43.950] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:5:0) after 7m41s
[08:53:25.590] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:5:0)
[08:53:25.640] Build status: STARTED
[08:53:25.640] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:6:0) after 3m44s
[08:57:10.210] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:6:0)
[08:57:10.228] Build status: STARTED
[08:57:10.228] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:7:0) after 8m10s
[09:05:20.588] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:7:0)
[09:05:20.610] Build status: STARTED
[09:05:20.610] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:8:0) after 7m37s
[09:12:57.640] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:8:0)
[09:12:57.662] Build status: STARTED
[09:12:57.662] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:9:0) after 6m32s
[09:19:30.696] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:9:0)
[09:19:30.717] Build status: STARTED
[09:19:30.717] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:10:0) after 3m47s
[09:23:17.736] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:10:0)
[09:23:17.787] Build status: STARTED
[09:23:17.787] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:11:0) after 5m4s
[09:28:22.071] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:11:0)
[09:28:22.092] Build status: STARTED
[09:28:22.093] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:12:0) after 9m13s
[09:37:35.189] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:12:0)
[09:37:35.211] Build status: STARTED
[09:37:35.211] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:13:0) after 9m27s
[09:47:02.375] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:13:0)
[09:47:02.404] Build status: STARTED
[09:47:02.404] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:14:0) after 4m11s
[09:51:13.456] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:14:0)
[09:51:13.493] Build status: STARTED
[09:51:13.493] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:15:0) after 5m13s
[09:56:26.614] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:15:0)
[09:56:26.649] Build status: STARTED
[09:56:26.649] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:16:0) after 9m4s
[10:05:30.667] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:16:0)
[10:05:30.702] Build status: STARTED
[10:05:30.702] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:17:0) after 1m10s
[10:06:40.720] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:17:0)
[10:06:40.754] Build status: STARTED
[10:06:40.754] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:18:0) after 4m50s
[10:11:30.857] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:18:0)
[10:11:30.876] Build status: STARTED
[10:11:30.876] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:19:0) after 2m40s
[10:14:10.894] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:19:0)
[10:14:10.916] Build status: STARTED
[10:14:10.916] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:20:0) after 9m9s
[10:23:19.936] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:20:0)
[10:23:19.969] Build status: STARTED
[10:23:19.969] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:21:0) after 5m37s
[10:28:57.062] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:21:0)
[10:28:57.091] Build status: STARTED
[10:28:57.091] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:22:0) after 4m6s
[10:33:03.279] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:22:0)
[10:33:03.301] Build status: STARTED
[10:33:03.301] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:23:0) after 1m55s
[10:34:58.321] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:23:0)
[10:34:58.364] Build status: STARTED
[10:34:58.364] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:24:0) after 8m6s
[10:43:04.477] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:24:0)
[10:43:04.514] Build status: STARTED
[10:43:04.514] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:25:0) after 9m7s
[10:52:11.542] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:25:0)
[10:52:11.565] Build status: STARTED
[10:52:11.565] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:26:0) after 8m6s
[11:00:17.698] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:26:0)
[11:00:17.751] Build status: STARTED
[11:00:17.751] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:27:0) after 7m13s
[11:07:30.864] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:27:0)
[11:07:30.896] Build status: STARTED
[11:07:30.896] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:28:0) after 1m28s
[11:08:58.916] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:28:0)
[11:08:58.957] Build status: STARTED
[11:08:58.957] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:29:0) after 9m36s
[11:18:34.977] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:29:0)
[11:18:34.999] Build status: STARTED
[11:18:34.999] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:30:0) after 1m27s
[11:20:02.022] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:30:0)
[11:20:02.059] Build status: STARTED
[11:20:02.059] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:31:0) after 7m17s
[11:27:19.443] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:31:0)
[11:27:19.479] Build status: STARTED
[11:27:19.479] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:32:0) after 5m59s
[11:33:18.514] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:32:0)
[11:33:18.550] Build status: STARTED
[11:33:18.550] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:33:0) after 7m44s
[11:41:03.042] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:33:0)
[11:41:03.085] Build status: STARTED
[11:41:03.085] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:34:0) after 4m15s
[11:45:18.107] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:34:0)
[11:45:18.140] Build status: STARTED
[11:45:18.140] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:35:0) after 4m53s
[11:50:11.288] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:35:0)
[11:50:11.336] Build status: STARTED
[11:50:11.336] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:36:0) after 2m59s
[11:53:10.355] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:36:0)
[11:53:10.399] Build status: STARTED
[11:53:10.399] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:37:0) after 8m11s
[12:01:21.464] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:37:0)
[12:01:21.498] Build status: STARTED
[12:01:21.498] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:38:0) after 2m12s
[12:03:33.683] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:38:0)
[12:03:33.725] Build status: STARTED
[12:03:33.725] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:39:0) after 9m57s
[12:13:30.769] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:39:0)
[12:13:30.810] Build status: STARTED
[12:13:30.810] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:40:0) after 2m0s
[12:15:30.874] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:40:0)
[12:15:30.897] Build status: STARTED
[12:15:30.897] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:41:0) after 7m41s
[12:23:12.307] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:41:0)
[12:23:12.343] Build status: STARTED
[12:23:12.343] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:42:0) after 1m41s
[12:24:53.362] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:42:0)
[12:24:53.385] Build status: STARTED
[12:24:53.385] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:43:0) after 5m40s
[12:30:33.584] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:43:0)
[12:30:33.623] Build status: STARTED
[12:30:33.623] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:44:0) after 6m52s
[12:37:25.647] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:44:0)
[12:37:25.700] Build status: STARTED
[12:37:25.701] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:45:0) after 1m14s
[12:38:39.938] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:45:0)
[12:38:39.959] Build status: STARTED
[12:38:39.959] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:46:0) after 7m35s
[12:46:14.981] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:46:0)
[12:46:15.003] Build status: STARTED
[12:46:15.003] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:47:0) after 8m48s
[12:55:03.024] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:47:0)
[12:55:03.086] Build status: STARTED
[12:55:03.086] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:48:0) after 5m42s
[13:00:45.309] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:48:0)
[13:00:45.375] Build status: STARTED
[13:00:45.375] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:49:0) after 8m33s
[13:09:18.457] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:49:0)
[13:09:18.512] Build status: STARTED
[13:09:18.513] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:50:0) after 4m5s
[13:13:23.534] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:50:0)
[13:13:23.587] Build status: STARTED
[13:13:23.587] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:51:0) after 6m12s
[13:19:35.606] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:51:0)
[13:19:35.628] Build status: STARTED
[13:19:35.628] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:52:0) after 9m36s
[13:29:11.654] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:52:0)
[13:29:11.676] Build status: STARTED
[13:29:11.676] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:53:0) after 8m14s
[13:37:25.761] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:53:0)
[13:37:25.804] Build status: STARTED
[13:37:25.804] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:54:0) after 8m22s
[13:45:47.827] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:54:0)
[13:45:47.886] Build status: STARTED
[13:45:47.886] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:55:0) after 4m11s
[13:49:58.907] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:55:0)
[13:49:58.985] Build status: STARTED
[13:49:58.985] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:56:0) after 4m51s
[13:54:50.004] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:56:0)
[13:54:50.036] Build status: STARTED
[13:54:50.036] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8977006362459536768:57:0) after 7m59s
[14:01:52.654] Received PubSub notification, asking Buildbucket for the build status
[14:01:52.851] Build:
{
"id": "8811576300497931777",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-fyi-x64-asan"
},
"number": 1136,
"createdBy": "project:chromium",
"createTime": "2022-06-12T08:36:57.369956538Z",
"startTime": "2022-06-12T08:37:11.576875Z",
"endTime": "2022-06-12T14:01:51.970146128Z",
"updateTime": "2022-06-12T14:01:51.970146128Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d77cdeaf17a543de22bc215619e5019f6c774289",
"ref": "refs/heads/main"
}
},
"canary": true
}
[14:01:52.851] Invocation finished in 5h24m56.737141417s with status FAILED