[13:30:49.249] New invocation is queued and will start shortly
[13:30:50.322] Starting the invocation (attempt 1)
[13:30:50.366] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/b095339d04dc75b5ea44bab76bd1cf7fc4219013"
[13:30:50.366] Popped gitiles commit info from properties and tags
[13:30:50.366] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:30:50.367] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:30:50.367] Buildbucket request:
{
"requestId": "8966750415589756016",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-fyi-x64-asan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b095339d04dc75b5ea44bab76bd1cf7fc4219013",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8966750415589756016"
},
{
"key": "scheduler_job_id",
"value": "chromium/fuchsia-fyi-x64-asan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:30:50.923] Scheduled build:
{
"id": "8801320353662097761",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-fyi-x64-asan"
},
"number": 1639,
"createdBy": "project:chromium",
"createTime": "2022-10-03T13:30:50.456195616Z",
"updateTime": "2022-10-03T13:30:50.456195616Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b095339d04dc75b5ea44bab76bd1cf7fc4219013",
"ref": "refs/heads/main"
}
}
}
[13:30:50.923] Task URL: https://cr-buildbucket.appspot.com/build/8801320353662097761
[13:30:50.923] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:2:0) after 4m23s
[13:31:10.046] Received PubSub notification, asking Buildbucket for the build status
[13:31:10.077] Build status: STARTED
[13:35:13.988] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:2:0)
[13:35:14.064] Build status: STARTED
[13:35:14.064] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:4:0) after 6m50s
[13:42:04.301] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:4:0)
[13:42:04.430] Build status: STARTED
[13:42:04.430] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:5:0) after 7m11s
[13:49:15.457] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:5:0)
[13:49:15.488] Build status: STARTED
[13:49:15.488] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:6:0) after 7m44s
[13:56:59.510] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:6:0)
[13:56:59.532] Build status: STARTED
[13:56:59.532] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:7:0) after 7m43s
[14:04:42.573] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:7:0)
[14:04:42.600] Build status: STARTED
[14:04:42.600] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:8:0) after 7m55s
[14:12:37.750] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:8:0)
[14:12:37.781] Build status: STARTED
[14:12:37.781] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:9:0) after 7m11s
[14:19:48.815] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:9:0)
[14:19:48.844] Build status: STARTED
[14:19:48.844] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:10:0) after 8m44s
[14:28:33.083] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:10:0)
[14:28:33.151] Build status: STARTED
[14:28:33.151] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:11:0) after 9m0s
[14:37:33.184] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:11:0)
[14:37:33.214] Build status: STARTED
[14:37:33.214] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:12:0) after 4m21s
[14:41:54.428] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:12:0)
[14:41:54.450] Build status: STARTED
[14:41:54.450] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:13:0) after 3m53s
[14:45:47.637] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:13:0)
[14:45:47.671] Build status: STARTED
[14:45:47.671] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:14:0) after 4m6s
[14:49:53.674] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:14:0)
[14:49:53.703] Build status: STARTED
[14:49:53.703] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:15:0) after 9m22s
[14:59:15.726] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:15:0)
[14:59:15.757] Build status: STARTED
[14:59:15.757] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:16:0) after 8m22s
[15:07:38.004] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:16:0)
[15:07:38.029] Build status: STARTED
[15:07:38.029] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:17:0) after 6m19s
[15:13:57.069] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:17:0)
[15:13:57.147] Build status: STARTED
[15:13:57.147] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:18:0) after 1m16s
[15:15:13.424] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:18:0)
[15:15:13.450] Build status: STARTED
[15:15:13.450] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:19:0) after 7m21s
[15:22:34.475] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:19:0)
[15:22:34.497] Build status: STARTED
[15:22:34.497] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:20:0) after 9m27s
[15:32:01.626] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:20:0)
[15:32:01.665] Build status: STARTED
[15:32:01.665] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:21:0) after 7m53s
[15:39:54.916] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:21:0)
[15:39:54.943] Build status: STARTED
[15:39:54.943] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:22:0) after 9m35s
[15:49:29.981] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:22:0)
[15:49:30.006] Build status: STARTED
[15:49:30.006] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:23:0) after 2m58s
[15:52:28.040] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:23:0)
[15:52:28.067] Build status: STARTED
[15:52:28.067] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:24:0) after 5m33s
[15:58:01.158] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:24:0)
[15:58:01.235] Build status: STARTED
[15:58:01.235] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:25:0) after 4m13s
[16:02:14.476] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:25:0)
[16:02:14.504] Build status: STARTED
[16:02:14.504] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:26:0) after 7m29s
[16:09:43.551] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:26:0)
[16:09:43.577] Build status: STARTED
[16:09:43.577] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:27:0) after 9m55s
[16:19:38.631] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:27:0)
[16:19:38.673] Build status: STARTED
[16:19:38.673] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:28:0) after 4m8s
[16:23:46.947] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:28:0)
[16:23:47.007] Build status: STARTED
[16:23:47.007] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:29:0) after 3m20s
[16:27:07.034] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:29:0)
[16:27:07.060] Build status: STARTED
[16:27:07.060] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:30:0) after 5m12s
[16:32:19.150] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:30:0)
[16:32:19.185] Build status: STARTED
[16:32:19.185] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:31:0) after 2m26s
[16:34:45.388] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:31:0)
[16:34:45.412] Build status: STARTED
[16:34:45.412] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:32:0) after 8m46s
[16:43:31.809] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:32:0)
[16:43:31.832] Build status: STARTED
[16:43:31.832] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:33:0) after 5m8s
[16:48:40.135] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:33:0)
[16:48:40.294] Build status: STARTED
[16:48:40.294] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:34:0) after 1m31s
[16:50:11.384] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:34:0)
[16:50:11.421] Build status: STARTED
[16:50:11.422] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:35:0) after 5m45s
[16:55:56.420] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:35:0)
[16:55:56.454] Build status: STARTED
[16:55:56.454] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:36:0) after 5m29s
[17:01:25.669] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:36:0)
[17:01:25.700] Build status: STARTED
[17:01:25.700] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:37:0) after 6m54s
[17:08:19.956] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:37:0)
[17:08:19.986] Build status: STARTED
[17:08:19.986] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:38:0) after 5m52s
[17:14:12.074] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:38:0)
[17:14:12.141] Build status: STARTED
[17:14:12.141] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:39:0) after 7m40s
[17:21:52.200] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:39:0)
[17:21:52.226] Build status: STARTED
[17:21:52.226] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:40:0) after 9m56s
[17:31:48.438] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:40:0)
[17:31:48.471] Build status: STARTED
[17:31:48.471] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:41:0) after 1m41s
[17:33:29.508] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:41:0)
[17:33:29.536] Build status: STARTED
[17:33:29.536] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:42:0) after 6m41s
[17:40:10.560] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:42:0)
[17:40:10.593] Build status: STARTED
[17:40:10.593] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:43:0) after 3m12s
[17:43:22.700] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:43:0)
[17:43:22.723] Build status: STARTED
[17:43:22.723] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:44:0) after 9m2s
[17:52:24.824] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:44:0)
[17:52:24.856] Build status: STARTED
[17:52:24.856] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:45:0) after 7m55s
[18:00:20.084] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:45:0)
[18:00:20.116] Build status: STARTED
[18:00:20.116] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:46:0) after 6m29s
[18:06:49.148] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:46:0)
[18:06:49.180] Build status: STARTED
[18:06:49.180] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:47:0) after 3m28s
[18:10:17.203] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:47:0)
[18:10:17.229] Build status: STARTED
[18:10:17.229] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:48:0) after 3m56s
[18:14:13.263] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:48:0)
[18:14:13.435] Build status: STARTED
[18:14:13.435] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:49:0) after 9m59s
[18:24:12.469] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:49:0)
[18:24:12.503] Build status: STARTED
[18:24:12.503] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:50:0) after 3m15s
[18:27:27.525] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:50:0)
[18:27:27.552] Build status: STARTED
[18:27:27.552] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:51:0) after 8m25s
[18:35:52.608] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:51:0)
[18:35:52.647] Build status: STARTED
[18:35:52.648] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:52:0) after 8m49s
[18:44:41.851] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:52:0)
[18:44:41.875] Build status: STARTED
[18:44:41.875] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8966750415589756016:53:0) after 7m8s
[18:48:17.996] Received PubSub notification, asking Buildbucket for the build status
[18:48:18.020] Build:
{
"id": "8801320353662097761",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-fyi-x64-asan"
},
"number": 1639,
"createdBy": "project:chromium",
"createTime": "2022-10-03T13:30:50.456195616Z",
"startTime": "2022-10-03T13:31:09.318567Z",
"endTime": "2022-10-03T18:48:17.540143749Z",
"updateTime": "2022-10-03T18:48:17.540143749Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b095339d04dc75b5ea44bab76bd1cf7fc4219013",
"ref": "refs/heads/main"
}
}
}
[18:48:18.020] Invocation finished in 5h17m28.786383173s with status FAILED