[07:00:08.457] New invocation is queued and will start shortly
[07:00:09.540] Starting the invocation (attempt 1)
[07:00:09.577] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/3ce06be375f320f7d5887c2a38761cbb0db047f4"
[07:00:09.577] Popped gitiles commit info from properties and tags
[07:00:09.577] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[07:00:09.577] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[07:00:09.577] Buildbucket request:
{
"requestId": "9002107811939142080",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-fyi-arm64-dbg"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3ce06be375f320f7d5887c2a38761cbb0db047f4",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9002107811939142080"
},
{
"key": "scheduler_job_id",
"value": "chromium/fuchsia-fyi-arm64-dbg"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[07:00:10.078] Scheduled build:
{
"id": "8836677750038214721",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-fyi-arm64-dbg"
},
"number": 2487,
"createdBy": "project:chromium",
"createTime": "2021-09-08T07:00:09.637556654Z",
"updateTime": "2021-09-08T07:00:09.897814302Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3ce06be375f320f7d5887c2a38761cbb0db047f4",
"ref": "refs/heads/main"
}
}
}
[07:00:10.078] Task URL: https://cr-buildbucket.appspot.com/build/8836677750038214721
[07:00:10.078] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:2:0) after 8m36s
[07:04:08.069] Received PubSub notification, asking Buildbucket for the build status
[07:04:08.113] Build status: STARTED
[07:08:46.202] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:2:0)
[07:08:46.234] Build status: STARTED
[07:08:46.234] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:4:0) after 5m41s
[07:14:27.337] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:4:0)
[07:14:27.383] Build status: STARTED
[07:14:27.383] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:5:0) after 3m40s
[07:18:07.499] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:5:0)
[07:18:07.541] Build status: STARTED
[07:18:07.541] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:6:0) after 3m48s
[07:21:55.783] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:6:0)
[07:21:55.818] Build status: STARTED
[07:21:55.818] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:7:0) after 4m41s
[07:26:36.877] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:7:0)
[07:26:36.946] Build status: STARTED
[07:26:36.946] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:8:0) after 8m42s
[07:35:19.037] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:8:0)
[07:35:19.124] Build status: STARTED
[07:35:19.124] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:9:0) after 5m23s
[07:40:42.454] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:9:0)
[07:40:42.494] Build status: STARTED
[07:40:42.494] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:10:0) after 4m49s
[07:45:31.518] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:10:0)
[07:45:31.548] Build status: STARTED
[07:45:31.548] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:11:0) after 9m52s
[07:55:23.852] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:11:0)
[07:55:23.883] Build status: STARTED
[07:55:23.883] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:12:0) after 7m56s
[08:03:19.924] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:12:0)
[08:03:20.047] Build status: STARTED
[08:03:20.047] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:13:0) after 1m36s
[08:04:56.078] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:13:0)
[08:04:56.112] Build status: STARTED
[08:04:56.112] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:14:0) after 8m35s
[08:13:31.280] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:14:0)
[08:13:31.321] Build status: STARTED
[08:13:31.321] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:15:0) after 7m38s
[08:21:09.425] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:15:0)
[08:21:09.461] Build status: STARTED
[08:21:09.461] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:16:0) after 8m30s
[08:29:39.492] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:16:0)
[08:29:39.525] Build status: STARTED
[08:29:39.525] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:17:0) after 5m14s
[08:34:53.821] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:17:0)
[08:34:53.855] Build status: STARTED
[08:34:53.855] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:18:0) after 1m31s
[08:36:25.175] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:18:0)
[08:36:25.257] Build status: STARTED
[08:36:25.257] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:19:0) after 2m16s
[08:38:41.278] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:19:0)
[08:38:41.336] Build status: STARTED
[08:38:41.336] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:20:0) after 5m12s
[08:43:53.366] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:20:0)
[08:43:53.406] Build status: STARTED
[08:43:53.406] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:21:0) after 3m14s
[08:47:07.575] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:21:0)
[08:47:07.659] Build status: STARTED
[08:47:07.659] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:22:0) after 8m47s
[08:55:54.683] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:22:0)
[08:55:54.719] Build status: STARTED
[08:55:54.719] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:23:0) after 1m58s
[08:57:52.758] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:23:0)
[08:57:52.798] Build status: STARTED
[08:57:52.798] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:24:0) after 5m38s
[09:03:30.911] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:24:0)
[09:03:30.946] Build status: STARTED
[09:03:30.947] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:25:0) after 3m2s
[09:06:32.978] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:25:0)
[09:06:33.020] Build status: STARTED
[09:06:33.020] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:26:0) after 7m36s
[09:14:09.301] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:26:0)
[09:14:09.440] Build status: STARTED
[09:14:09.440] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:27:0) after 7m49s
[09:21:58.593] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:27:0)
[09:21:58.688] Build status: STARTED
[09:21:58.688] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:28:0) after 7m33s
[09:29:32.090] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:28:0)
[09:29:32.137] Build status: STARTED
[09:29:32.138] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:29:0) after 5m45s
[09:35:17.206] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:29:0)
[09:35:17.294] Build status: STARTED
[09:35:17.294] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:30:0) after 7m40s
[09:42:57.397] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:30:0)
[09:42:57.445] Build status: STARTED
[09:42:57.445] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:31:0) after 5m9s
[09:48:06.575] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:31:0)
[09:48:06.627] Build status: STARTED
[09:48:06.627] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:32:0) after 7m9s
[09:55:15.709] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:32:0)
[09:55:15.744] Build status: STARTED
[09:55:15.744] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:33:0) after 9m33s
[10:04:48.935] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:33:0)
[10:04:48.999] Build status: STARTED
[10:04:48.999] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:34:0) after 3m20s
[10:08:09.047] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:34:0)
[10:08:09.084] Build status: STARTED
[10:08:09.084] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:35:0) after 4m37s
[10:12:46.158] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:35:0)
[10:12:46.189] Build status: STARTED
[10:12:46.189] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:36:0) after 5m12s
[10:17:58.409] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:36:0)
[10:17:58.446] Build status: STARTED
[10:17:58.446] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:37:0) after 6m32s
[10:24:30.476] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:37:0)
[10:24:30.527] Build status: STARTED
[10:24:30.527] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:38:0) after 1m6s
[10:25:36.569] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:38:0)
[10:25:36.602] Build status: STARTED
[10:25:36.602] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:39:0) after 9m4s
[10:34:40.629] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:39:0)
[10:34:40.683] Build status: STARTED
[10:34:40.683] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:40:0) after 4m48s
[10:39:28.741] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:40:0)
[10:39:28.776] Build status: STARTED
[10:39:28.776] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:41:0) after 4m48s
[10:44:16.928] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:41:0)
[10:44:17.034] Build status: STARTED
[10:44:17.034] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:42:0) after 5m43s
[10:50:00.016] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:42:0)
[10:50:00.046] Build status: STARTED
[10:50:00.046] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:43:0) after 8m37s
[10:58:37.174] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:43:0)
[10:58:37.248] Build status: STARTED
[10:58:37.249] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:44:0) after 1m31s
[11:00:08.286] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:44:0)
[11:00:08.325] Build status: STARTED
[11:00:08.325] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:45:0) after 9m2s
[11:09:10.386] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:45:0)
[11:09:10.429] Build status: STARTED
[11:09:10.429] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:46:0) after 6m51s
[11:16:01.672] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:46:0)
[11:16:01.710] Build status: STARTED
[11:16:01.710] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:47:0) after 8m22s
[11:24:23.737] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:47:0)
[11:24:23.792] Build status: STARTED
[11:24:23.792] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:48:0) after 8m2s
[11:32:25.835] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:48:0)
[11:32:25.870] Build status: STARTED
[11:32:25.870] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:49:0) after 4m59s
[11:37:24.902] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:49:0)
[11:37:24.962] Build status: STARTED
[11:37:24.962] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:50:0) after 7m42s
[11:45:06.985] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:50:0)
[11:45:07.022] Build status: STARTED
[11:45:07.022] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:51:0) after 9m14s
[11:54:21.152] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:51:0)
[11:54:21.201] Build status: STARTED
[11:54:21.201] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:52:0) after 2m6s
[11:56:27.273] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:52:0)
[11:56:27.318] Build status: STARTED
[11:56:27.318] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:53:0) after 8m30s
[12:04:57.513] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:53:0)
[12:04:57.654] Build status: STARTED
[12:04:57.654] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:54:0) after 7m36s
[12:12:33.884] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:54:0)
[12:12:33.920] Build status: STARTED
[12:12:33.920] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:55:0) after 3m47s
[12:16:20.941] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:55:0)
[12:16:20.992] Build status: STARTED
[12:16:20.992] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-arm64-dbg:9002107811939142080:56:0) after 4m26s
[12:17:19.679] Received PubSub notification, asking Buildbucket for the build status
[12:17:19.719] Build:
{
"id": "8836677750038214721",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-fyi-arm64-dbg"
},
"number": 2487,
"createdBy": "project:chromium",
"createTime": "2021-09-08T07:00:09.637556654Z",
"startTime": "2021-09-08T07:04:06.632356Z",
"endTime": "2021-09-08T12:17:19.095513423Z",
"updateTime": "2021-09-08T12:17:19.097036673Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3ce06be375f320f7d5887c2a38761cbb0db047f4",
"ref": "refs/heads/main"
}
}
}
[12:17:19.719] Invocation finished in 5h17m11.2782057s with status FAILED