[04:19:44.875] New invocation is queued and will start shortly
[04:19:46.026] Starting the invocation (attempt 1)
[04:19:46.052] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/efee908ab3f80ba2a3eb9c3f7d4f7614da27815a"
[04:19:46.052] Popped gitiles commit info from properties and tags
[04:19:46.052] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:19:46.056] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:19:46.056] Buildbucket request:
{
"requestId": "8924929287621887776",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-fyi-x64-asan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "efee908ab3f80ba2a3eb9c3f7d4f7614da27815a",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8924929287621887776"
},
{
"key": "scheduler_job_id",
"value": "chromium/fuchsia-fyi-x64-asan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:19:46.598] Scheduled build:
{
"id": "8759499225650345601",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-fyi-x64-asan"
},
"number": 4777,
"createdBy": "project:chromium",
"createTime": "2024-01-08T04:19:46.124288878Z",
"updateTime": "2024-01-08T04:19:46.124288878Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "efee908ab3f80ba2a3eb9c3f7d4f7614da27815a",
"ref": "refs/heads/main"
}
}
}
[04:19:46.598] Task URL: https://cr-buildbucket.appspot.com/build/8759499225650345601
[04:19:46.598] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:2:0) after 9m32s
[04:19:46.961] Received PubSub notification, asking Buildbucket for the build status
[04:19:46.988] Build status: SCHEDULED
[04:19:49.060] Received PubSub notification, asking Buildbucket for the build status
[04:19:49.090] Build status: STARTED
[04:29:18.738] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:2:0)
[04:29:18.760] Build status: STARTED
[04:29:18.760] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:5:0) after 2m28s
[04:31:46.777] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:5:0)
[04:31:46.849] Build status: STARTED
[04:31:46.849] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:6:0) after 4m54s
[04:36:40.867] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:6:0)
[04:36:40.914] Build status: STARTED
[04:36:40.914] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:7:0) after 5m4s
[04:41:44.965] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:7:0)
[04:41:44.994] Build status: STARTED
[04:41:44.994] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:8:0) after 9m24s
[04:51:09.045] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:8:0)
[04:51:09.066] Build status: STARTED
[04:51:09.066] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:9:0) after 3m25s
[04:54:34.093] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:9:0)
[04:54:34.112] Build status: STARTED
[04:54:34.112] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:10:0) after 8m54s
[05:03:28.130] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:10:0)
[05:03:28.151] Build status: STARTED
[05:03:28.151] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:11:0) after 6m49s
[05:10:17.127] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:11:0)
[05:10:17.146] Build status: STARTED
[05:10:17.146] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:12:0) after 8m46s
[05:19:03.201] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:12:0)
[05:19:03.238] Build status: STARTED
[05:19:03.238] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:13:0) after 1m17s
[05:20:20.327] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:13:0)
[05:20:20.345] Build status: STARTED
[05:20:20.345] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:14:0) after 8m7s
[05:28:27.875] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:14:0)
[05:28:27.943] Build status: STARTED
[05:28:27.944] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:15:0) after 8m49s
[05:37:16.970] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:15:0)
[05:37:16.990] Build status: STARTED
[05:37:16.990] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:16:0) after 5m55s
[05:43:12.003] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:16:0)
[05:43:12.019] Build status: STARTED
[05:43:12.019] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:17:0) after 5m25s
[05:48:37.134] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:17:0)
[05:48:37.207] Build status: STARTED
[05:48:37.207] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:18:0) after 6m46s
[05:55:23.222] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:18:0)
[05:55:23.321] Build status: STARTED
[05:55:23.321] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:19:0) after 1m26s
[05:56:49.336] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:19:0)
[05:56:49.369] Build status: STARTED
[05:56:49.369] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:20:0) after 5m37s
[06:02:26.401] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:20:0)
[06:02:26.504] Build status: STARTED
[06:02:26.504] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:21:0) after 3m7s
[06:05:33.531] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:21:0)
[06:05:33.563] Build status: STARTED
[06:05:33.563] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:22:0) after 6m58s
[06:12:31.580] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:22:0)
[06:12:31.643] Build status: STARTED
[06:12:31.643] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:23:0) after 7m3s
[06:19:34.666] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:23:0)
[06:19:34.699] Build status: STARTED
[06:19:34.699] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:24:0) after 7m28s
[06:27:02.727] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:24:0)
[06:27:02.757] Build status: STARTED
[06:27:02.757] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:25:0) after 3m26s
[06:30:28.789] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:25:0)
[06:30:28.810] Build status: STARTED
[06:30:28.811] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:26:0) after 2m29s
[06:32:57.879] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:26:0)
[06:32:57.900] Build status: STARTED
[06:32:57.900] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:27:0) after 5m23s
[06:38:20.943] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:27:0)
[06:38:20.960] Build status: STARTED
[06:38:20.960] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:28:0) after 6m38s
[06:44:58.976] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:28:0)
[06:44:59.177] Build status: STARTED
[06:44:59.177] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:29:0) after 9m43s
[06:54:42.306] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:29:0)
[06:54:42.326] Build status: STARTED
[06:54:42.326] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:30:0) after 4m40s
[06:59:22.455] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:30:0)
[06:59:22.472] Build status: STARTED
[06:59:22.472] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:31:0) after 3m7s
[07:02:29.478] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:31:0)
[07:02:29.604] Build status: STARTED
[07:02:29.604] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:32:0) after 8m9s
[07:10:38.625] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:32:0)
[07:10:39.221] Build status: STARTED
[07:10:39.221] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:33:0) after 1m7s
[07:11:46.236] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:33:0)
[07:11:46.258] Build status: STARTED
[07:11:46.258] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:34:0) after 5m19s
[07:17:05.342] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:34:0)
[07:17:05.392] Build status: STARTED
[07:17:05.392] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:35:0) after 7m44s
[07:24:49.508] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:35:0)
[07:24:49.529] Build status: STARTED
[07:24:49.529] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:36:0) after 1m18s
[07:26:07.546] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:36:0)
[07:26:07.568] Build status: STARTED
[07:26:07.568] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:37:0) after 8m23s
[07:34:30.667] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:37:0)
[07:34:30.684] Build status: STARTED
[07:34:30.684] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:38:0) after 3m12s
[07:37:42.802] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:38:0)
[07:37:42.829] Build status: STARTED
[07:37:42.829] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:39:0) after 6m59s
[07:44:41.884] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:39:0)
[07:44:41.902] Build status: STARTED
[07:44:41.902] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:40:0) after 9m6s
[07:53:47.934] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:40:0)
[07:53:47.955] Build status: STARTED
[07:53:47.955] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:41:0) after 7m42s
[08:01:30.066] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:41:0)
[08:01:30.159] Build status: STARTED
[08:01:30.159] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:42:0) after 8m19s
[08:09:49.281] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:42:0)
[08:09:49.308] Build status: STARTED
[08:09:49.308] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:43:0) after 6m16s
[08:16:05.404] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:43:0)
[08:16:05.431] Build status: STARTED
[08:16:05.431] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:44:0) after 1m23s
[08:17:28.467] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:44:0)
[08:17:28.488] Build status: STARTED
[08:17:28.488] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:45:0) after 9m14s
[08:26:42.644] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:45:0)
[08:26:42.672] Build status: STARTED
[08:26:42.672] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:46:0) after 2m13s
[08:28:56.033] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:46:0)
[08:28:56.062] Build status: STARTED
[08:28:56.062] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:47:0) after 1m27s
[08:30:23.185] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:47:0)
[08:30:23.212] Build status: STARTED
[08:30:23.212] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:48:0) after 3m14s
[08:33:37.378] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:48:0)
[08:33:37.409] Build status: STARTED
[08:33:37.409] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:49:0) after 1m17s
[08:34:54.446] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:49:0)
[08:34:54.481] Build status: STARTED
[08:34:54.481] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:50:0) after 2m4s
[08:36:58.499] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:50:0)
[08:36:58.521] Build status: STARTED
[08:36:58.521] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:51:0) after 9m4s
[08:46:02.541] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:51:0)
[08:46:02.559] Build status: STARTED
[08:46:02.559] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:52:0) after 5m10s
[08:51:12.638] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:52:0)
[08:51:12.658] Build status: STARTED
[08:51:12.658] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:53:0) after 9m18s
[09:00:30.692] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:53:0)
[09:00:30.713] Build status: STARTED
[09:00:30.713] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:54:0) after 6m21s
[09:06:51.729] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:54:0)
[09:06:51.767] Build status: STARTED
[09:06:51.767] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:55:0) after 5m16s
[09:12:07.793] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:55:0)
[09:12:07.810] Build status: STARTED
[09:12:07.810] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:56:0) after 5m7s
[09:17:14.924] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:56:0)
[09:17:14.943] Build status: STARTED
[09:17:14.943] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:57:0) after 1m55s
[09:19:10.167] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:57:0)
[09:19:10.191] Build status: STARTED
[09:19:10.191] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:58:0) after 9m49s
[09:28:59.299] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:58:0)
[09:28:59.416] Build status: STARTED
[09:28:59.416] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:59:0) after 1m35s
[09:30:34.435] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:59:0)
[09:30:34.462] Build status: STARTED
[09:30:34.462] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:60:0) after 4m10s
[09:34:44.490] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:60:0)
[09:34:44.532] Build status: STARTED
[09:34:44.532] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:61:0) after 9m6s
[09:43:50.725] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:61:0)
[09:43:50.744] Build status: STARTED
[09:43:50.744] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:62:0) after 6m24s
[09:50:14.905] Handling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:62:0)
[09:50:14.927] Build status: STARTED
[09:50:14.927] Scheduling timer "check-buildbucket-build-status" (chromium/fuchsia-fyi-x64-asan:8924929287621887776:63:0) after 6m4s
[09:52:07.962] Received PubSub notification, asking Buildbucket for the build status
[09:52:07.977] Build:
{
"id": "8759499225650345601",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "fuchsia-fyi-x64-asan"
},
"number": 4777,
"createdBy": "project:chromium",
"createTime": "2024-01-08T04:19:46.124288878Z",
"startTime": "2024-01-08T04:19:48.462496Z",
"endTime": "2024-01-08T09:52:04.813840Z",
"updateTime": "2024-01-08T09:52:04.813840Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "efee908ab3f80ba2a3eb9c3f7d4f7614da27815a",
"ref": "refs/heads/main"
}
}
}
[09:52:07.977] Invocation finished in 5h32m23.115898311s with status FAILED