[05:00:01.010] New invocation is queued and will start shortly
[05:00:02.142] Starting the invocation (attempt 1)
[05:00:02.172] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/498d6b246533be2fc7ced8524154d9093ff06ae6"
[05:00:02.172] Popped gitiles commit info from properties and tags
[05:00:02.172] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:00:02.177] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:00:02.177] Buildbucket request:
{
"requestId": "8948391368417197280",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-lsan-fyi-rel"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "498d6b246533be2fc7ced8524154d9093ff06ae6",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8948391368417197280"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-lsan-fyi-rel"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[05:00:02.607] Scheduled build:
{
"id": "8782961306458593569",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-lsan-fyi-rel"
},
"number": 78,
"createdBy": "project:chromium",
"createTime": "2023-04-24T05:00:02.248656260Z",
"updateTime": "2023-04-24T05:00:02.248656260Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "498d6b246533be2fc7ced8524154d9093ff06ae6",
"ref": "refs/heads/main"
}
}
}
[05:00:02.607] Task URL: https://cr-buildbucket.appspot.com/build/8782961306458593569
[05:00:02.607] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:2:0) after 3m41s
[05:03:43.641] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:2:0)
[05:03:43.666] Build status: SCHEDULED
[05:03:43.666] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:3:0) after 6m51s
[05:10:34.767] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:3:0)
[05:10:34.787] Build status: SCHEDULED
[05:10:34.787] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:4:0) after 3m28s
[05:14:02.873] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:4:0)
[05:14:02.920] Build status: SCHEDULED
[05:14:02.920] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:5:0) after 9m2s
[05:23:04.935] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:5:0)
[05:23:04.963] Build status: SCHEDULED
[05:23:04.963] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:6:0) after 1m43s
[05:24:47.986] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:6:0)
[05:24:48.010] Build status: SCHEDULED
[05:24:48.010] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:7:0) after 5m16s
[05:29:52.448] Received PubSub notification, asking Buildbucket for the build status
[05:29:52.472] Build status: STARTED
[05:30:04.235] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:7:0)
[05:30:04.303] Build status: STARTED
[05:30:04.303] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:9:0) after 4m25s
[05:34:29.337] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:9:0)
[05:34:29.359] Build status: STARTED
[05:34:29.359] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:10:0) after 7m5s
[05:41:34.377] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:10:0)
[05:41:34.406] Build status: STARTED
[05:41:34.406] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:11:0) after 3m20s
[05:44:54.644] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:11:0)
[05:44:54.676] Build status: STARTED
[05:44:54.676] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:12:0) after 1m25s
[05:46:19.698] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:12:0)
[05:46:19.717] Build status: STARTED
[05:46:19.717] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:13:0) after 1m34s
[05:47:53.827] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:13:0)
[05:47:54.003] Build status: STARTED
[05:47:54.003] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:14:0) after 9m3s
[05:56:56.989] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:14:0)
[05:56:57.008] Build status: STARTED
[05:56:57.008] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:15:0) after 5m12s
[06:02:09.106] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:15:0)
[06:02:09.132] Build status: STARTED
[06:02:09.132] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:16:0) after 3m15s
[06:05:24.594] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:16:0)
[06:05:24.625] Build status: STARTED
[06:05:24.625] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:17:0) after 3m32s
[06:08:56.759] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:17:0)
[06:08:56.838] Build status: STARTED
[06:08:56.838] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:18:0) after 3m19s
[06:12:15.857] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:18:0)
[06:12:15.875] Build status: STARTED
[06:12:15.876] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:19:0) after 6m27s
[06:18:42.895] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:19:0)
[06:18:42.926] Build status: STARTED
[06:18:42.926] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:20:0) after 7m37s
[06:26:19.945] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:20:0)
[06:26:19.963] Build status: STARTED
[06:26:19.963] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:21:0) after 2m29s
[06:28:48.995] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:21:0)
[06:28:49.014] Build status: STARTED
[06:28:49.014] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:22:0) after 2m19s
[06:31:08.274] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:22:0)
[06:31:08.292] Build status: STARTED
[06:31:08.293] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:23:0) after 2m0s
[06:33:08.317] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:23:0)
[06:33:08.351] Build status: STARTED
[06:33:08.351] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:24:0) after 1m47s
[06:34:55.437] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:24:0)
[06:34:55.473] Build status: STARTED
[06:34:55.473] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:25:0) after 5m25s
[06:40:20.452] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:25:0)
[06:40:20.471] Build status: STARTED
[06:40:20.471] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:26:0) after 5m39s
[06:45:59.496] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:26:0)
[06:45:59.519] Build status: STARTED
[06:45:59.519] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:27:0) after 9m22s
[06:55:21.542] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:27:0)
[06:55:21.569] Build status: STARTED
[06:55:21.569] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:28:0) after 9m54s
[07:05:15.594] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:28:0)
[07:05:15.619] Build status: STARTED
[07:05:15.620] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:29:0) after 7m35s
[07:12:51.095] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:29:0)
[07:12:51.116] Build status: STARTED
[07:12:51.116] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:30:0) after 8m25s
[07:21:16.143] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:30:0)
[07:21:16.165] Build status: STARTED
[07:21:16.165] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:31:0) after 7m16s
[07:28:32.185] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:31:0)
[07:28:32.255] Build status: STARTED
[07:28:32.255] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:32:0) after 3m24s
[07:31:56.342] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:32:0)
[07:31:56.389] Build status: STARTED
[07:31:56.389] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:33:0) after 8m10s
[07:40:06.521] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:33:0)
[07:40:06.541] Build status: STARTED
[07:40:06.541] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:34:0) after 5m10s
[07:45:17.333] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:34:0)
[07:45:17.369] Build status: STARTED
[07:45:17.369] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:35:0) after 4m4s
[07:49:21.384] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:35:0)
[07:49:21.448] Build status: STARTED
[07:49:21.448] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:36:0) after 4m25s
[07:53:46.479] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:36:0)
[07:53:46.498] Build status: STARTED
[07:53:46.498] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:37:0) after 3m12s
[07:56:58.508] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:37:0)
[07:56:58.527] Build status: STARTED
[07:56:58.527] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:38:0) after 8m39s
[08:05:37.564] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:38:0)
[08:05:37.584] Build status: STARTED
[08:05:37.584] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:39:0) after 3m13s
[08:08:50.754] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:39:0)
[08:08:50.833] Build status: STARTED
[08:08:50.833] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:40:0) after 5m33s
[08:14:23.930] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:40:0)
[08:14:23.954] Build status: STARTED
[08:14:23.954] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:41:0) after 2m56s
[08:17:19.971] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:41:0)
[08:17:19.997] Build status: STARTED
[08:17:19.997] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:42:0) after 5m37s
[08:22:57.146] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:42:0)
[08:22:57.167] Build status: STARTED
[08:22:57.167] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:43:0) after 8m57s
[08:31:54.319] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:43:0)
[08:31:54.342] Build status: STARTED
[08:31:54.343] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:44:0) after 7m33s
[08:39:27.416] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:44:0)
[08:39:27.437] Build status: STARTED
[08:39:27.437] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:45:0) after 9m42s
[08:49:09.497] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:45:0)
[08:49:09.518] Build status: STARTED
[08:49:09.518] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:46:0) after 1m14s
[08:50:23.582] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:46:0)
[08:50:23.604] Build status: STARTED
[08:50:23.604] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:47:0) after 7m41s
[08:58:04.945] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:47:0)
[08:58:04.974] Build status: STARTED
[08:58:04.974] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:48:0) after 5m17s
[09:03:21.996] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:48:0)
[09:03:22.020] Build status: STARTED
[09:03:22.021] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:49:0) after 5m46s
[09:09:08.622] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:49:0)
[09:09:08.651] Build status: STARTED
[09:09:08.651] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:50:0) after 4m13s
[09:13:21.717] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:50:0)
[09:13:21.744] Build status: STARTED
[09:13:21.745] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:51:0) after 8m7s
[09:21:29.163] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:51:0)
[09:21:29.300] Build status: STARTED
[09:21:29.300] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:52:0) after 8m20s
[09:29:49.424] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:52:0)
[09:29:49.446] Build status: STARTED
[09:29:49.446] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:53:0) after 3m17s
[09:33:06.466] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:53:0)
[09:33:06.499] Build status: STARTED
[09:33:06.499] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:54:0) after 3m35s
[09:36:41.532] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:54:0)
[09:36:41.553] Build status: STARTED
[09:36:41.553] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:55:0) after 3m1s
[09:39:42.575] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:55:0)
[09:39:42.593] Build status: STARTED
[09:39:42.593] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:56:0) after 9m31s
[09:49:13.698] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:56:0)
[09:49:13.736] Build status: STARTED
[09:49:13.736] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:57:0) after 4m31s
[09:53:44.800] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:57:0)
[09:53:44.853] Build status: STARTED
[09:53:44.853] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:58:0) after 4m13s
[09:57:57.873] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:58:0)
[09:57:57.892] Build status: STARTED
[09:57:57.892] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:59:0) after 9m26s
[10:07:23.913] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:59:0)
[10:07:24.004] Build status: STARTED
[10:07:24.004] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:60:0) after 4m14s
[10:11:38.235] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:60:0)
[10:11:38.254] Build status: STARTED
[10:11:38.254] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:61:0) after 9m25s
[10:21:03.431] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:61:0)
[10:21:03.454] Build status: STARTED
[10:21:03.454] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:62:0) after 6m56s
[10:27:59.478] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:62:0)
[10:27:59.499] Build status: STARTED
[10:27:59.499] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:63:0) after 9m12s
[10:37:11.517] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:63:0)
[10:37:11.606] Build status: STARTED
[10:37:11.606] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8948391368417197280:64:0) after 5m40s
[10:38:49.777] Received PubSub notification, asking Buildbucket for the build status
[10:38:49.797] Build:
{
"id": "8782961306458593569",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-lsan-fyi-rel"
},
"number": 78,
"createdBy": "project:chromium",
"createTime": "2023-04-24T05:00:02.248656260Z",
"startTime": "2023-04-24T05:29:51.720793Z",
"endTime": "2023-04-24T10:38:49.519536461Z",
"updateTime": "2023-04-24T10:38:49.519536461Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "498d6b246533be2fc7ced8524154d9093ff06ae6",
"ref": "refs/heads/main"
}
}
}
[10:38:49.797] Invocation finished in 5h38m48.799877787s with status FAILED