[01:30:33.219] New invocation is queued and will start shortly
[01:30:34.593] Starting the invocation (attempt 1)
[01:30:34.623] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2adf45be1c08dd6b0fe19cb1c53361697e4ae132"
[01:30:34.623] Popped gitiles commit info from properties and tags
[01:30:34.623] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:30:34.624] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:30:34.624] Buildbucket request:
{
"requestId": "8926570677794361968",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Comparison Mac (reclient)(CQ)"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2adf45be1c08dd6b0fe19cb1c53361697e4ae132",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8926570677794361968"
},
{
"key": "scheduler_job_id",
"value": "chromium/Comparison Mac (reclient)(CQ)"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:30:35.649] Scheduled build:
{
"id": "8761140615581896417",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Comparison Mac (reclient)(CQ)"
},
"number": 5847,
"createdBy": "project:chromium",
"createTime": "2023-12-21T01:30:34.703122965Z",
"updateTime": "2023-12-21T01:30:34.703122965Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2adf45be1c08dd6b0fe19cb1c53361697e4ae132",
"ref": "refs/heads/main"
}
}
}
[01:30:35.649] Task URL: https://cr-buildbucket.appspot.com/build/8761140615581896417
[01:30:35.649] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:2:0) after 7m58s
[01:30:36.479] Received PubSub notification, asking Buildbucket for the build status
[01:30:36.500] Build status: SCHEDULED
[01:30:36.829] Received PubSub notification, asking Buildbucket for the build status
[01:30:36.863] Build status: STARTED
[01:38:33.770] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:2:0)
[01:38:33.858] Build status: STARTED
[01:38:33.858] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:5:0) after 5m44s
[01:44:17.903] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:5:0)
[01:44:17.922] Build status: STARTED
[01:44:17.922] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:6:0) after 2m0s
[01:46:18.091] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:6:0)
[01:46:18.113] Build status: STARTED
[01:46:18.113] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:7:0) after 6m5s
[01:52:23.778] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:7:0)
[01:52:23.796] Build status: STARTED
[01:52:23.796] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:8:0) after 6m58s
[01:59:22.006] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:8:0)
[01:59:22.026] Build status: STARTED
[01:59:22.026] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:9:0) after 3m54s
[02:03:16.100] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:9:0)
[02:03:16.150] Build status: STARTED
[02:03:16.151] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:10:0) after 8m5s
[02:11:21.254] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:10:0)
[02:11:21.274] Build status: STARTED
[02:11:21.274] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:11:0) after 2m15s
[02:13:37.054] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:11:0)
[02:13:37.088] Build status: STARTED
[02:13:37.088] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:12:0) after 2m11s
[02:15:48.419] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:12:0)
[02:15:48.437] Build status: STARTED
[02:15:48.437] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:13:0) after 3m3s
[02:18:51.731] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:13:0)
[02:18:51.759] Build status: STARTED
[02:18:51.759] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:14:0) after 4m52s
[02:23:43.791] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:14:0)
[02:23:43.819] Build status: STARTED
[02:23:43.819] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:15:0) after 2m29s
[02:26:12.854] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:15:0)
[02:26:12.966] Build status: STARTED
[02:26:12.966] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:16:0) after 7m42s
[02:33:54.988] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:16:0)
[02:33:55.116] Build status: STARTED
[02:33:55.116] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:17:0) after 5m23s
[02:39:18.245] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:17:0)
[02:39:18.271] Build status: STARTED
[02:39:18.271] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:18:0) after 5m32s
[02:44:50.470] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:18:0)
[02:44:50.498] Build status: STARTED
[02:44:50.498] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:19:0) after 1m23s
[02:46:13.667] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:19:0)
[02:46:13.685] Build status: STARTED
[02:46:13.685] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:20:0) after 2m1s
[02:48:15.559] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:20:0)
[02:48:15.581] Build status: STARTED
[02:48:15.581] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:21:0) after 4m11s
[02:52:26.603] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:21:0)
[02:52:26.618] Build status: STARTED
[02:52:26.618] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:22:0) after 4m41s
[02:57:07.641] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:22:0)
[02:57:07.907] Build status: STARTED
[02:57:07.907] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:23:0) after 7m36s
[03:04:44.333] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:23:0)
[03:04:44.357] Build status: STARTED
[03:04:44.358] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:24:0) after 7m51s
[03:12:35.468] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:24:0)
[03:12:35.488] Build status: STARTED
[03:12:35.488] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:25:0) after 5m18s
[03:17:53.521] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:25:0)
[03:17:53.542] Build status: STARTED
[03:17:53.542] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:26:0) after 4m30s
[03:22:23.554] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:26:0)
[03:22:23.574] Build status: STARTED
[03:22:23.574] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:27:0) after 3m36s
[03:25:59.962] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:27:0)
[03:26:00.028] Build status: STARTED
[03:26:00.028] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:28:0) after 1m13s
[03:27:13.064] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:28:0)
[03:27:13.122] Build status: STARTED
[03:27:13.122] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:29:0) after 2m34s
[03:29:47.220] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:29:0)
[03:29:47.262] Build status: STARTED
[03:29:47.263] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:30:0) after 3m43s
[03:33:30.321] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:30:0)
[03:33:30.341] Build status: STARTED
[03:33:30.341] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:31:0) after 9m43s
[03:43:13.459] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:31:0)
[03:43:13.522] Build status: STARTED
[03:43:13.522] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:32:0) after 1m36s
[03:44:49.504] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:32:0)
[03:44:49.520] Build status: STARTED
[03:44:49.520] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:33:0) after 5m42s
[03:50:31.609] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:33:0)
[03:50:31.636] Build status: STARTED
[03:50:31.636] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:34:0) after 8m53s
[03:59:24.754] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:34:0)
[03:59:24.773] Build status: STARTED
[03:59:24.773] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:35:0) after 3m47s
[04:03:11.894] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:35:0)
[04:03:11.911] Build status: STARTED
[04:03:11.911] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:36:0) after 4m5s
[04:07:16.950] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:36:0)
[04:07:17.034] Build status: STARTED
[04:07:17.034] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:37:0) after 2m48s
[04:10:05.333] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:37:0)
[04:10:05.351] Build status: STARTED
[04:10:05.351] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:38:0) after 7m19s
[04:17:24.465] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:38:0)
[04:17:24.483] Build status: STARTED
[04:17:24.483] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:39:0) after 2m54s
[04:20:18.591] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:39:0)
[04:20:18.609] Build status: STARTED
[04:20:18.609] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:40:0) after 1m38s
[04:21:56.712] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:40:0)
[04:21:56.763] Build status: STARTED
[04:21:56.763] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:41:0) after 1m52s
[04:23:48.802] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:41:0)
[04:23:48.821] Build status: STARTED
[04:23:48.821] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:42:0) after 1m21s
[04:25:09.942] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:42:0)
[04:25:10.047] Build status: STARTED
[04:25:10.047] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:43:0) after 8m54s
[04:34:04.067] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:43:0)
[04:34:04.090] Build status: STARTED
[04:34:04.090] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:44:0) after 8m52s
[04:42:56.464] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:44:0)
[04:42:56.480] Build status: STARTED
[04:42:56.480] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:45:0) after 2m46s
[04:45:42.921] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:45:0)
[04:45:42.944] Build status: STARTED
[04:45:42.944] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:46:0) after 7m35s
[04:53:17.964] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:46:0)
[04:53:18.032] Build status: STARTED
[04:53:18.032] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:47:0) after 4m28s
[04:57:46.200] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:47:0)
[04:57:46.286] Build status: STARTED
[04:57:46.286] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:48:0) after 4m47s
[05:02:33.313] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:48:0)
[05:02:33.341] Build status: STARTED
[05:02:33.341] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:49:0) after 3m24s
[05:05:57.366] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:49:0)
[05:05:57.385] Build status: STARTED
[05:05:57.385] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:50:0) after 7m9s
[05:13:06.496] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:50:0)
[05:13:06.515] Build status: STARTED
[05:13:06.515] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:51:0) after 9m22s
[05:22:28.593] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:51:0)
[05:22:28.612] Build status: STARTED
[05:22:28.612] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:52:0) after 9m1s
[05:31:29.634] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:52:0)
[05:31:29.655] Build status: STARTED
[05:31:29.655] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:53:0) after 7m23s
[05:38:52.834] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:53:0)
[05:38:52.857] Build status: STARTED
[05:38:52.857] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:54:0) after 6m43s
[05:45:35.887] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:54:0)
[05:45:35.905] Build status: STARTED
[05:45:35.905] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:55:0) after 3m31s
[05:49:06.945] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:55:0)
[05:49:07.007] Build status: STARTED
[05:49:07.007] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:56:0) after 1m51s
[05:50:58.219] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:56:0)
[05:50:58.248] Build status: STARTED
[05:50:58.248] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:57:0) after 9m42s
[06:00:40.444] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:57:0)
[06:00:40.484] Build status: STARTED
[06:00:40.484] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:58:0) after 5m4s
[06:05:44.514] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:58:0)
[06:05:44.537] Build status: STARTED
[06:05:44.537] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:59:0) after 8m51s
[06:14:35.700] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:59:0)
[06:14:35.718] Build status: STARTED
[06:14:35.718] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:60:0) after 5m36s
[06:20:11.789] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:60:0)
[06:20:11.806] Build status: STARTED
[06:20:11.806] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:61:0) after 2m19s
[06:22:31.391] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:61:0)
[06:22:31.415] Build status: STARTED
[06:22:31.415] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:62:0) after 3m20s
[06:25:51.526] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:62:0)
[06:25:51.546] Build status: STARTED
[06:25:51.546] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:63:0) after 6m8s
[06:31:59.627] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:63:0)
[06:31:59.650] Build status: STARTED
[06:31:59.650] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:64:0) after 7m25s
[06:39:24.795] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:64:0)
[06:39:24.915] Build status: STARTED
[06:39:24.915] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:65:0) after 2m2s
[06:41:27.231] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:65:0)
[06:41:27.285] Build status: STARTED
[06:41:27.285] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:66:0) after 5m47s
[06:47:14.432] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:66:0)
[06:47:14.491] Build status: STARTED
[06:47:14.491] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:67:0) after 6m34s
[06:53:48.531] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:67:0)
[06:53:48.551] Build status: STARTED
[06:53:48.551] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:68:0) after 5m55s
[06:59:43.940] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:68:0)
[06:59:43.964] Build status: STARTED
[06:59:43.964] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:69:0) after 3m15s
[07:02:59.142] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:69:0)
[07:02:59.155] Build status: STARTED
[07:02:59.155] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:70:0) after 8m23s
[07:11:22.186] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:70:0)
[07:11:22.305] Build status: STARTED
[07:11:22.305] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:71:0) after 2m51s
[07:14:13.366] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:71:0)
[07:14:13.395] Build status: STARTED
[07:14:13.395] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:72:0) after 2m5s
[07:16:18.508] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:72:0)
[07:16:18.532] Build status: STARTED
[07:16:18.533] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:73:0) after 5m40s
[07:21:58.552] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:73:0)
[07:21:58.575] Build status: STARTED
[07:21:58.575] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:74:0) after 1m7s
[07:23:05.648] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:74:0)
[07:23:05.713] Build status: STARTED
[07:23:05.713] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:75:0) after 2m30s
[07:25:35.761] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:75:0)
[07:25:35.857] Build status: STARTED
[07:25:35.857] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:76:0) after 5m34s
[07:31:09.886] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:76:0)
[07:31:09.904] Build status: STARTED
[07:31:09.904] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:77:0) after 5m25s
[07:36:34.929] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:77:0)
[07:36:34.952] Build status: STARTED
[07:36:34.953] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:78:0) after 3m14s
[07:39:48.984] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:78:0)
[07:39:49.010] Build status: STARTED
[07:39:49.010] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:79:0) after 5m0s
[07:44:49.076] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:79:0)
[07:44:49.098] Build status: STARTED
[07:44:49.098] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:80:0) after 6m32s
[07:51:21.120] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:80:0)
[07:51:21.151] Build status: STARTED
[07:51:21.151] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:81:0) after 5m44s
[07:57:05.236] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:81:0)
[07:57:05.252] Build status: STARTED
[07:57:05.252] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:82:0) after 7m47s
[08:04:52.379] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:82:0)
[08:04:52.407] Build status: STARTED
[08:04:52.407] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:83:0) after 5m6s
[08:09:58.485] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:83:0)
[08:09:58.503] Build status: STARTED
[08:09:58.503] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:84:0) after 4m49s
[08:14:47.626] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:84:0)
[08:14:47.640] Build status: STARTED
[08:14:47.641] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:85:0) after 7m2s
[08:21:49.723] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:85:0)
[08:21:49.742] Build status: STARTED
[08:21:49.742] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:86:0) after 6m54s
[08:28:43.827] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:86:0)
[08:28:43.865] Build status: STARTED
[08:28:43.865] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:87:0) after 8m8s
[08:36:52.037] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:87:0)
[08:36:52.075] Build status: STARTED
[08:36:52.075] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:88:0) after 4m49s
[08:41:41.270] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:88:0)
[08:41:41.299] Build status: STARTED
[08:41:41.299] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:89:0) after 6m42s
[08:48:23.377] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:89:0)
[08:48:23.404] Build status: STARTED
[08:48:23.404] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:90:0) after 6m3s
[08:54:26.507] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:90:0)
[08:54:26.529] Build status: STARTED
[08:54:26.529] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:91:0) after 4m11s
[08:58:37.723] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:91:0)
[08:58:37.754] Build status: STARTED
[08:58:37.754] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:92:0) after 1m43s
[09:00:20.776] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:92:0)
[09:00:20.869] Build status: STARTED
[09:00:20.869] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:93:0) after 6m41s
[09:07:01.892] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:93:0)
[09:07:01.913] Build status: STARTED
[09:07:01.913] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:94:0) after 6m21s
[09:13:22.937] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:94:0)
[09:13:22.964] Build status: STARTED
[09:13:22.964] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:95:0) after 7m17s
[09:20:39.994] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:95:0)
[09:20:40.027] Build status: STARTED
[09:20:40.027] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:96:0) after 7m1s
[09:27:41.052] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:96:0)
[09:27:41.070] Build status: STARTED
[09:27:41.071] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:97:0) after 3m13s
[09:30:54.209] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:97:0)
[09:30:54.387] Build status: STARTED
[09:30:54.387] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:98:0) after 2m0s
[09:32:54.417] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:98:0)
[09:32:54.434] Build status: STARTED
[09:32:54.434] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:99:0) after 9m21s
[09:42:15.459] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:99:0)
[09:42:15.477] Build status: STARTED
[09:42:15.477] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:100:0) after 3m25s
[09:45:40.499] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:100:0)
[09:45:40.518] Build status: STARTED
[09:45:40.518] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:101:0) after 7m43s
[09:53:23.508] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:101:0)
[09:53:23.524] Build status: STARTED
[09:53:23.524] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:102:0) after 3m55s
[09:57:18.545] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:102:0)
[09:57:18.562] Build status: STARTED
[09:57:18.562] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:103:0) after 2m24s
[09:59:42.768] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:103:0)
[09:59:42.786] Build status: STARTED
[09:59:42.786] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:104:0) after 6m54s
[10:06:36.822] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:104:0)
[10:06:36.906] Build status: STARTED
[10:06:36.907] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:105:0) after 1m29s
[10:08:06.234] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:105:0)
[10:08:06.360] Build status: STARTED
[10:08:06.360] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:106:0) after 6m19s
[10:14:25.599] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:106:0)
[10:14:25.624] Build status: STARTED
[10:14:25.624] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:107:0) after 3m19s
[10:17:44.755] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:107:0)
[10:17:44.769] Build status: STARTED
[10:17:44.769] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:108:0) after 7m10s
[10:24:54.811] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:108:0)
[10:24:54.832] Build status: STARTED
[10:24:54.832] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:109:0) after 7m55s
[10:32:49.868] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:109:0)
[10:32:49.939] Build status: STARTED
[10:32:49.939] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:110:0) after 7m58s
[10:40:48.137] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:110:0)
[10:40:48.153] Build status: STARTED
[10:40:48.153] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:111:0) after 3m38s
[10:44:26.300] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:111:0)
[10:44:26.317] Build status: STARTED
[10:44:26.317] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:112:0) after 2m45s
[10:47:11.347] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:112:0)
[10:47:11.370] Build status: STARTED
[10:47:11.370] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:113:0) after 8m23s
[10:55:34.478] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:113:0)
[10:55:34.504] Build status: STARTED
[10:55:34.504] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:114:0) after 5m19s
[11:00:53.663] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:114:0)
[11:00:53.693] Build status: STARTED
[11:00:53.693] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:115:0) after 5m6s
[11:05:59.747] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:115:0)
[11:05:59.762] Build status: STARTED
[11:05:59.762] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:116:0) after 6m15s
[11:12:14.827] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:116:0)
[11:12:14.892] Build status: STARTED
[11:12:14.892] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:117:0) after 8m57s
[11:21:11.944] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:117:0)
[11:21:11.971] Build status: STARTED
[11:21:11.971] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:118:0) after 2m45s
[11:23:57.246] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:118:0)
[11:23:57.308] Build status: STARTED
[11:23:57.309] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:119:0) after 2m55s
[11:26:52.594] Handling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:119:0)
[11:26:52.616] Build status: STARTED
[11:26:52.616] Scheduling timer "check-buildbucket-build-status" (chromium/Comparison Mac (reclient)(CQ):8926570677794361968:120:0) after 6m5s
[11:31:50.026] Received PubSub notification, asking Buildbucket for the build status
[11:31:50.053] Build:
{
"id": "8761140615581896417",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Comparison Mac (reclient)(CQ)"
},
"number": 5847,
"createdBy": "project:chromium",
"createTime": "2023-12-21T01:30:34.703122965Z",
"startTime": "2023-12-21T01:30:36.116901Z",
"endTime": "2023-12-21T11:31:49.111165Z",
"updateTime": "2023-12-21T11:31:49.111165Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2adf45be1c08dd6b0fe19cb1c53361697e4ae132",
"ref": "refs/heads/main"
}
}
}
[11:31:50.053] Invocation finished in 10h1m16.84335762s with status FAILED