[03:20:06.189] New invocation is queued and will start shortly
[03:20:07.578] Starting the invocation (attempt 1)
[03:20:07.612] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9598ffdf5f11ef6e3fb02acd144b5b1da4dec68d"
[03:20:07.612] Popped gitiles commit info from properties and tags
[03:20:07.612] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:20:07.612] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:20:07.612] Buildbucket request:
{
"requestId": "8950028399836178352",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9598ffdf5f11ef6e3fb02acd144b5b1da4dec68d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8950028399836178352"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:20:08.172] Scheduled build:
{
"id": "8784598337578209313",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60543,
"createdBy": "project:chromium",
"createTime": "2023-04-06T03:20:07.714423276Z",
"updateTime": "2023-04-06T03:20:07.714423276Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9598ffdf5f11ef6e3fb02acd144b5b1da4dec68d",
"ref": "refs/heads/main"
}
}
}
[03:20:08.173] Task URL: https://cr-buildbucket.appspot.com/build/8784598337578209313
[03:20:08.173] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:2:0) after 2m56s
[03:23:04.545] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:2:0)
[03:23:04.566] Build status: SCHEDULED
[03:23:04.566] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:3:0) after 4m24s
[03:27:28.613] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:3:0)
[03:27:28.638] Build status: SCHEDULED
[03:27:28.638] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:4:0) after 1m40s
[03:29:08.908] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:4:0)
[03:29:08.972] Build status: SCHEDULED
[03:29:08.972] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:5:0) after 9m9s
[03:38:18.057] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:5:0)
[03:38:18.084] Build status: SCHEDULED
[03:38:18.084] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:6:0) after 4m43s
[03:43:01.316] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:6:0)
[03:43:01.384] Build status: SCHEDULED
[03:43:01.384] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:7:0) after 5m20s
[03:48:21.414] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:7:0)
[03:48:21.448] Build status: SCHEDULED
[03:48:21.448] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:8:0) after 4m15s
[03:52:36.455] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:8:0)
[03:52:36.482] Build status: SCHEDULED
[03:52:36.482] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:9:0) after 1m54s
[03:54:30.503] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:9:0)
[03:54:30.521] Build status: SCHEDULED
[03:54:30.521] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:10:0) after 5m41s
[04:00:11.560] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:10:0)
[04:00:11.582] Build status: SCHEDULED
[04:00:11.582] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:11:0) after 7m3s
[04:07:15.047] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:11:0)
[04:07:15.068] Build status: SCHEDULED
[04:07:15.068] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:12:0) after 4m57s
[04:12:12.235] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:12:0)
[04:12:12.255] Build status: SCHEDULED
[04:12:12.255] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:13:0) after 2m38s
[04:14:50.227] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:13:0)
[04:14:50.245] Build status: SCHEDULED
[04:14:50.245] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:14:0) after 8m49s
[04:23:39.457] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:14:0)
[04:23:39.481] Build status: SCHEDULED
[04:23:39.481] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:15:0) after 2m47s
[04:26:26.502] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:15:0)
[04:26:26.522] Build status: SCHEDULED
[04:26:26.522] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:16:0) after 3m55s
[04:30:21.756] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:16:0)
[04:30:21.777] Build status: SCHEDULED
[04:30:21.777] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:17:0) after 4m36s
[04:34:57.814] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:17:0)
[04:34:57.837] Build status: SCHEDULED
[04:34:57.837] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:18:0) after 2m20s
[04:37:17.858] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:18:0)
[04:37:17.879] Build status: SCHEDULED
[04:37:17.879] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:19:0) after 9m39s
[04:46:56.900] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:19:0)
[04:46:56.922] Build status: SCHEDULED
[04:46:56.922] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:20:0) after 9m14s
[04:56:11.093] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:20:0)
[04:56:11.115] Build status: SCHEDULED
[04:56:11.115] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:21:0) after 7m45s
[05:03:56.358] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:21:0)
[05:03:56.377] Build status: SCHEDULED
[05:03:56.377] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:22:0) after 4m22s
[05:08:18.408] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:22:0)
[05:08:18.475] Build status: SCHEDULED
[05:08:18.475] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:23:0) after 9m3s
[05:17:21.886] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:23:0)
[05:17:21.906] Build status: SCHEDULED
[05:17:21.906] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:24:0) after 1m59s
[05:19:21.034] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:24:0)
[05:19:21.058] Build status: SCHEDULED
[05:19:21.058] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:25:0) after 8m28s
[05:27:49.079] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:25:0)
[05:27:49.108] Build status: SCHEDULED
[05:27:49.108] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:26:0) after 5m45s
[05:33:34.134] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:26:0)
[05:33:34.179] Build status: SCHEDULED
[05:33:34.179] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:27:0) after 6m59s
[05:40:33.279] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:27:0)
[05:40:33.298] Build status: SCHEDULED
[05:40:33.298] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:28:0) after 5m0s
[05:45:33.431] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:28:0)
[05:45:33.503] Build status: SCHEDULED
[05:45:33.503] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:29:0) after 7m17s
[05:52:50.695] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:29:0)
[05:52:50.716] Build status: SCHEDULED
[05:52:50.716] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:30:0) after 7m19s
[06:00:09.727] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:30:0)
[06:00:09.745] Build status: SCHEDULED
[06:00:09.745] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:31:0) after 7m34s
[06:07:43.893] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:31:0)
[06:07:43.917] Build status: SCHEDULED
[06:07:43.917] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:32:0) after 6m8s
[06:13:51.941] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:32:0)
[06:13:51.962] Build status: SCHEDULED
[06:13:51.962] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:33:0) after 5m42s
[06:19:33.995] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:33:0)
[06:19:34.016] Build status: SCHEDULED
[06:19:34.016] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:34:0) after 1m34s
[06:21:08.054] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:34:0)
[06:21:08.112] Build status: SCHEDULED
[06:21:08.112] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:35:0) after 6m51s
[06:27:59.136] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:35:0)
[06:27:59.151] Build status: SCHEDULED
[06:27:59.151] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:36:0) after 6m18s
[06:34:17.525] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:36:0)
[06:34:17.551] Build status: SCHEDULED
[06:34:17.551] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:37:0) after 5m29s
[06:39:46.602] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:37:0)
[06:39:46.629] Build status: SCHEDULED
[06:39:46.629] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:38:0) after 9m43s
[06:49:29.798] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:38:0)
[06:49:29.819] Build status: SCHEDULED
[06:49:29.819] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:39:0) after 3m14s
[06:52:43.845] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:39:0)
[06:52:43.891] Build status: SCHEDULED
[06:52:43.891] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:40:0) after 4m28s
[06:57:11.928] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:40:0)
[06:57:11.958] Build status: SCHEDULED
[06:57:11.958] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:41:0) after 5m9s
[07:02:21.238] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:41:0)
[07:02:21.255] Build status: SCHEDULED
[07:02:21.255] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:42:0) after 7m27s
[07:09:48.275] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:42:0)
[07:09:48.297] Build status: SCHEDULED
[07:09:48.297] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:43:0) after 6m42s
[07:16:30.603] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:43:0)
[07:16:30.665] Build status: SCHEDULED
[07:16:30.665] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:44:0) after 3m46s
[07:20:16.735] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:44:0)
[07:20:16.762] Build status: SCHEDULED
[07:20:16.762] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:45:0) after 4m38s
[07:24:54.786] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:45:0)
[07:24:54.806] Build status: SCHEDULED
[07:24:54.806] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:46:0) after 2m3s
[07:26:57.944] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:46:0)
[07:26:57.967] Build status: SCHEDULED
[07:26:57.967] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:47:0) after 8m11s
[07:35:09.644] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:47:0)
[07:35:09.664] Build status: SCHEDULED
[07:35:09.664] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:48:0) after 8m8s
[07:43:17.691] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:48:0)
[07:43:17.714] Build status: SCHEDULED
[07:43:17.715] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:49:0) after 6m7s
[07:49:24.767] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:49:0)
[07:49:24.787] Build status: SCHEDULED
[07:49:24.787] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:50:0) after 5m46s
[07:55:10.809] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:50:0)
[07:55:11.077] Build status: SCHEDULED
[07:55:11.077] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:51:0) after 9m28s
[08:04:39.108] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:51:0)
[08:04:39.165] Build status: SCHEDULED
[08:04:39.165] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:52:0) after 3m34s
[08:08:13.197] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:52:0)
[08:08:13.267] Build status: SCHEDULED
[08:08:13.267] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:53:0) after 6m38s
[08:14:51.618] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:53:0)
[08:14:51.642] Build status: SCHEDULED
[08:14:51.642] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:54:0) after 3m2s
[08:17:53.847] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:54:0)
[08:17:53.868] Build status: SCHEDULED
[08:17:53.868] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:55:0) after 7m34s
[08:25:27.985] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:55:0)
[08:25:28.037] Build status: SCHEDULED
[08:25:28.037] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:56:0) after 6m7s
[08:31:35.253] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:56:0)
[08:31:35.275] Build status: SCHEDULED
[08:31:35.275] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:57:0) after 8m25s
[08:40:00.373] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:57:0)
[08:40:00.396] Build status: SCHEDULED
[08:40:00.396] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:58:0) after 7m25s
[08:47:25.428] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:58:0)
[08:47:25.483] Build status: SCHEDULED
[08:47:25.483] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:59:0) after 2m9s
[08:49:34.507] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:59:0)
[08:49:34.529] Build status: SCHEDULED
[08:49:34.529] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:60:0) after 4m16s
[08:53:50.611] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:60:0)
[08:53:50.634] Build status: SCHEDULED
[08:53:50.634] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:61:0) after 2m20s
[08:56:10.733] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:61:0)
[08:56:10.760] Build status: SCHEDULED
[08:56:10.760] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:62:0) after 1m57s
[08:58:07.767] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:62:0)
[08:58:07.790] Build status: SCHEDULED
[08:58:07.790] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:63:0) after 7m47s
[09:05:54.996] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:63:0)
[09:05:55.017] Build status: SCHEDULED
[09:05:55.017] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:64:0) after 6m1s
[09:11:56.330] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:64:0)
[09:11:56.351] Build status: SCHEDULED
[09:11:56.351] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:65:0) after 8m12s
[09:20:08.392] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:65:0)
[09:20:08.412] Build status: SCHEDULED
[09:20:08.412] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950028399836178352:66:0) after 2m19s
[09:21:03.020] Received PubSub notification, asking Buildbucket for the build status
[09:21:03.092] Build:
{
"id": "8784598337578209313",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60543,
"createdBy": "project:chromium",
"createTime": "2023-04-06T03:20:07.714423276Z",
"endTime": "2023-04-06T09:21:02.309330Z",
"updateTime": "2023-04-06T09:21:02.309330Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9598ffdf5f11ef6e3fb02acd144b5b1da4dec68d",
"ref": "refs/heads/main"
}
}
}
[09:21:03.092] Invocation finished in 6h0m56.915014371s with status FAILED