[01:39:08.763] New invocation is queued and will start shortly
[01:39:09.984] Starting the invocation (attempt 1)
[01:39:10.025] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/8cf214b3b337c0497e0ce8d55da0bd5bf4b4502d"
[01:39:10.026] Popped gitiles commit info from properties and tags
[01:39:10.026] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:39:10.026] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:39:10.026] Buildbucket request:
{
"requestId": "8954564599823556128",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8cf214b3b337c0497e0ce8d55da0bd5bf4b4502d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8954564599823556128"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:39:10.540] Scheduled build:
{
"id": "8789134537678589425",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60325,
"createdBy": "project:chromium",
"createTime": "2023-02-15T01:39:10.184751542Z",
"updateTime": "2023-02-15T01:39:10.184751542Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8cf214b3b337c0497e0ce8d55da0bd5bf4b4502d",
"ref": "refs/heads/main"
}
}
}
[01:39:10.540] Task URL: https://cr-buildbucket.appspot.com/build/8789134537678589425
[01:39:10.540] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:2:0) after 1m6s
[01:40:16.572] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:2:0)
[01:40:16.589] Build status: SCHEDULED
[01:40:16.589] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:3:0) after 9m24s
[01:49:40.792] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:3:0)
[01:49:40.812] Build status: SCHEDULED
[01:49:40.812] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:4:0) after 5m20s
[01:55:00.838] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:4:0)
[01:55:00.869] Build status: SCHEDULED
[01:55:00.869] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:5:0) after 8m28s
[02:03:29.233] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:5:0)
[02:03:29.434] Build status: SCHEDULED
[02:03:29.434] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:6:0) after 2m53s
[02:06:22.716] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:6:0)
[02:06:22.735] Build status: SCHEDULED
[02:06:22.735] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:7:0) after 3m23s
[02:09:45.797] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:7:0)
[02:09:45.836] Build status: SCHEDULED
[02:09:45.836] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:8:0) after 5m14s
[02:15:00.050] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:8:0)
[02:15:00.071] Build status: SCHEDULED
[02:15:00.071] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:9:0) after 2m7s
[02:17:07.619] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:9:0)
[02:17:07.648] Build status: SCHEDULED
[02:17:07.648] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:10:0) after 8m27s
[02:25:34.672] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:10:0)
[02:25:34.698] Build status: SCHEDULED
[02:25:34.698] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:11:0) after 9m41s
[02:35:15.759] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:11:0)
[02:35:15.784] Build status: SCHEDULED
[02:35:15.784] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:12:0) after 9m24s
[02:44:40.039] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:12:0)
[02:44:40.060] Build status: SCHEDULED
[02:44:40.060] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:13:0) after 3m18s
[02:47:58.086] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:13:0)
[02:47:58.106] Build status: SCHEDULED
[02:47:58.106] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:14:0) after 5m0s
[02:52:58.149] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:14:0)
[02:52:58.193] Build status: SCHEDULED
[02:52:58.193] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:15:0) after 1m31s
[02:54:29.532] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:15:0)
[02:54:29.553] Build status: SCHEDULED
[02:54:29.553] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:16:0) after 4m14s
[02:58:43.699] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:16:0)
[02:58:43.721] Build status: SCHEDULED
[02:58:43.721] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:17:0) after 1m18s
[03:00:02.045] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:17:0)
[03:00:02.068] Build status: SCHEDULED
[03:00:02.068] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:18:0) after 6m30s
[03:06:32.421] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:18:0)
[03:06:32.463] Build status: SCHEDULED
[03:06:32.463] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:19:0) after 3m59s
[03:10:31.571] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:19:0)
[03:10:31.603] Build status: SCHEDULED
[03:10:31.603] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:20:0) after 2m2s
[03:12:33.959] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:20:0)
[03:12:33.982] Build status: SCHEDULED
[03:12:33.982] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:21:0) after 3m15s
[03:15:49.365] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:21:0)
[03:15:49.411] Build status: SCHEDULED
[03:15:49.411] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:22:0) after 7m2s
[03:22:51.506] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:22:0)
[03:22:51.528] Build status: SCHEDULED
[03:22:51.528] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:23:0) after 7m37s
[03:30:28.571] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:23:0)
[03:30:28.594] Build status: SCHEDULED
[03:30:28.594] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:24:0) after 5m29s
[03:35:57.634] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:24:0)
[03:35:57.655] Build status: SCHEDULED
[03:35:57.655] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:25:0) after 3m45s
[03:39:42.813] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:25:0)
[03:39:42.833] Build status: SCHEDULED
[03:39:42.833] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:26:0) after 8m32s
[03:48:15.159] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:26:0)
[03:48:15.255] Build status: SCHEDULED
[03:48:15.255] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:27:0) after 7m27s
[03:55:42.397] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:27:0)
[03:55:42.418] Build status: SCHEDULED
[03:55:42.418] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:28:0) after 6m53s
[04:02:35.577] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:28:0)
[04:02:35.598] Build status: SCHEDULED
[04:02:35.598] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:29:0) after 5m7s
[04:07:42.942] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:29:0)
[04:07:42.966] Build status: SCHEDULED
[04:07:42.966] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:30:0) after 9m45s
[04:17:28.254] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:30:0)
[04:17:28.274] Build status: SCHEDULED
[04:17:28.274] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:31:0) after 8m40s
[04:26:08.305] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:31:0)
[04:26:08.333] Build status: SCHEDULED
[04:26:08.333] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:32:0) after 8m10s
[04:34:18.360] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:32:0)
[04:34:18.383] Build status: SCHEDULED
[04:34:18.383] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:33:0) after 8m37s
[04:42:55.410] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:33:0)
[04:42:55.429] Build status: SCHEDULED
[04:42:55.429] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:34:0) after 3m28s
[04:46:23.711] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:34:0)
[04:46:23.748] Build status: SCHEDULED
[04:46:23.748] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:35:0) after 4m0s
[04:50:23.931] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:35:0)
[04:50:24.015] Build status: SCHEDULED
[04:50:24.015] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:36:0) after 3m8s
[04:53:32.434] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:36:0)
[04:53:32.466] Build status: SCHEDULED
[04:53:32.467] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:37:0) after 3m35s
[04:57:07.684] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:37:0)
[04:57:07.765] Build status: SCHEDULED
[04:57:07.765] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:38:0) after 4m0s
[05:01:08.008] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:38:0)
[05:01:08.038] Build status: SCHEDULED
[05:01:08.038] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:39:0) after 2m49s
[05:03:57.066] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:39:0)
[05:03:57.124] Build status: SCHEDULED
[05:03:57.124] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:40:0) after 3m3s
[05:07:00.196] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:40:0)
[05:07:00.218] Build status: SCHEDULED
[05:07:00.218] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:41:0) after 4m10s
[05:11:10.267] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:41:0)
[05:11:10.293] Build status: SCHEDULED
[05:11:10.293] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:42:0) after 4m7s
[05:15:17.595] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:42:0)
[05:15:17.619] Build status: SCHEDULED
[05:15:17.619] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:43:0) after 1m14s
[05:16:32.084] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:43:0)
[05:16:32.104] Build status: SCHEDULED
[05:16:32.104] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:44:0) after 9m18s
[05:25:50.248] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:44:0)
[05:25:50.343] Build status: SCHEDULED
[05:25:50.343] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:45:0) after 5m9s
[05:30:59.469] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:45:0)
[05:30:59.488] Build status: SCHEDULED
[05:30:59.488] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:46:0) after 7m30s
[05:38:29.778] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:46:0)
[05:38:29.796] Build status: SCHEDULED
[05:38:29.796] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:47:0) after 6m28s
[05:44:58.227] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:47:0)
[05:44:58.248] Build status: SCHEDULED
[05:44:58.248] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:48:0) after 1m29s
[05:46:27.286] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:48:0)
[05:46:27.550] Build status: SCHEDULED
[05:46:27.550] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:49:0) after 6m5s
[05:52:32.797] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:49:0)
[05:52:32.818] Build status: SCHEDULED
[05:52:32.818] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:50:0) after 5m12s
[05:57:44.866] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:50:0)
[05:57:44.901] Build status: SCHEDULED
[05:57:44.901] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:51:0) after 7m15s
[06:05:00.172] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:51:0)
[06:05:00.191] Build status: SCHEDULED
[06:05:00.191] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:52:0) after 7m30s
[06:12:30.713] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:52:0)
[06:12:30.734] Build status: SCHEDULED
[06:12:30.734] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:53:0) after 8m23s
[06:20:53.808] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:53:0)
[06:20:53.830] Build status: SCHEDULED
[06:20:53.830] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:54:0) after 8m18s
[06:29:11.915] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:54:0)
[06:29:11.983] Build status: SCHEDULED
[06:29:11.983] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:55:0) after 3m14s
[06:32:26.091] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:55:0)
[06:32:26.114] Build status: SCHEDULED
[06:32:26.114] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:56:0) after 2m0s
[06:34:26.149] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:56:0)
[06:34:26.249] Build status: SCHEDULED
[06:34:26.249] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:57:0) after 1m13s
[06:35:39.273] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:57:0)
[06:35:39.317] Build status: SCHEDULED
[06:35:39.317] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:58:0) after 9m3s
[06:44:42.632] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:58:0)
[06:44:42.661] Build status: SCHEDULED
[06:44:42.661] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:59:0) after 5m33s
[06:50:15.797] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:59:0)
[06:50:15.819] Build status: SCHEDULED
[06:50:15.819] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:60:0) after 4m19s
[06:54:35.051] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:60:0)
[06:54:35.087] Build status: SCHEDULED
[06:54:35.087] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:61:0) after 2m21s
[06:56:56.113] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:61:0)
[06:56:56.146] Build status: SCHEDULED
[06:56:56.146] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:62:0) after 9m47s
[07:06:43.268] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:62:0)
[07:06:43.288] Build status: SCHEDULED
[07:06:43.288] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:63:0) after 9m44s
[07:16:27.321] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:63:0)
[07:16:27.347] Build status: SCHEDULED
[07:16:27.347] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:64:0) after 4m30s
[07:20:57.616] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:64:0)
[07:20:57.637] Build status: SCHEDULED
[07:20:57.637] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:65:0) after 4m55s
[07:25:52.771] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:65:0)
[07:25:52.798] Build status: SCHEDULED
[07:25:52.798] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:66:0) after 8m21s
[07:34:13.981] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:66:0)
[07:34:14.001] Build status: SCHEDULED
[07:34:14.001] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954564599823556128:67:0) after 8m16s
[07:40:19.757] Received PubSub notification, asking Buildbucket for the build status
[07:40:19.790] Build:
{
"id": "8789134537678589425",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60325,
"createdBy": "project:chromium",
"createTime": "2023-02-15T01:39:10.184751542Z",
"endTime": "2023-02-15T07:40:19.213285Z",
"updateTime": "2023-02-15T07:40:19.213285Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8cf214b3b337c0497e0ce8d55da0bd5bf4b4502d",
"ref": "refs/heads/main"
}
}
}
[07:40:19.790] Invocation finished in 6h1m11.034991376s with status FAILED