[01:08:08.888] New invocation is queued and will start shortly
[01:08:10.007] Starting the invocation (attempt 1)
[01:08:10.036] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/765b445c62ec74c8a3e1e17d91012cfdc3426fc1"
[01:08:10.036] Popped gitiles commit info from properties and tags
[01:08:10.036] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:08:10.036] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:08:10.036] Buildbucket request:
{
"requestId": "8951667447120388144",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "765b445c62ec74c8a3e1e17d91012cfdc3426fc1",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8951667447120388144"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:08:10.496] Scheduled build:
{
"id": "8786237385198507969",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60471,
"createdBy": "project:chromium",
"createTime": "2023-03-19T01:08:10.095232785Z",
"updateTime": "2023-03-19T01:08:10.095232785Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "765b445c62ec74c8a3e1e17d91012cfdc3426fc1",
"ref": "refs/heads/main"
}
}
}
[01:08:10.496] Task URL: https://cr-buildbucket.appspot.com/build/8786237385198507969
[01:08:10.496] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:2:0) after 7m11s
[01:15:21.515] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:2:0)
[01:15:21.561] Build status: SCHEDULED
[01:15:21.561] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:3:0) after 2m11s
[01:17:32.611] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:3:0)
[01:17:32.641] Build status: SCHEDULED
[01:17:32.641] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:4:0) after 9m7s
[01:26:39.660] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:4:0)
[01:26:39.679] Build status: SCHEDULED
[01:26:39.679] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:5:0) after 9m53s
[01:36:32.746] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:5:0)
[01:36:32.769] Build status: SCHEDULED
[01:36:32.770] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:6:0) after 4m23s
[01:40:56.107] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:6:0)
[01:40:56.125] Build status: SCHEDULED
[01:40:56.125] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:7:0) after 8m29s
[01:49:25.140] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:7:0)
[01:49:25.159] Build status: SCHEDULED
[01:49:25.159] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:8:0) after 9m54s
[01:59:19.228] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:8:0)
[01:59:19.246] Build status: SCHEDULED
[01:59:19.246] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:9:0) after 9m45s
[02:09:04.269] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:9:0)
[02:09:04.309] Build status: SCHEDULED
[02:09:04.309] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:10:0) after 7m9s
[02:16:13.355] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:10:0)
[02:16:13.375] Build status: SCHEDULED
[02:16:13.375] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:11:0) after 4m33s
[02:20:46.392] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:11:0)
[02:20:46.409] Build status: SCHEDULED
[02:20:46.409] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:12:0) after 3m50s
[02:24:36.434] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:12:0)
[02:24:36.460] Build status: SCHEDULED
[02:24:36.460] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:13:0) after 4m4s
[02:28:40.666] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:13:0)
[02:28:40.688] Build status: SCHEDULED
[02:28:40.688] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:14:0) after 5m22s
[02:34:02.706] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:14:0)
[02:34:02.723] Build status: SCHEDULED
[02:34:02.723] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:15:0) after 8m6s
[02:42:08.890] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:15:0)
[02:42:08.911] Build status: SCHEDULED
[02:42:08.911] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:16:0) after 8m33s
[02:50:41.921] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:16:0)
[02:50:41.945] Build status: SCHEDULED
[02:50:41.945] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:17:0) after 2m29s
[02:53:10.981] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:17:0)
[02:53:11.002] Build status: SCHEDULED
[02:53:11.002] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:18:0) after 3m28s
[02:56:39.324] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:18:0)
[02:56:39.343] Build status: SCHEDULED
[02:56:39.343] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:19:0) after 4m1s
[03:00:40.511] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:19:0)
[03:00:40.531] Build status: SCHEDULED
[03:00:40.531] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:20:0) after 1m58s
[03:02:38.551] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:20:0)
[03:02:38.584] Build status: SCHEDULED
[03:02:38.584] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:21:0) after 8m49s
[03:11:27.608] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:21:0)
[03:11:27.625] Build status: SCHEDULED
[03:11:27.625] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:22:0) after 7m33s
[03:19:00.742] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:22:0)
[03:19:00.762] Build status: SCHEDULED
[03:19:00.762] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:23:0) after 5m51s
[03:24:51.790] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:23:0)
[03:24:51.811] Build status: SCHEDULED
[03:24:51.811] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:24:0) after 9m17s
[03:34:08.829] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:24:0)
[03:34:08.853] Build status: SCHEDULED
[03:34:08.853] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:25:0) after 5m38s
[03:39:46.962] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:25:0)
[03:39:46.981] Build status: SCHEDULED
[03:39:46.981] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:26:0) after 9m23s
[03:49:10.214] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:26:0)
[03:49:10.235] Build status: SCHEDULED
[03:49:10.235] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:27:0) after 1m29s
[03:50:40.447] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:27:0)
[03:50:40.471] Build status: SCHEDULED
[03:50:40.471] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:28:0) after 2m14s
[03:52:54.772] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:28:0)
[03:52:54.796] Build status: SCHEDULED
[03:52:54.796] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:29:0) after 5m32s
[03:58:27.104] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:29:0)
[03:58:27.130] Build status: SCHEDULED
[03:58:27.130] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:30:0) after 9m35s
[04:08:02.184] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:30:0)
[04:08:02.203] Build status: SCHEDULED
[04:08:02.203] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:31:0) after 4m28s
[04:12:30.221] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:31:0)
[04:12:30.265] Build status: SCHEDULED
[04:12:30.265] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:32:0) after 2m24s
[04:14:54.287] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:32:0)
[04:14:54.308] Build status: SCHEDULED
[04:14:54.308] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:33:0) after 7m28s
[04:22:22.322] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:33:0)
[04:22:22.364] Build status: SCHEDULED
[04:22:22.364] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:34:0) after 9m52s
[04:32:14.384] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:34:0)
[04:32:14.402] Build status: SCHEDULED
[04:32:14.402] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:35:0) after 1m0s
[04:33:14.681] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:35:0)
[04:33:14.708] Build status: SCHEDULED
[04:33:14.708] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:36:0) after 6m19s
[04:39:33.728] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:36:0)
[04:39:33.762] Build status: SCHEDULED
[04:39:33.762] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:37:0) after 5m28s
[04:45:01.781] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:37:0)
[04:45:01.803] Build status: SCHEDULED
[04:45:01.803] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:38:0) after 8m58s
[04:53:59.818] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:38:0)
[04:53:59.838] Build status: SCHEDULED
[04:53:59.838] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:39:0) after 5m56s
[04:59:55.864] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:39:0)
[04:59:55.880] Build status: SCHEDULED
[04:59:55.880] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:40:0) after 3m21s
[05:03:16.903] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:40:0)
[05:03:16.926] Build status: SCHEDULED
[05:03:16.926] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:41:0) after 5m8s
[05:08:25.118] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:41:0)
[05:08:25.141] Build status: SCHEDULED
[05:08:25.141] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:42:0) after 2m20s
[05:10:45.159] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:42:0)
[05:10:45.179] Build status: SCHEDULED
[05:10:45.180] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:43:0) after 5m58s
[05:16:43.215] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:43:0)
[05:16:43.244] Build status: SCHEDULED
[05:16:43.244] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:44:0) after 3m32s
[05:20:15.261] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:44:0)
[05:20:15.281] Build status: SCHEDULED
[05:20:15.281] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:45:0) after 9m56s
[05:30:11.311] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:45:0)
[05:30:11.337] Build status: SCHEDULED
[05:30:11.337] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:46:0) after 3m33s
[05:33:44.351] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:46:0)
[05:33:44.370] Build status: SCHEDULED
[05:33:44.370] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:47:0) after 3m56s
[05:37:40.671] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:47:0)
[05:37:40.688] Build status: SCHEDULED
[05:37:40.688] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:48:0) after 2m15s
[05:39:55.897] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:48:0)
[05:39:55.930] Build status: SCHEDULED
[05:39:55.930] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:49:0) after 6m49s
[05:46:44.953] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:49:0)
[05:46:44.980] Build status: SCHEDULED
[05:46:44.980] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:50:0) after 8m39s
[05:55:23.997] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:50:0)
[05:55:24.021] Build status: SCHEDULED
[05:55:24.021] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:51:0) after 1m6s
[05:56:30.037] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:51:0)
[05:56:30.093] Build status: SCHEDULED
[05:56:30.093] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:52:0) after 6m35s
[06:03:05.426] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:52:0)
[06:03:05.452] Build status: SCHEDULED
[06:03:05.452] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:53:0) after 2m30s
[06:05:35.478] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:53:0)
[06:05:35.501] Build status: SCHEDULED
[06:05:35.501] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:54:0) after 7m7s
[06:12:42.524] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:54:0)
[06:12:42.550] Build status: SCHEDULED
[06:12:42.550] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:55:0) after 1m47s
[06:14:29.987] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:55:0)
[06:14:30.025] Build status: SCHEDULED
[06:14:30.025] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:56:0) after 3m12s
[06:17:42.044] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:56:0)
[06:17:42.065] Build status: SCHEDULED
[06:17:42.065] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:57:0) after 4m56s
[06:22:38.086] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:57:0)
[06:22:38.106] Build status: SCHEDULED
[06:22:38.106] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:58:0) after 8m6s
[06:30:44.134] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:58:0)
[06:30:44.191] Build status: SCHEDULED
[06:30:44.191] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:59:0) after 6m9s
[06:36:53.206] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:59:0)
[06:36:53.222] Build status: SCHEDULED
[06:36:53.222] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:60:0) after 4m23s
[06:41:16.343] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:60:0)
[06:41:16.378] Build status: SCHEDULED
[06:41:16.378] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:61:0) after 9m44s
[06:51:00.399] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:61:0)
[06:51:00.418] Build status: SCHEDULED
[06:51:00.419] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:62:0) after 8m39s
[06:59:39.434] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:62:0)
[06:59:39.457] Build status: SCHEDULED
[06:59:39.457] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:63:0) after 3m43s
[07:03:22.523] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:63:0)
[07:03:22.544] Build status: SCHEDULED
[07:03:22.544] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951667447120388144:64:0) after 8m39s
[07:09:17.948] Received PubSub notification, asking Buildbucket for the build status
[07:09:17.978] Build:
{
"id": "8786237385198507969",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60471,
"createdBy": "project:chromium",
"createTime": "2023-03-19T01:08:10.095232785Z",
"endTime": "2023-03-19T07:09:07.469458Z",
"updateTime": "2023-03-19T07:09:07.469458Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "765b445c62ec74c8a3e1e17d91012cfdc3426fc1",
"ref": "refs/heads/main"
}
}
}
[07:09:17.978] Invocation finished in 6h1m9.098426673s with status FAILED