[03:24:07.518] New invocation is queued and will start shortly
[03:24:08.671] Starting the invocation (attempt 1)
[03:24:08.701] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/32e5048a9775bd01f217217bd8281bc342c62264"
[03:24:08.701] Popped gitiles commit info from properties and tags
[03:24:08.701] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:24:08.701] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:24:08.701] Buildbucket request:
{
"requestId": "8949937549858668896",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "32e5048a9775bd01f217217bd8281bc342c62264",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8949937549858668896"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:24:09.168] Scheduled build:
{
"id": "8784507487847985089",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60547,
"createdBy": "project:chromium",
"createTime": "2023-04-07T03:24:08.768533838Z",
"updateTime": "2023-04-07T03:24:08.768533838Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "32e5048a9775bd01f217217bd8281bc342c62264",
"ref": "refs/heads/main"
}
}
}
[03:24:09.168] Task URL: https://cr-buildbucket.appspot.com/build/8784507487847985089
[03:24:09.168] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:2:0) after 6m51s
[03:31:00.445] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:2:0)
[03:31:00.468] Build status: SCHEDULED
[03:31:00.468] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:3:0) after 8m33s
[03:39:33.464] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:3:0)
[03:39:33.557] Build status: SCHEDULED
[03:39:33.558] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:4:0) after 1m36s
[03:41:09.791] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:4:0)
[03:41:09.856] Build status: SCHEDULED
[03:41:09.856] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:5:0) after 5m17s
[03:46:26.930] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:5:0)
[03:46:26.948] Build status: SCHEDULED
[03:46:26.948] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:6:0) after 3m38s
[03:50:05.014] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:6:0)
[03:50:05.083] Build status: SCHEDULED
[03:50:05.083] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:7:0) after 4m49s
[03:54:54.089] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:7:0)
[03:54:54.159] Build status: SCHEDULED
[03:54:54.159] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:8:0) after 6m20s
[04:01:14.186] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:8:0)
[04:01:14.206] Build status: SCHEDULED
[04:01:14.206] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:9:0) after 8m52s
[04:10:06.411] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:9:0)
[04:10:06.435] Build status: SCHEDULED
[04:10:06.436] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:10:0) after 2m55s
[04:13:01.463] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:10:0)
[04:13:01.488] Build status: SCHEDULED
[04:13:01.488] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:11:0) after 7m54s
[04:20:55.548] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:11:0)
[04:20:55.710] Build status: SCHEDULED
[04:20:55.711] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:12:0) after 2m58s
[04:23:53.943] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:12:0)
[04:23:54.129] Build status: SCHEDULED
[04:23:54.129] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:13:0) after 4m42s
[04:28:36.149] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:13:0)
[04:28:36.170] Build status: SCHEDULED
[04:28:36.170] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:14:0) after 9m49s
[04:38:25.259] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:14:0)
[04:38:25.279] Build status: SCHEDULED
[04:38:25.279] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:15:0) after 8m56s
[04:47:21.284] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:15:0)
[04:47:21.318] Build status: SCHEDULED
[04:47:21.318] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:16:0) after 3m30s
[04:50:51.438] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:16:0)
[04:50:51.549] Build status: SCHEDULED
[04:50:51.549] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:17:0) after 8m53s
[04:59:44.606] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:17:0)
[04:59:44.631] Build status: SCHEDULED
[04:59:44.631] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:18:0) after 2m31s
[05:02:15.940] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:18:0)
[05:02:15.964] Build status: SCHEDULED
[05:02:15.964] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:19:0) after 9m53s
[05:12:08.989] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:19:0)
[05:12:09.011] Build status: SCHEDULED
[05:12:09.011] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:20:0) after 8m50s
[05:20:59.039] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:20:0)
[05:20:59.059] Build status: SCHEDULED
[05:20:59.059] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:21:0) after 5m18s
[05:26:17.228] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:21:0)
[05:26:17.249] Build status: SCHEDULED
[05:26:17.249] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:22:0) after 9m44s
[05:36:01.273] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:22:0)
[05:36:01.295] Build status: SCHEDULED
[05:36:01.295] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:23:0) after 9m28s
[05:45:29.316] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:23:0)
[05:45:29.401] Build status: SCHEDULED
[05:45:29.401] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:24:0) after 6m15s
[05:51:44.421] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:24:0)
[05:51:44.444] Build status: SCHEDULED
[05:51:44.444] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:25:0) after 3m44s
[05:55:28.470] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:25:0)
[05:55:28.492] Build status: SCHEDULED
[05:55:28.492] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:26:0) after 5m24s
[06:00:52.562] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:26:0)
[06:00:52.584] Build status: SCHEDULED
[06:00:52.584] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:27:0) after 8m7s
[06:08:59.605] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:27:0)
[06:08:59.789] Build status: SCHEDULED
[06:08:59.789] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:28:0) after 3m54s
[06:12:53.811] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:28:0)
[06:12:53.839] Build status: SCHEDULED
[06:12:53.839] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:29:0) after 8m17s
[06:21:10.920] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:29:0)
[06:21:10.944] Build status: SCHEDULED
[06:21:10.944] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:30:0) after 2m9s
[06:23:19.964] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:30:0)
[06:23:19.988] Build status: SCHEDULED
[06:23:19.988] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:31:0) after 5m47s
[06:29:06.993] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:31:0)
[06:29:07.014] Build status: SCHEDULED
[06:29:07.014] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:32:0) after 3m19s
[06:32:26.255] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:32:0)
[06:32:26.280] Build status: SCHEDULED
[06:32:26.280] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:33:0) after 4m26s
[06:36:52.382] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:33:0)
[06:36:52.453] Build status: SCHEDULED
[06:36:52.453] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:34:0) after 8m20s
[06:45:12.593] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:34:0)
[06:45:12.625] Build status: SCHEDULED
[06:45:12.625] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:35:0) after 8m4s
[06:53:16.643] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:35:0)
[06:53:16.662] Build status: SCHEDULED
[06:53:16.663] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:36:0) after 4m19s
[06:57:35.886] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:36:0)
[06:57:35.938] Build status: SCHEDULED
[06:57:35.938] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:37:0) after 5m35s
[07:03:11.686] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:37:0)
[07:03:11.710] Build status: SCHEDULED
[07:03:11.710] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:38:0) after 6m37s
[07:09:48.802] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:38:0)
[07:09:48.830] Build status: SCHEDULED
[07:09:48.830] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:39:0) after 9m22s
[07:19:10.867] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:39:0)
[07:19:10.896] Build status: SCHEDULED
[07:19:10.896] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:40:0) after 2m17s
[07:21:28.263] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:40:0)
[07:21:28.285] Build status: SCHEDULED
[07:21:28.285] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:41:0) after 6m0s
[07:27:28.311] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:41:0)
[07:27:28.332] Build status: SCHEDULED
[07:27:28.332] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:42:0) after 6m21s
[07:33:49.647] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:42:0)
[07:33:49.672] Build status: SCHEDULED
[07:33:49.672] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:43:0) after 6m43s
[07:40:32.776] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:43:0)
[07:40:32.800] Build status: SCHEDULED
[07:40:32.800] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:44:0) after 3m36s
[07:44:08.823] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:44:0)
[07:44:08.851] Build status: SCHEDULED
[07:44:08.852] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:45:0) after 2m17s
[07:46:25.947] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:45:0)
[07:46:25.967] Build status: SCHEDULED
[07:46:25.967] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:46:0) after 7m45s
[07:54:10.997] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:46:0)
[07:54:11.016] Build status: SCHEDULED
[07:54:11.016] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:47:0) after 6m7s
[08:00:18.180] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:47:0)
[08:00:18.222] Build status: SCHEDULED
[08:00:18.222] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:48:0) after 3m6s
[08:03:24.263] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:48:0)
[08:03:24.293] Build status: SCHEDULED
[08:03:24.293] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:49:0) after 3m32s
[08:06:56.365] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:49:0)
[08:06:56.385] Build status: SCHEDULED
[08:06:56.385] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:50:0) after 5m11s
[08:12:07.415] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:50:0)
[08:12:07.435] Build status: SCHEDULED
[08:12:07.435] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:51:0) after 8m56s
[08:21:03.453] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:51:0)
[08:21:03.471] Build status: SCHEDULED
[08:21:03.471] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:52:0) after 5m9s
[08:26:12.586] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:52:0)
[08:26:12.619] Build status: SCHEDULED
[08:26:12.619] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:53:0) after 5m38s
[08:31:50.765] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:53:0)
[08:31:50.795] Build status: SCHEDULED
[08:31:50.795] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:54:0) after 2m15s
[08:34:05.821] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:54:0)
[08:34:05.897] Build status: SCHEDULED
[08:34:05.897] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:55:0) after 5m36s
[08:39:41.918] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:55:0)
[08:39:41.936] Build status: SCHEDULED
[08:39:41.936] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:56:0) after 5m54s
[08:45:36.004] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:56:0)
[08:45:36.024] Build status: SCHEDULED
[08:45:36.024] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:57:0) after 9m14s
[08:54:50.060] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:57:0)
[08:54:50.082] Build status: SCHEDULED
[08:54:50.082] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:58:0) after 2m17s
[08:57:07.113] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:58:0)
[08:57:07.132] Build status: SCHEDULED
[08:57:07.132] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:59:0) after 3m31s
[09:00:38.221] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:59:0)
[09:00:38.241] Build status: SCHEDULED
[09:00:38.241] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:60:0) after 5m16s
[09:05:54.428] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:60:0)
[09:05:54.455] Build status: SCHEDULED
[09:05:54.455] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:61:0) after 5m24s
[09:11:18.733] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:61:0)
[09:11:18.792] Build status: SCHEDULED
[09:11:18.792] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:62:0) after 7m34s
[09:18:52.817] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:62:0)
[09:18:52.973] Build status: SCHEDULED
[09:18:52.973] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949937549858668896:63:0) after 6m37s
[09:25:08.008] Received PubSub notification, asking Buildbucket for the build status
[09:25:08.030] Build:
{
"id": "8784507487847985089",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60547,
"createdBy": "project:chromium",
"createTime": "2023-04-07T03:24:08.768533838Z",
"endTime": "2023-04-07T09:25:07.432366Z",
"updateTime": "2023-04-07T09:25:07.432366Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "32e5048a9775bd01f217217bd8281bc342c62264",
"ref": "refs/heads/main"
}
}
}
[09:25:08.030] Invocation finished in 6h1m0.562851949s with status FAILED