[01:46:06.548] New invocation is queued and will start shortly
[01:46:07.730] Starting the invocation (attempt 1)
[01:46:07.773] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d50c5fb34c7e638f3d43e0faf82660e0aa18f722"
[01:46:07.773] Popped gitiles commit info from properties and tags
[01:46:07.774] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:46:07.774] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:46:07.774] Buildbucket request:
{
"requestId": "8972774152000243312",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d50c5fb34c7e638f3d43e0faf82660e0aa18f722",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8972774152000243312"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:46:08.323] Scheduled build:
{
"id": "8807344089932390049",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 56971,
"createdBy": "project:chromium",
"createTime": "2022-07-29T01:46:07.887552671Z",
"updateTime": "2022-07-29T01:46:07.887552671Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d50c5fb34c7e638f3d43e0faf82660e0aa18f722",
"ref": "refs/heads/main"
}
}
}
[01:46:08.323] Task URL: https://cr-buildbucket.appspot.com/build/8807344089932390049
[01:46:08.323] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:2:0) after 9m2s
[01:55:10.404] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:2:0)
[01:55:10.456] Build status: SCHEDULED
[01:55:10.456] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:3:0) after 1m27s
[01:56:37.482] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:3:0)
[01:56:37.503] Build status: SCHEDULED
[01:56:37.503] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:4:0) after 8m34s
[02:05:11.526] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:4:0)
[02:05:11.544] Build status: SCHEDULED
[02:05:11.544] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:5:0) after 9m45s
[02:14:56.574] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:5:0)
[02:14:56.591] Build status: SCHEDULED
[02:14:56.592] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:6:0) after 2m57s
[02:17:53.612] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:6:0)
[02:17:53.641] Build status: SCHEDULED
[02:17:53.641] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:7:0) after 2m32s
[02:20:25.785] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:7:0)
[02:20:25.805] Build status: SCHEDULED
[02:20:25.805] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:8:0) after 3m47s
[02:24:13.358] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:8:0)
[02:24:13.380] Build status: SCHEDULED
[02:24:13.380] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:9:0) after 3m43s
[02:27:56.475] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:9:0)
[02:27:56.551] Build status: SCHEDULED
[02:27:56.551] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:10:0) after 1m41s
[02:29:37.545] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:10:0)
[02:29:37.574] Build status: SCHEDULED
[02:29:37.574] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:11:0) after 9m55s
[02:39:32.643] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:11:0)
[02:39:32.664] Build status: SCHEDULED
[02:39:32.664] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:12:0) after 4m21s
[02:43:53.998] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:12:0)
[02:43:54.021] Build status: SCHEDULED
[02:43:54.021] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:13:0) after 8m57s
[02:52:51.279] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:13:0)
[02:52:51.312] Build status: SCHEDULED
[02:52:51.312] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:14:0) after 7m39s
[03:00:30.442] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:14:0)
[03:00:30.530] Build status: SCHEDULED
[03:00:30.530] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:15:0) after 5m51s
[03:06:21.602] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:15:0)
[03:06:21.642] Build status: SCHEDULED
[03:06:21.642] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:16:0) after 5m25s
[03:11:46.668] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:16:0)
[03:11:46.692] Build status: SCHEDULED
[03:11:46.692] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:17:0) after 8m11s
[03:19:57.715] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:17:0)
[03:19:57.742] Build status: SCHEDULED
[03:19:57.742] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:18:0) after 9m12s
[03:29:09.775] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:18:0)
[03:29:09.821] Build status: SCHEDULED
[03:29:09.821] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:19:0) after 6m50s
[03:35:59.929] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:19:0)
[03:35:59.954] Build status: SCHEDULED
[03:35:59.954] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:20:0) after 8m29s
[03:44:29.047] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:20:0)
[03:44:29.067] Build status: SCHEDULED
[03:44:29.067] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:21:0) after 4m37s
[03:49:06.194] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:21:0)
[03:49:06.262] Build status: SCHEDULED
[03:49:06.262] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:22:0) after 9m16s
[03:58:22.420] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:22:0)
[03:58:22.443] Build status: SCHEDULED
[03:58:22.443] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:23:0) after 3m4s
[04:01:26.501] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:23:0)
[04:01:26.548] Build status: SCHEDULED
[04:01:26.548] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:24:0) after 6m30s
[04:07:56.701] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:24:0)
[04:07:56.727] Build status: SCHEDULED
[04:07:56.727] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:25:0) after 6m31s
[04:14:27.862] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:25:0)
[04:14:27.883] Build status: SCHEDULED
[04:14:27.883] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:26:0) after 2m56s
[04:17:24.121] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:26:0)
[04:17:24.150] Build status: SCHEDULED
[04:17:24.150] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:27:0) after 7m30s
[04:24:54.236] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:27:0)
[04:24:54.254] Build status: SCHEDULED
[04:24:54.254] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:28:0) after 3m9s
[04:28:03.502] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:28:0)
[04:28:03.539] Build status: SCHEDULED
[04:28:03.539] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:29:0) after 4m59s
[04:33:02.691] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:29:0)
[04:33:02.711] Build status: SCHEDULED
[04:33:02.711] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:30:0) after 8m56s
[04:41:58.745] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:30:0)
[04:41:58.766] Build status: SCHEDULED
[04:41:58.766] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:31:0) after 2m35s
[04:44:33.798] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:31:0)
[04:44:33.817] Build status: SCHEDULED
[04:44:33.817] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:32:0) after 1m53s
[04:46:27.173] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:32:0)
[04:46:27.194] Build status: SCHEDULED
[04:46:27.194] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:33:0) after 2m53s
[04:49:20.313] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:33:0)
[04:49:20.332] Build status: SCHEDULED
[04:49:20.332] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:34:0) after 7m29s
[04:56:49.364] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:34:0)
[04:56:49.384] Build status: SCHEDULED
[04:56:49.384] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:35:0) after 9m36s
[05:06:25.449] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:35:0)
[05:06:25.467] Build status: SCHEDULED
[05:06:25.467] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:36:0) after 3m20s
[05:09:45.501] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:36:0)
[05:09:45.532] Build status: SCHEDULED
[05:09:45.532] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:37:0) after 6m35s
[05:16:20.562] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:37:0)
[05:16:20.581] Build status: SCHEDULED
[05:16:20.581] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:38:0) after 3m39s
[05:19:59.629] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:38:0)
[05:19:59.650] Build status: SCHEDULED
[05:19:59.650] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:39:0) after 7m34s
[05:27:33.816] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:39:0)
[05:27:33.929] Build status: SCHEDULED
[05:27:33.929] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:40:0) after 8m22s
[05:35:56.305] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:40:0)
[05:35:56.334] Build status: SCHEDULED
[05:35:56.335] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:41:0) after 1m4s
[05:37:00.488] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:41:0)
[05:37:00.510] Build status: SCHEDULED
[05:37:00.510] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:42:0) after 6m8s
[05:43:08.695] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:42:0)
[05:43:08.730] Build status: SCHEDULED
[05:43:08.730] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:43:0) after 3m36s
[05:46:45.013] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:43:0)
[05:46:45.037] Build status: SCHEDULED
[05:46:45.037] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:44:0) after 3m44s
[05:50:29.064] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:44:0)
[05:50:29.229] Build status: SCHEDULED
[05:50:29.229] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:45:0) after 3m52s
[05:54:21.291] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:45:0)
[05:54:21.310] Build status: SCHEDULED
[05:54:21.310] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:46:0) after 3m45s
[05:58:06.486] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:46:0)
[05:58:06.505] Build status: SCHEDULED
[05:58:06.505] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:47:0) after 4m7s
[06:02:13.582] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:47:0)
[06:02:13.625] Build status: SCHEDULED
[06:02:13.625] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:48:0) after 2m47s
[06:05:00.654] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:48:0)
[06:05:00.715] Build status: SCHEDULED
[06:05:00.715] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:49:0) after 7m30s
[06:12:30.761] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:49:0)
[06:12:30.789] Build status: SCHEDULED
[06:12:30.789] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:50:0) after 8m1s
[06:20:31.823] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:50:0)
[06:20:31.844] Build status: SCHEDULED
[06:20:31.844] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:51:0) after 8m43s
[06:29:14.885] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:51:0)
[06:29:14.904] Build status: SCHEDULED
[06:29:14.904] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:52:0) after 5m37s
[06:34:51.929] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:52:0)
[06:34:51.955] Build status: SCHEDULED
[06:34:51.955] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:53:0) after 9m41s
[06:44:32.982] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:53:0)
[06:44:32.999] Build status: SCHEDULED
[06:44:32.999] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:54:0) after 6m54s
[06:51:27.118] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:54:0)
[06:51:27.136] Build status: SCHEDULED
[06:51:27.137] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:55:0) after 4m54s
[06:56:21.161] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:55:0)
[06:56:21.184] Build status: SCHEDULED
[06:56:21.184] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:56:0) after 9m40s
[07:06:01.243] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:56:0)
[07:06:01.266] Build status: SCHEDULED
[07:06:01.266] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:57:0) after 2m24s
[07:08:25.333] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:57:0)
[07:08:25.351] Build status: SCHEDULED
[07:08:25.351] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:58:0) after 9m42s
[07:18:07.378] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:58:0)
[07:18:07.398] Build status: SCHEDULED
[07:18:07.398] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:59:0) after 2m49s
[07:20:56.714] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:59:0)
[07:20:56.734] Build status: SCHEDULED
[07:20:56.734] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:60:0) after 7m40s
[07:28:36.877] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:60:0)
[07:28:36.896] Build status: SCHEDULED
[07:28:36.897] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:61:0) after 7m31s
[07:36:08.066] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:61:0)
[07:36:08.087] Build status: SCHEDULED
[07:36:08.087] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:62:0) after 5m17s
[07:41:25.266] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:62:0)
[07:41:25.298] Build status: SCHEDULED
[07:41:25.298] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972774152000243312:63:0) after 5m44s
[07:47:04.776] Received PubSub notification, asking Buildbucket for the build status
[07:47:04.826] Build:
{
"id": "8807344089932390049",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 56971,
"createdBy": "project:chromium",
"createTime": "2022-07-29T01:46:07.887552671Z",
"endTime": "2022-07-29T07:47:04.193667Z",
"updateTime": "2022-07-29T07:47:04.567871Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d50c5fb34c7e638f3d43e0faf82660e0aa18f722",
"ref": "refs/heads/main"
}
}
}
[07:47:04.826] Invocation finished in 6h0m58.295258657s with status FAILED