[19:59:18.908] New invocation is queued and will start shortly
[19:59:20.231] Starting the invocation (attempt 1)
[19:59:20.272] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/8963eb07ee45b04d91e15f3a90e825e5c83b082f"
[19:59:20.272] Popped gitiles commit info from properties and tags
[19:59:20.272] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:59:20.273] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:59:20.273] Buildbucket request:
{
"requestId": "8950509116646272160",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8963eb07ee45b04d91e15f3a90e825e5c83b082f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8950509116646272160"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:59:20.700] Scheduled build:
{
"id": "8785079054472766113",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60522,
"createdBy": "project:chromium",
"createTime": "2023-03-31T19:59:20.358853671Z",
"updateTime": "2023-03-31T19:59:20.358853671Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8963eb07ee45b04d91e15f3a90e825e5c83b082f",
"ref": "refs/heads/main"
}
}
}
[19:59:20.700] Task URL: https://cr-buildbucket.appspot.com/build/8785079054472766113
[19:59:20.700] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:2:0) after 9m41s
[20:09:01.948] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:2:0)
[20:09:01.983] Build status: SCHEDULED
[20:09:01.983] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:3:0) after 4m0s
[20:13:02.026] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:3:0)
[20:13:02.055] Build status: SCHEDULED
[20:13:02.055] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:4:0) after 6m9s
[20:19:11.299] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:4:0)
[20:19:11.346] Build status: SCHEDULED
[20:19:11.346] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:5:0) after 4m19s
[20:23:30.468] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:5:0)
[20:23:30.494] Build status: SCHEDULED
[20:23:30.494] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:6:0) after 9m52s
[20:33:22.771] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:6:0)
[20:33:22.803] Build status: SCHEDULED
[20:33:22.804] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:7:0) after 9m30s
[20:42:52.891] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:7:0)
[20:42:52.941] Build status: SCHEDULED
[20:42:52.941] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:8:0) after 9m14s
[20:52:07.140] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:8:0)
[20:52:07.175] Build status: SCHEDULED
[20:52:07.175] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:9:0) after 4m53s
[20:57:00.902] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:9:0)
[20:57:00.954] Build status: SCHEDULED
[20:57:00.954] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:10:0) after 9m21s
[21:06:21.978] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:10:0)
[21:06:21.998] Build status: SCHEDULED
[21:06:21.999] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:11:0) after 8m47s
[21:15:09.043] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:11:0)
[21:15:09.066] Build status: SCHEDULED
[21:15:09.066] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:12:0) after 9m29s
[21:24:38.432] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:12:0)
[21:24:38.466] Build status: SCHEDULED
[21:24:38.466] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:13:0) after 1m22s
[21:26:00.494] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:13:0)
[21:26:00.542] Build status: SCHEDULED
[21:26:00.542] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:14:0) after 3m51s
[21:29:51.569] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:14:0)
[21:29:51.589] Build status: SCHEDULED
[21:29:51.589] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:15:0) after 3m15s
[21:33:06.675] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:15:0)
[21:33:06.741] Build status: SCHEDULED
[21:33:06.741] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:16:0) after 4m36s
[21:37:42.754] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:16:0)
[21:37:42.778] Build status: SCHEDULED
[21:37:42.779] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:17:0) after 2m48s
[21:40:30.954] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:17:0)
[21:40:30.979] Build status: SCHEDULED
[21:40:30.979] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:18:0) after 6m45s
[21:47:16.353] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:18:0)
[21:47:16.375] Build status: SCHEDULED
[21:47:16.375] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:19:0) after 6m13s
[21:53:29.458] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:19:0)
[21:53:29.478] Build status: SCHEDULED
[21:53:29.478] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:20:0) after 7m27s
[22:00:56.629] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:20:0)
[22:00:56.659] Build status: SCHEDULED
[22:00:56.659] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:21:0) after 5m21s
[22:06:17.777] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:21:0)
[22:06:17.832] Build status: SCHEDULED
[22:06:17.832] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:22:0) after 7m36s
[22:13:53.955] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:22:0)
[22:13:53.981] Build status: SCHEDULED
[22:13:53.981] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:23:0) after 4m18s
[22:18:12.337] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:23:0)
[22:18:12.412] Build status: SCHEDULED
[22:18:12.412] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:24:0) after 3m8s
[22:21:20.868] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:24:0)
[22:21:20.891] Build status: SCHEDULED
[22:21:20.891] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:25:0) after 4m24s
[22:25:44.911] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:25:0)
[22:25:44.933] Build status: SCHEDULED
[22:25:44.933] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:26:0) after 4m14s
[22:29:58.957] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:26:0)
[22:29:58.981] Build status: SCHEDULED
[22:29:58.981] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:27:0) after 7m53s
[22:37:52.396] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:27:0)
[22:37:52.584] Build status: SCHEDULED
[22:37:52.584] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:28:0) after 8m48s
[22:46:40.852] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:28:0)
[22:46:40.875] Build status: SCHEDULED
[22:46:40.875] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:29:0) after 3m56s
[22:50:37.124] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:29:0)
[22:50:37.151] Build status: SCHEDULED
[22:50:37.151] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:30:0) after 8m41s
[22:59:18.255] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:30:0)
[22:59:18.279] Build status: SCHEDULED
[22:59:18.279] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:31:0) after 9m51s
[23:09:09.357] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:31:0)
[23:09:09.380] Build status: SCHEDULED
[23:09:09.380] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:32:0) after 4m53s
[23:14:02.557] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:32:0)
[23:14:02.585] Build status: SCHEDULED
[23:14:02.585] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:33:0) after 2m25s
[23:16:27.815] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:33:0)
[23:16:27.836] Build status: SCHEDULED
[23:16:27.836] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:34:0) after 9m56s
[23:26:23.862] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:34:0)
[23:26:23.880] Build status: SCHEDULED
[23:26:23.880] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:35:0) after 6m15s
[23:32:38.927] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:35:0)
[23:32:38.946] Build status: SCHEDULED
[23:32:38.946] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:36:0) after 1m12s
[23:33:50.972] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:36:0)
[23:33:50.994] Build status: SCHEDULED
[23:33:50.994] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:37:0) after 7m19s
[23:41:10.022] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:37:0)
[23:41:10.088] Build status: SCHEDULED
[23:41:10.088] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:38:0) after 9m10s
[23:50:20.113] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:38:0)
[23:50:20.145] Build status: SCHEDULED
[23:50:20.145] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:39:0) after 5m52s
[23:56:12.170] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:39:0)
[23:56:12.192] Build status: SCHEDULED
[23:56:12.192] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:40:0) after 5m32s
[00:01:44.225] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:40:0)
[00:01:44.251] Build status: SCHEDULED
[00:01:44.251] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:41:0) after 5m36s
[00:07:20.276] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:41:0)
[00:07:20.333] Build status: SCHEDULED
[00:07:20.333] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:42:0) after 1m42s
[00:09:02.615] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:42:0)
[00:09:02.637] Build status: SCHEDULED
[00:09:02.637] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:43:0) after 5m13s
[00:14:15.768] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:43:0)
[00:14:15.787] Build status: SCHEDULED
[00:14:15.787] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:44:0) after 6m8s
[00:20:24.053] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:44:0)
[00:20:24.082] Build status: SCHEDULED
[00:20:24.082] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:45:0) after 5m31s
[00:25:55.108] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:45:0)
[00:25:55.128] Build status: SCHEDULED
[00:25:55.129] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:46:0) after 1m15s
[00:27:10.165] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:46:0)
[00:27:10.189] Build status: SCHEDULED
[00:27:10.189] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:47:0) after 4m4s
[00:31:14.398] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:47:0)
[00:31:14.455] Build status: SCHEDULED
[00:31:14.455] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:48:0) after 1m5s
[00:32:19.836] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:48:0)
[00:32:19.857] Build status: SCHEDULED
[00:32:19.857] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:49:0) after 7m53s
[00:40:12.904] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:49:0)
[00:40:12.931] Build status: SCHEDULED
[00:40:12.931] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:50:0) after 5m19s
[00:45:32.986] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:50:0)
[00:45:33.042] Build status: SCHEDULED
[00:45:33.043] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:51:0) after 5m6s
[00:50:39.220] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:51:0)
[00:50:39.243] Build status: SCHEDULED
[00:50:39.243] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:52:0) after 4m42s
[00:55:21.405] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:52:0)
[00:55:21.429] Build status: SCHEDULED
[00:55:21.429] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:53:0) after 6m12s
[01:01:33.454] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:53:0)
[01:01:33.475] Build status: SCHEDULED
[01:01:33.475] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:54:0) after 8m10s
[01:09:43.603] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:54:0)
[01:09:43.633] Build status: SCHEDULED
[01:09:43.633] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:55:0) after 4m36s
[01:14:19.671] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:55:0)
[01:14:19.691] Build status: SCHEDULED
[01:14:19.691] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:56:0) after 6m55s
[01:21:14.806] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:56:0)
[01:21:14.834] Build status: SCHEDULED
[01:21:14.834] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:57:0) after 3m23s
[01:24:38.122] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:57:0)
[01:24:38.154] Build status: SCHEDULED
[01:24:38.154] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:58:0) after 5m42s
[01:30:20.195] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:58:0)
[01:30:20.215] Build status: SCHEDULED
[01:30:20.215] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:59:0) after 9m37s
[01:39:57.536] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:59:0)
[01:39:57.575] Build status: SCHEDULED
[01:39:57.575] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:60:0) after 3m43s
[01:43:40.608] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:60:0)
[01:43:40.631] Build status: SCHEDULED
[01:43:40.631] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:61:0) after 2m4s
[01:45:44.662] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:61:0)
[01:45:44.689] Build status: SCHEDULED
[01:45:44.689] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:62:0) after 8m37s
[01:54:21.797] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:62:0)
[01:54:21.818] Build status: SCHEDULED
[01:54:21.818] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950509116646272160:63:0) after 9m21s
[02:00:13.854] Received PubSub notification, asking Buildbucket for the build status
[02:00:13.895] Build:
{
"id": "8785079054472766113",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60522,
"createdBy": "project:chromium",
"createTime": "2023-03-31T19:59:20.358853671Z",
"endTime": "2023-04-01T02:00:12.597750Z",
"updateTime": "2023-04-01T02:00:12.597750Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8963eb07ee45b04d91e15f3a90e825e5c83b082f",
"ref": "refs/heads/main"
}
}
}
[02:00:13.895] Invocation finished in 6h0m54.993595557s with status FAILED