[03:18:04.673] New invocation is queued and will start shortly
[03:18:06.092] Starting the invocation (attempt 1)
[03:18:06.122] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a8c33d336a64097702d1a27662e7e4a71b809654"
[03:18:06.122] Popped gitiles commit info from properties and tags
[03:18:06.122] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:18:06.122] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:18:06.122] Buildbucket request:
{
"requestId": "8970684635588489744",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a8c33d336a64097702d1a27662e7e4a71b809654",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8970684635588489744"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:18:06.740] Scheduled build:
{
"id": "8805254573364828449",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 57063,
"createdBy": "project:chromium",
"createTime": "2022-08-21T03:18:06.171675347Z",
"updateTime": "2022-08-21T03:18:06.171675347Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a8c33d336a64097702d1a27662e7e4a71b809654",
"ref": "refs/heads/main"
}
}
}
[03:18:06.740] Task URL: https://cr-buildbucket.appspot.com/build/8805254573364828449
[03:18:06.740] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:2:0) after 3m39s
[03:21:45.789] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:2:0)
[03:21:45.809] Build status: SCHEDULED
[03:21:45.809] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:3:0) after 9m25s
[03:31:10.825] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:3:0)
[03:31:10.855] Build status: SCHEDULED
[03:31:10.855] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:4:0) after 6m47s
[03:37:57.973] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:4:0)
[03:37:58.056] Build status: SCHEDULED
[03:37:58.056] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:5:0) after 8m37s
[03:46:35.190] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:5:0)
[03:46:35.215] Build status: SCHEDULED
[03:46:35.215] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:6:0) after 2m34s
[03:49:09.655] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:6:0)
[03:49:09.678] Build status: SCHEDULED
[03:49:09.678] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:7:0) after 4m39s
[03:53:48.711] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:7:0)
[03:53:48.735] Build status: SCHEDULED
[03:53:48.735] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:8:0) after 3m48s
[03:57:36.751] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:8:0)
[03:57:36.776] Build status: SCHEDULED
[03:57:36.776] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:9:0) after 7m37s
[04:05:13.798] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:9:0)
[04:05:13.820] Build status: SCHEDULED
[04:05:13.820] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:10:0) after 3m3s
[04:08:16.835] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:10:0)
[04:08:16.862] Build status: SCHEDULED
[04:08:16.862] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:11:0) after 1m21s
[04:09:37.901] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:11:0)
[04:09:38.012] Build status: SCHEDULED
[04:09:38.012] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:12:0) after 5m17s
[04:14:55.269] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:12:0)
[04:14:55.289] Build status: SCHEDULED
[04:14:55.289] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:13:0) after 3m2s
[04:17:57.307] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:13:0)
[04:17:57.328] Build status: SCHEDULED
[04:17:57.328] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:14:0) after 3m50s
[04:21:47.353] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:14:0)
[04:21:47.377] Build status: SCHEDULED
[04:21:47.377] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:15:0) after 3m13s
[04:25:00.493] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:15:0)
[04:25:00.515] Build status: SCHEDULED
[04:25:00.515] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:16:0) after 8m49s
[04:33:49.533] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:16:0)
[04:33:49.566] Build status: SCHEDULED
[04:33:49.566] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:17:0) after 7m2s
[04:40:51.643] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:17:0)
[04:40:51.662] Build status: SCHEDULED
[04:40:51.662] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:18:0) after 7m37s
[04:48:28.682] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:18:0)
[04:48:28.704] Build status: SCHEDULED
[04:48:28.704] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:19:0) after 5m59s
[04:54:27.720] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:19:0)
[04:54:27.742] Build status: SCHEDULED
[04:54:27.742] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:20:0) after 4m20s
[04:58:47.768] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:20:0)
[04:58:47.789] Build status: SCHEDULED
[04:58:47.789] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:21:0) after 3m0s
[05:01:47.903] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:21:0)
[05:01:47.920] Build status: SCHEDULED
[05:01:47.920] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:22:0) after 5m36s
[05:07:24.027] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:22:0)
[05:07:24.048] Build status: SCHEDULED
[05:07:24.048] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:23:0) after 5m25s
[05:12:49.124] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:23:0)
[05:12:49.145] Build status: SCHEDULED
[05:12:49.145] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:24:0) after 9m35s
[05:22:24.161] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:24:0)
[05:22:24.182] Build status: SCHEDULED
[05:22:24.182] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:25:0) after 9m56s
[05:32:20.541] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:25:0)
[05:32:20.563] Build status: SCHEDULED
[05:32:20.563] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:26:0) after 9m22s
[05:41:42.574] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:26:0)
[05:41:42.597] Build status: SCHEDULED
[05:41:42.597] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:27:0) after 8m53s
[05:50:35.648] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:27:0)
[05:50:35.667] Build status: SCHEDULED
[05:50:35.667] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:28:0) after 7m26s
[05:58:01.691] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:28:0)
[05:58:01.718] Build status: SCHEDULED
[05:58:01.718] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:29:0) after 2m55s
[06:00:56.743] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:29:0)
[06:00:56.764] Build status: SCHEDULED
[06:00:56.764] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:30:0) after 9m39s
[06:10:35.749] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:30:0)
[06:10:35.782] Build status: SCHEDULED
[06:10:35.782] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:31:0) after 5m56s
[06:16:31.801] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:31:0)
[06:16:31.824] Build status: SCHEDULED
[06:16:31.824] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:32:0) after 9m27s
[06:25:58.843] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:32:0)
[06:25:58.863] Build status: SCHEDULED
[06:25:58.863] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:33:0) after 6m6s
[06:32:04.890] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:33:0)
[06:32:04.916] Build status: SCHEDULED
[06:32:04.916] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:34:0) after 1m31s
[06:33:36.035] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:34:0)
[06:33:36.060] Build status: SCHEDULED
[06:33:36.060] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:35:0) after 8m39s
[06:42:15.082] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:35:0)
[06:42:15.114] Build status: SCHEDULED
[06:42:15.114] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:36:0) after 1m8s
[06:43:23.333] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:36:0)
[06:43:23.354] Build status: SCHEDULED
[06:43:23.354] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:37:0) after 4m50s
[06:48:13.348] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:37:0)
[06:48:13.376] Build status: SCHEDULED
[06:48:13.376] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:38:0) after 9m25s
[06:57:38.398] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:38:0)
[06:57:38.430] Build status: SCHEDULED
[06:57:38.430] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:39:0) after 7m43s
[07:05:21.548] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:39:0)
[07:05:21.593] Build status: SCHEDULED
[07:05:21.593] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:40:0) after 7m44s
[07:13:05.734] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:40:0)
[07:13:05.756] Build status: SCHEDULED
[07:13:05.756] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:41:0) after 1m41s
[07:14:46.780] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:41:0)
[07:14:46.800] Build status: SCHEDULED
[07:14:46.800] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:42:0) after 5m54s
[07:20:40.866] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:42:0)
[07:20:40.893] Build status: SCHEDULED
[07:20:40.893] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:43:0) after 8m40s
[07:29:20.909] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:43:0)
[07:29:20.956] Build status: SCHEDULED
[07:29:20.956] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:44:0) after 1m11s
[07:30:32.050] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:44:0)
[07:30:32.079] Build status: SCHEDULED
[07:30:32.079] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:45:0) after 1m41s
[07:32:13.113] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:45:0)
[07:32:13.135] Build status: SCHEDULED
[07:32:13.135] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:46:0) after 4m31s
[07:36:44.182] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:46:0)
[07:36:44.206] Build status: SCHEDULED
[07:36:44.206] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:47:0) after 8m16s
[07:45:00.223] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:47:0)
[07:45:00.247] Build status: SCHEDULED
[07:45:00.248] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:48:0) after 7m45s
[07:52:45.272] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:48:0)
[07:52:45.290] Build status: SCHEDULED
[07:52:45.290] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:49:0) after 7m59s
[08:00:44.308] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:49:0)
[08:00:44.329] Build status: SCHEDULED
[08:00:44.329] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:50:0) after 3m14s
[08:03:58.466] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:50:0)
[08:03:58.486] Build status: SCHEDULED
[08:03:58.486] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:51:0) after 3m30s
[08:07:28.512] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:51:0)
[08:07:28.535] Build status: SCHEDULED
[08:07:28.535] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:52:0) after 8m55s
[08:16:23.561] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:52:0)
[08:16:23.587] Build status: SCHEDULED
[08:16:23.587] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:53:0) after 8m48s
[08:25:11.674] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:53:0)
[08:25:11.702] Build status: SCHEDULED
[08:25:11.702] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:54:0) after 1m41s
[08:26:52.720] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:54:0)
[08:26:52.745] Build status: SCHEDULED
[08:26:52.745] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:55:0) after 2m1s
[08:28:53.866] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:55:0)
[08:28:53.888] Build status: SCHEDULED
[08:28:53.888] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:56:0) after 2m30s
[08:31:23.919] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:56:0)
[08:31:23.939] Build status: SCHEDULED
[08:31:23.939] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:57:0) after 5m47s
[08:37:10.964] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:57:0)
[08:37:10.989] Build status: SCHEDULED
[08:37:10.989] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:58:0) after 4m37s
[08:41:48.007] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:58:0)
[08:41:48.029] Build status: SCHEDULED
[08:41:48.029] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:59:0) after 6m56s
[08:48:44.049] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:59:0)
[08:48:44.071] Build status: SCHEDULED
[08:48:44.071] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:60:0) after 4m46s
[08:53:30.090] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:60:0)
[08:53:30.113] Build status: SCHEDULED
[08:53:30.113] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:61:0) after 1m38s
[08:55:08.230] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:61:0)
[08:55:08.303] Build status: SCHEDULED
[08:55:08.303] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:62:0) after 6m52s
[09:02:00.320] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:62:0)
[09:02:00.401] Build status: SCHEDULED
[09:02:00.401] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:63:0) after 5m33s
[09:07:33.421] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:63:0)
[09:07:33.445] Build status: SCHEDULED
[09:07:33.445] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:64:0) after 5m41s
[09:13:14.468] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:64:0)
[09:13:14.491] Build status: SCHEDULED
[09:13:14.491] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:65:0) after 3m1s
[09:16:15.525] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:65:0)
[09:16:15.552] Build status: SCHEDULED
[09:16:15.552] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8970684635588489744:66:0) after 6m14s
[09:19:05.946] Received PubSub notification, asking Buildbucket for the build status
[09:19:05.978] Build:
{
"id": "8805254573364828449",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 57063,
"createdBy": "project:chromium",
"createTime": "2022-08-21T03:18:06.171675347Z",
"endTime": "2022-08-21T09:19:05.326855Z",
"updateTime": "2022-08-21T09:19:05.718007Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a8c33d336a64097702d1a27662e7e4a71b809654",
"ref": "refs/heads/main"
}
}
}
[09:19:05.978] Invocation finished in 6h1m1.3112515s with status FAILED