[11:49:10.283] New invocation is queued and will start shortly
[11:49:11.522] Starting the invocation (attempt 1)
[11:49:11.556] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f86f76f49f4ad70faa88a17368034313753eb3f7"
[11:49:11.556] Popped gitiles commit info from properties and tags
[11:49:11.556] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[11:49:11.556] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[11:49:11.556] Buildbucket request:
{
"requestId": "8946553687309733824",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f86f76f49f4ad70faa88a17368034313753eb3f7",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8946553687309733824"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[11:49:12.039] Scheduled build:
{
"id": "8781123625243813009",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60696,
"createdBy": "project:chromium",
"createTime": "2023-05-14T11:49:11.624623699Z",
"updateTime": "2023-05-14T11:49:11.624623699Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f86f76f49f4ad70faa88a17368034313753eb3f7",
"ref": "refs/heads/main"
}
}
}
[11:49:12.039] Task URL: https://cr-buildbucket.appspot.com/build/8781123625243813009
[11:49:12.039] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:2:0) after 5m28s
[11:54:40.166] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:2:0)
[11:54:40.221] Build status: SCHEDULED
[11:54:40.221] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:3:0) after 7m40s
[12:02:20.243] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:3:0)
[12:02:20.260] Build status: SCHEDULED
[12:02:20.260] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:4:0) after 2m35s
[12:04:55.691] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:4:0)
[12:04:55.714] Build status: SCHEDULED
[12:04:55.714] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:5:0) after 9m49s
[12:14:44.911] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:5:0)
[12:14:44.967] Build status: SCHEDULED
[12:14:44.967] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:6:0) after 4m25s
[12:19:10.278] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:6:0)
[12:19:10.304] Build status: SCHEDULED
[12:19:10.304] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:7:0) after 7m15s
[12:26:25.813] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:7:0)
[12:26:25.828] Build status: SCHEDULED
[12:26:25.828] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:8:0) after 3m25s
[12:29:51.559] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:8:0)
[12:29:51.576] Build status: SCHEDULED
[12:29:51.576] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:9:0) after 4m27s
[12:34:18.725] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:9:0)
[12:34:18.744] Build status: SCHEDULED
[12:34:18.744] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:10:0) after 7m30s
[12:41:48.761] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:10:0)
[12:41:48.780] Build status: SCHEDULED
[12:41:48.780] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:11:0) after 5m53s
[12:47:41.796] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:11:0)
[12:47:41.816] Build status: SCHEDULED
[12:47:41.816] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:12:0) after 9m15s
[12:56:56.836] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:12:0)
[12:56:56.854] Build status: SCHEDULED
[12:56:56.854] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:13:0) after 2m7s
[12:59:03.979] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:13:0)
[12:59:03.996] Build status: SCHEDULED
[12:59:03.996] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:14:0) after 8m45s
[13:07:49.393] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:14:0)
[13:07:49.409] Build status: SCHEDULED
[13:07:49.409] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:15:0) after 8m29s
[13:16:18.440] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:15:0)
[13:16:18.467] Build status: SCHEDULED
[13:16:18.467] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:16:0) after 5m6s
[13:21:24.567] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:16:0)
[13:21:24.624] Build status: SCHEDULED
[13:21:24.624] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:17:0) after 8m49s
[13:30:13.832] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:17:0)
[13:30:13.850] Build status: SCHEDULED
[13:30:13.850] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:18:0) after 3m4s
[13:33:17.865] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:18:0)
[13:33:17.883] Build status: SCHEDULED
[13:33:17.883] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:19:0) after 5m1s
[13:38:18.902] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:19:0)
[13:38:18.921] Build status: SCHEDULED
[13:38:18.921] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:20:0) after 7m59s
[13:46:18.119] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:20:0)
[13:46:18.134] Build status: SCHEDULED
[13:46:18.134] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:21:0) after 8m54s
[13:55:12.587] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:21:0)
[13:55:12.605] Build status: SCHEDULED
[13:55:12.605] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:22:0) after 5m5s
[14:00:17.648] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:22:0)
[14:00:17.677] Build status: SCHEDULED
[14:00:17.677] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:23:0) after 4m55s
[14:05:12.695] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:23:0)
[14:05:12.719] Build status: SCHEDULED
[14:05:12.719] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:24:0) after 5m53s
[14:11:06.057] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:24:0)
[14:11:06.078] Build status: SCHEDULED
[14:11:06.078] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:25:0) after 7m45s
[14:18:51.094] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:25:0)
[14:18:51.125] Build status: SCHEDULED
[14:18:51.125] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:26:0) after 1m50s
[14:20:41.233] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:26:0)
[14:20:41.256] Build status: SCHEDULED
[14:20:41.256] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:27:0) after 2m23s
[14:23:04.291] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:27:0)
[14:23:04.306] Build status: SCHEDULED
[14:23:04.306] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:28:0) after 5m6s
[14:28:10.311] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:28:0)
[14:28:10.493] Build status: SCHEDULED
[14:28:10.493] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:29:0) after 4m56s
[14:33:06.514] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:29:0)
[14:33:06.532] Build status: SCHEDULED
[14:33:06.532] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:30:0) after 1m35s
[14:34:41.517] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:30:0)
[14:34:41.537] Build status: SCHEDULED
[14:34:41.537] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:31:0) after 7m21s
[14:42:02.562] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:31:0)
[14:42:02.584] Build status: SCHEDULED
[14:42:02.584] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:32:0) after 4m10s
[14:46:12.875] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:32:0)
[14:46:12.896] Build status: SCHEDULED
[14:46:12.896] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:33:0) after 9m17s
[14:55:29.916] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:33:0)
[14:55:29.940] Build status: SCHEDULED
[14:55:29.940] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:34:0) after 3m53s
[14:59:22.967] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:34:0)
[14:59:22.986] Build status: SCHEDULED
[14:59:22.986] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:35:0) after 2m43s
[15:02:06.060] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:35:0)
[15:02:06.081] Build status: SCHEDULED
[15:02:06.081] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:36:0) after 5m4s
[15:07:10.066] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:36:0)
[15:07:10.131] Build status: SCHEDULED
[15:07:10.131] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:37:0) after 9m13s
[15:16:23.257] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:37:0)
[15:16:23.289] Build status: SCHEDULED
[15:16:23.289] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:38:0) after 4m57s
[15:21:20.349] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:38:0)
[15:21:20.367] Build status: SCHEDULED
[15:21:20.367] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:39:0) after 4m34s
[15:25:54.438] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:39:0)
[15:25:54.457] Build status: SCHEDULED
[15:25:54.457] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:40:0) after 8m3s
[15:33:57.546] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:40:0)
[15:33:57.707] Build status: SCHEDULED
[15:33:57.707] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:41:0) after 3m21s
[15:37:18.864] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:41:0)
[15:37:18.882] Build status: SCHEDULED
[15:37:18.882] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:42:0) after 3m44s
[15:41:02.912] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:42:0)
[15:41:02.933] Build status: SCHEDULED
[15:41:02.933] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:43:0) after 4m42s
[15:45:44.954] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:43:0)
[15:45:44.969] Build status: SCHEDULED
[15:45:44.969] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:44:0) after 3m7s
[15:48:51.995] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:44:0)
[15:48:52.023] Build status: SCHEDULED
[15:48:52.023] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:45:0) after 6m6s
[15:54:58.143] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:45:0)
[15:54:58.166] Build status: SCHEDULED
[15:54:58.166] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:46:0) after 9m2s
[16:04:00.516] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:46:0)
[16:04:00.535] Build status: SCHEDULED
[16:04:00.535] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:47:0) after 7m16s
[16:11:16.577] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:47:0)
[16:11:16.630] Build status: SCHEDULED
[16:11:16.630] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:48:0) after 2m58s
[16:14:14.666] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:48:0)
[16:14:14.746] Build status: SCHEDULED
[16:14:14.746] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:49:0) after 2m39s
[16:16:53.873] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:49:0)
[16:16:53.896] Build status: SCHEDULED
[16:16:53.896] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:50:0) after 3m42s
[16:20:35.915] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:50:0)
[16:20:35.932] Build status: SCHEDULED
[16:20:35.932] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:51:0) after 9m58s
[16:30:34.023] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:51:0)
[16:30:34.040] Build status: SCHEDULED
[16:30:34.040] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:52:0) after 8m20s
[16:38:54.131] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:52:0)
[16:38:54.154] Build status: SCHEDULED
[16:38:54.154] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:53:0) after 6m13s
[16:45:07.180] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:53:0)
[16:45:07.207] Build status: SCHEDULED
[16:45:07.207] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:54:0) after 3m23s
[16:48:30.303] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:54:0)
[16:48:30.325] Build status: SCHEDULED
[16:48:30.325] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:55:0) after 6m56s
[16:55:26.678] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:55:0)
[16:55:26.708] Build status: SCHEDULED
[16:55:26.708] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:56:0) after 6m32s
[17:01:58.726] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:56:0)
[17:01:58.760] Build status: SCHEDULED
[17:01:58.760] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:57:0) after 6m54s
[17:08:52.793] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:57:0)
[17:08:52.818] Build status: SCHEDULED
[17:08:52.818] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:58:0) after 3m46s
[17:12:38.835] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:58:0)
[17:12:38.855] Build status: SCHEDULED
[17:12:38.855] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:59:0) after 9m45s
[17:22:23.871] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:59:0)
[17:22:23.893] Build status: SCHEDULED
[17:22:23.893] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:60:0) after 5m5s
[17:27:28.912] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:60:0)
[17:27:28.988] Build status: SCHEDULED
[17:27:28.988] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:61:0) after 4m12s
[17:31:41.163] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:61:0)
[17:31:41.230] Build status: SCHEDULED
[17:31:41.230] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:62:0) after 5m48s
[17:37:29.253] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:62:0)
[17:37:29.274] Build status: SCHEDULED
[17:37:29.274] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:63:0) after 9m39s
[17:47:08.919] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:63:0)
[17:47:08.939] Build status: SCHEDULED
[17:47:08.939] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:64:0) after 1m41s
[17:48:50.504] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:64:0)
[17:48:50.527] Build status: SCHEDULED
[17:48:50.527] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946553687309733824:65:0) after 5m30s
[17:50:07.165] Received PubSub notification, asking Buildbucket for the build status
[17:50:07.185] Build:
{
"id": "8781123625243813009",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60696,
"createdBy": "project:chromium",
"createTime": "2023-05-14T11:49:11.624623699Z",
"endTime": "2023-05-14T17:50:06.521833Z",
"updateTime": "2023-05-14T17:50:06.521833Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f86f76f49f4ad70faa88a17368034313753eb3f7",
"ref": "refs/heads/main"
}
}
}
[17:50:07.185] Invocation finished in 6h0m56.913998493s with status FAILED