[18:50:05.183] New invocation is queued and will start shortly
[18:50:06.516] Starting the invocation (attempt 1)
[18:50:06.544] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/836c48880b76c2023340181c837b085db1533584"
[18:50:06.544] Popped gitiles commit info from properties and tags
[18:50:06.544] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:50:06.544] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:50:06.544] Buildbucket request:
{
"requestId": "8945168251126505568",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "836c48880b76c2023340181c837b085db1533584",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8945168251126505568"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:50:07.289] Scheduled build:
{
"id": "8779738188922841553",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60757,
"createdBy": "project:chromium",
"createTime": "2023-05-29T18:50:06.661025873Z",
"updateTime": "2023-05-29T18:50:06.661025873Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "836c48880b76c2023340181c837b085db1533584",
"ref": "refs/heads/main"
}
}
}
[18:50:07.289] Task URL: https://cr-buildbucket.appspot.com/build/8779738188922841553
[18:50:07.289] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:2:0) after 5m10s
[18:55:17.303] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:2:0)
[18:55:17.330] Build status: SCHEDULED
[18:55:17.330] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:3:0) after 5m35s
[19:00:52.518] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:3:0)
[19:00:52.541] Build status: SCHEDULED
[19:00:52.541] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:4:0) after 8m58s
[19:09:50.609] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:4:0)
[19:09:50.680] Build status: SCHEDULED
[19:09:50.680] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:5:0) after 7m6s
[19:16:56.824] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:5:0)
[19:16:56.840] Build status: SCHEDULED
[19:16:56.840] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:6:0) after 3m37s
[19:20:33.895] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:6:0)
[19:20:33.959] Build status: SCHEDULED
[19:20:33.959] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:7:0) after 9m50s
[19:30:24.109] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:7:0)
[19:30:24.165] Build status: SCHEDULED
[19:30:24.165] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:8:0) after 7m41s
[19:38:05.184] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:8:0)
[19:38:05.210] Build status: SCHEDULED
[19:38:05.210] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:9:0) after 7m44s
[19:45:49.263] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:9:0)
[19:45:49.290] Build status: SCHEDULED
[19:45:49.290] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:10:0) after 2m11s
[19:48:00.312] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:10:0)
[19:48:00.327] Build status: SCHEDULED
[19:48:00.327] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:11:0) after 4m29s
[19:52:29.616] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:11:0)
[19:52:29.636] Build status: SCHEDULED
[19:52:29.636] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:12:0) after 7m2s
[19:59:31.860] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:12:0)
[19:59:31.878] Build status: SCHEDULED
[19:59:31.878] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:13:0) after 4m25s
[20:03:56.900] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:13:0)
[20:03:56.924] Build status: SCHEDULED
[20:03:56.924] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:14:0) after 6m42s
[20:10:38.962] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:14:0)
[20:10:39.019] Build status: SCHEDULED
[20:10:39.019] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:15:0) after 1m1s
[20:11:40.043] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:15:0)
[20:11:40.117] Build status: SCHEDULED
[20:11:40.117] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:16:0) after 6m55s
[20:18:35.296] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:16:0)
[20:18:35.319] Build status: SCHEDULED
[20:18:35.319] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:17:0) after 3m43s
[20:22:18.334] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:17:0)
[20:22:18.355] Build status: SCHEDULED
[20:22:18.355] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:18:0) after 3m44s
[20:26:02.424] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:18:0)
[20:26:02.448] Build status: SCHEDULED
[20:26:02.448] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:19:0) after 2m10s
[20:28:12.839] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:19:0)
[20:28:12.855] Build status: SCHEDULED
[20:28:12.855] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:20:0) after 6m54s
[20:35:06.874] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:20:0)
[20:35:06.902] Build status: SCHEDULED
[20:35:06.902] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:21:0) after 4m25s
[20:39:32.029] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:21:0)
[20:39:32.056] Build status: SCHEDULED
[20:39:32.056] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:22:0) after 5m18s
[20:44:50.274] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:22:0)
[20:44:50.292] Build status: SCHEDULED
[20:44:50.292] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:23:0) after 9m18s
[20:54:08.538] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:23:0)
[20:54:08.575] Build status: SCHEDULED
[20:54:08.575] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:24:0) after 1m26s
[20:55:34.798] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:24:0)
[20:55:34.819] Build status: SCHEDULED
[20:55:34.819] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:25:0) after 3m53s
[20:59:28.063] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:25:0)
[20:59:28.080] Build status: SCHEDULED
[20:59:28.080] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:26:0) after 4m17s
[21:03:45.107] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:26:0)
[21:03:45.133] Build status: SCHEDULED
[21:03:45.133] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:27:0) after 3m53s
[21:07:38.170] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:27:0)
[21:07:38.203] Build status: SCHEDULED
[21:07:38.203] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:28:0) after 9m17s
[21:16:55.241] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:28:0)
[21:16:55.260] Build status: SCHEDULED
[21:16:55.260] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:29:0) after 8m31s
[21:25:26.360] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:29:0)
[21:25:26.377] Build status: SCHEDULED
[21:25:26.377] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:30:0) after 1m20s
[21:26:46.746] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:30:0)
[21:26:46.769] Build status: SCHEDULED
[21:26:46.769] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:31:0) after 6m9s
[21:32:55.769] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:31:0)
[21:32:55.796] Build status: SCHEDULED
[21:32:55.796] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:32:0) after 9m32s
[21:42:27.920] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:32:0)
[21:42:27.950] Build status: SCHEDULED
[21:42:27.950] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:33:0) after 2m13s
[21:44:41.093] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:33:0)
[21:44:41.120] Build status: SCHEDULED
[21:44:41.121] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:34:0) after 5m22s
[21:50:03.165] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:34:0)
[21:50:03.182] Build status: SCHEDULED
[21:50:03.182] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:35:0) after 8m19s
[21:58:22.202] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:35:0)
[21:58:22.219] Build status: SCHEDULED
[21:58:22.219] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:36:0) after 3m25s
[22:01:47.208] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:36:0)
[22:01:47.247] Build status: SCHEDULED
[22:01:47.247] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:37:0) after 6m45s
[22:08:32.298] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:37:0)
[22:08:32.325] Build status: SCHEDULED
[22:08:32.325] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:38:0) after 5m4s
[22:13:36.343] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:38:0)
[22:13:36.366] Build status: SCHEDULED
[22:13:36.366] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:39:0) after 8m18s
[22:21:54.391] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:39:0)
[22:21:54.408] Build status: SCHEDULED
[22:21:54.408] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:40:0) after 2m16s
[22:24:10.635] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:40:0)
[22:24:10.654] Build status: SCHEDULED
[22:24:10.654] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:41:0) after 5m47s
[22:29:57.675] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:41:0)
[22:29:57.694] Build status: SCHEDULED
[22:29:57.694] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:42:0) after 6m22s
[22:36:19.720] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:42:0)
[22:36:19.754] Build status: SCHEDULED
[22:36:19.754] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:43:0) after 4m49s
[22:41:08.801] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:43:0)
[22:41:08.821] Build status: SCHEDULED
[22:41:08.821] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:44:0) after 5m27s
[22:46:35.840] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:44:0)
[22:46:35.860] Build status: SCHEDULED
[22:46:35.860] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:45:0) after 9m10s
[22:55:45.885] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:45:0)
[22:55:45.903] Build status: SCHEDULED
[22:55:45.903] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:46:0) after 7m15s
[23:03:01.139] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:46:0)
[23:03:01.163] Build status: SCHEDULED
[23:03:01.163] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:47:0) after 1m53s
[23:05:34.911] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:47:0)
[23:05:34.936] Build status: SCHEDULED
[23:05:34.936] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:48:0) after 2m45s
[23:08:19.961] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:48:0)
[23:08:19.985] Build status: SCHEDULED
[23:08:19.985] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:49:0) after 5m47s
[23:14:07.077] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:49:0)
[23:14:07.111] Build status: SCHEDULED
[23:14:07.111] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:50:0) after 3m54s
[23:18:01.151] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:50:0)
[23:18:01.175] Build status: SCHEDULED
[23:18:01.175] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:51:0) after 2m9s
[23:20:10.212] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:51:0)
[23:20:10.243] Build status: SCHEDULED
[23:20:10.243] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:52:0) after 3m21s
[23:23:31.323] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:52:0)
[23:23:31.344] Build status: SCHEDULED
[23:23:31.344] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:53:0) after 3m54s
[23:27:25.627] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:53:0)
[23:27:25.645] Build status: SCHEDULED
[23:27:25.645] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:54:0) after 9m28s
[23:36:53.671] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:54:0)
[23:36:53.689] Build status: SCHEDULED
[23:36:53.689] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:55:0) after 5m38s
[23:42:31.714] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:55:0)
[23:42:33.407] Build status: SCHEDULED
[23:42:33.407] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:56:0) after 8m13s
[23:50:46.689] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:56:0)
[23:50:46.718] Build status: SCHEDULED
[23:50:46.718] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:57:0) after 7m50s
[23:58:36.825] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:57:0)
[23:58:36.845] Build status: SCHEDULED
[23:58:36.845] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:58:0) after 8m20s
[00:06:56.986] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:58:0)
[00:06:57.027] Build status: SCHEDULED
[00:06:57.027] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:59:0) after 8m1s
[00:14:58.054] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:59:0)
[00:14:58.074] Build status: SCHEDULED
[00:14:58.074] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:60:0) after 5m47s
[00:20:45.196] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:60:0)
[00:20:45.222] Build status: SCHEDULED
[00:20:45.222] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:61:0) after 4m31s
[00:25:16.243] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:61:0)
[00:25:16.264] Build status: SCHEDULED
[00:25:16.265] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:62:0) after 6m48s
[00:32:04.324] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:62:0)
[00:32:04.343] Build status: SCHEDULED
[00:32:04.343] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:63:0) after 8m46s
[00:40:50.399] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:63:0)
[00:40:50.444] Build status: SCHEDULED
[00:40:50.444] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:64:0) after 4m14s
[00:45:04.468] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:64:0)
[00:45:04.488] Build status: SCHEDULED
[00:45:04.488] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945168251126505568:65:0) after 7m49s
[00:51:08.196] Received PubSub notification, asking Buildbucket for the build status
[00:51:08.213] Build:
{
"id": "8779738188922841553",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60757,
"createdBy": "project:chromium",
"createTime": "2023-05-29T18:50:06.661025873Z",
"endTime": "2023-05-30T00:51:06.299766Z",
"updateTime": "2023-05-30T00:51:06.299766Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "836c48880b76c2023340181c837b085db1533584",
"ref": "refs/heads/main"
}
}
}
[00:51:08.213] Invocation finished in 6h1m3.037257114s with status FAILED