[12:05:04.417] New invocation is queued and will start shortly
[12:05:05.510] Starting the invocation (attempt 1)
[12:05:05.545] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/8f994f189193084b98766fb0f5969de4d028fb78"
[12:05:05.545] Popped gitiles commit info from properties and tags
[12:05:05.545] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[12:05:05.545] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[12:05:05.545] Buildbucket request:
{
"requestId": "8946190298965170192",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8f994f189193084b98766fb0f5969de4d028fb78",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8946190298965170192"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[12:05:05.970] Scheduled build:
{
"id": "8780760237059475665",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60712,
"createdBy": "project:chromium",
"createTime": "2023-05-18T12:05:05.603622061Z",
"updateTime": "2023-05-18T12:05:05.603622061Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8f994f189193084b98766fb0f5969de4d028fb78",
"ref": "refs/heads/main"
}
}
}
[12:05:05.970] Task URL: https://cr-buildbucket.appspot.com/build/8780760237059475665
[12:05:05.970] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:2:0) after 5m49s
[12:10:54.994] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:2:0)
[12:10:55.015] Build status: SCHEDULED
[12:10:55.015] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:3:0) after 2m58s
[12:13:53.035] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:3:0)
[12:13:53.054] Build status: SCHEDULED
[12:13:53.054] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:4:0) after 7m57s
[12:21:50.079] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:4:0)
[12:21:50.099] Build status: SCHEDULED
[12:21:50.099] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:5:0) after 8m42s
[12:30:32.202] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:5:0)
[12:30:32.246] Build status: SCHEDULED
[12:30:32.246] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:6:0) after 7m44s
[12:38:16.357] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:6:0)
[12:38:16.377] Build status: SCHEDULED
[12:38:16.377] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:7:0) after 8m13s
[12:46:29.402] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:7:0)
[12:46:29.428] Build status: SCHEDULED
[12:46:29.428] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:8:0) after 7m46s
[12:54:15.492] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:8:0)
[12:54:15.512] Build status: SCHEDULED
[12:54:15.512] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:9:0) after 3m58s
[12:58:13.541] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:9:0)
[12:58:13.623] Build status: SCHEDULED
[12:58:13.623] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:10:0) after 7m57s
[13:06:10.649] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:10:0)
[13:06:10.670] Build status: SCHEDULED
[13:06:10.671] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:11:0) after 2m3s
[13:08:13.786] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:11:0)
[13:08:13.804] Build status: SCHEDULED
[13:08:13.805] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:12:0) after 1m59s
[13:10:12.790] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:12:0)
[13:10:12.810] Build status: SCHEDULED
[13:10:12.810] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:13:0) after 3m45s
[13:13:57.870] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:13:0)
[13:13:57.900] Build status: SCHEDULED
[13:13:57.900] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:14:0) after 1m6s
[13:15:04.029] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:14:0)
[13:15:04.046] Build status: SCHEDULED
[13:15:04.046] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:15:0) after 7m49s
[13:22:53.111] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:15:0)
[13:22:53.128] Build status: SCHEDULED
[13:22:53.128] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:16:0) after 1m38s
[13:24:31.147] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:16:0)
[13:24:31.169] Build status: SCHEDULED
[13:24:31.169] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:17:0) after 6m29s
[13:31:00.284] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:17:0)
[13:31:00.313] Build status: SCHEDULED
[13:31:00.313] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:18:0) after 2m9s
[13:33:09.342] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:18:0)
[13:33:09.360] Build status: SCHEDULED
[13:33:09.360] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:19:0) after 9m12s
[13:42:21.378] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:19:0)
[13:42:21.407] Build status: SCHEDULED
[13:42:21.407] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:20:0) after 4m8s
[13:46:29.427] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:20:0)
[13:46:29.453] Build status: SCHEDULED
[13:46:29.453] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:21:0) after 3m1s
[13:49:30.745] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:21:0)
[13:49:30.788] Build status: SCHEDULED
[13:49:30.788] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:22:0) after 4m34s
[13:54:04.837] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:22:0)
[13:54:04.879] Build status: SCHEDULED
[13:54:04.879] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:23:0) after 1m57s
[13:56:01.869] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:23:0)
[13:56:01.890] Build status: SCHEDULED
[13:56:01.890] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:24:0) after 4m8s
[14:00:10.200] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:24:0)
[14:00:10.223] Build status: SCHEDULED
[14:00:10.223] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:25:0) after 8m10s
[14:08:20.368] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:25:0)
[14:08:20.407] Build status: SCHEDULED
[14:08:20.407] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:26:0) after 9m22s
[14:17:42.488] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:26:0)
[14:17:42.534] Build status: SCHEDULED
[14:17:42.534] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:27:0) after 3m30s
[14:21:12.562] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:27:0)
[14:21:12.580] Build status: SCHEDULED
[14:21:12.580] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:28:0) after 3m15s
[14:24:28.206] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:28:0)
[14:24:28.239] Build status: SCHEDULED
[14:24:28.239] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:29:0) after 7m39s
[14:32:07.452] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:29:0)
[14:32:07.483] Build status: SCHEDULED
[14:32:07.483] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:30:0) after 5m54s
[14:38:01.574] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:30:0)
[14:38:01.611] Build status: SCHEDULED
[14:38:01.611] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:31:0) after 1m37s
[14:39:38.733] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:31:0)
[14:39:38.752] Build status: SCHEDULED
[14:39:38.752] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:32:0) after 4m9s
[14:43:47.828] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:32:0)
[14:43:47.851] Build status: SCHEDULED
[14:43:47.851] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:33:0) after 8m14s
[14:52:01.881] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:33:0)
[14:52:01.902] Build status: SCHEDULED
[14:52:01.902] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:34:0) after 6m13s
[14:58:15.049] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:34:0)
[14:58:15.070] Build status: SCHEDULED
[14:58:15.070] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:35:0) after 1m6s
[14:59:21.252] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:35:0)
[14:59:21.280] Build status: SCHEDULED
[14:59:21.280] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:36:0) after 1m50s
[15:01:11.314] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:36:0)
[15:01:11.337] Build status: SCHEDULED
[15:01:11.337] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:37:0) after 5m1s
[15:06:12.612] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:37:0)
[15:06:12.629] Build status: SCHEDULED
[15:06:12.629] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:38:0) after 7m25s
[15:13:37.770] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:38:0)
[15:13:37.794] Build status: SCHEDULED
[15:13:37.794] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:39:0) after 7m54s
[15:21:31.819] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:39:0)
[15:21:31.922] Build status: SCHEDULED
[15:21:31.922] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:40:0) after 9m28s
[15:30:59.945] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:40:0)
[15:30:59.966] Build status: SCHEDULED
[15:30:59.966] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:41:0) after 3m53s
[15:34:53.086] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:41:0)
[15:34:53.106] Build status: SCHEDULED
[15:34:53.106] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:42:0) after 7m37s
[15:42:30.245] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:42:0)
[15:42:30.267] Build status: SCHEDULED
[15:42:30.267] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:43:0) after 9m57s
[15:52:27.386] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:43:0)
[15:52:27.406] Build status: SCHEDULED
[15:52:27.406] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:44:0) after 5m22s
[15:57:49.514] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:44:0)
[15:57:49.589] Build status: SCHEDULED
[15:57:49.589] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:45:0) after 5m38s
[16:03:27.648] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:45:0)
[16:03:27.695] Build status: SCHEDULED
[16:03:27.695] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:46:0) after 7m43s
[16:11:10.870] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:46:0)
[16:11:10.893] Build status: SCHEDULED
[16:11:10.893] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:47:0) after 9m22s
[16:20:33.189] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:47:0)
[16:20:33.391] Build status: SCHEDULED
[16:20:33.391] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:48:0) after 9m41s
[16:30:14.821] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:48:0)
[16:30:15.044] Build status: SCHEDULED
[16:30:15.044] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:49:0) after 6m20s
[16:36:35.066] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:49:0)
[16:36:35.171] Build status: SCHEDULED
[16:36:35.171] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:50:0) after 9m52s
[16:46:27.358] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:50:0)
[16:46:27.377] Build status: SCHEDULED
[16:46:27.377] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:51:0) after 4m8s
[16:50:35.852] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:51:0)
[16:50:36.024] Build status: SCHEDULED
[16:50:36.024] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:52:0) after 4m13s
[16:54:49.112] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:52:0)
[16:54:49.133] Build status: SCHEDULED
[16:54:49.133] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:53:0) after 9m54s
[17:04:43.392] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:53:0)
[17:04:43.412] Build status: SCHEDULED
[17:04:43.412] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:54:0) after 5m57s
[17:10:40.881] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:54:0)
[17:10:40.908] Build status: SCHEDULED
[17:10:40.908] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:55:0) after 4m11s
[17:14:51.931] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:55:0)
[17:14:51.955] Build status: SCHEDULED
[17:14:51.955] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:56:0) after 8m39s
[17:23:30.964] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:56:0)
[17:23:31.036] Build status: SCHEDULED
[17:23:31.036] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:57:0) after 4m34s
[17:28:05.177] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:57:0)
[17:28:05.206] Build status: SCHEDULED
[17:28:05.206] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:58:0) after 7m10s
[17:35:15.793] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:58:0)
[17:35:15.818] Build status: SCHEDULED
[17:35:15.818] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:59:0) after 8m44s
[17:43:59.886] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:59:0)
[17:43:59.910] Build status: SCHEDULED
[17:43:59.910] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:60:0) after 4m49s
[17:48:48.974] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:60:0)
[17:48:48.995] Build status: SCHEDULED
[17:48:48.995] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:61:0) after 6m12s
[17:55:01.541] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:61:0)
[17:55:01.578] Build status: SCHEDULED
[17:55:01.579] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:62:0) after 8m14s
[18:03:15.777] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:62:0)
[18:03:15.800] Build status: SCHEDULED
[18:03:15.800] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8946190298965170192:63:0) after 4m44s
[18:06:09.037] Received PubSub notification, asking Buildbucket for the build status
[18:06:09.094] Build:
{
"id": "8780760237059475665",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60712,
"createdBy": "project:chromium",
"createTime": "2023-05-18T12:05:05.603622061Z",
"endTime": "2023-05-18T18:06:07.961945Z",
"updateTime": "2023-05-18T18:06:07.961945Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8f994f189193084b98766fb0f5969de4d028fb78",
"ref": "refs/heads/main"
}
}
}
[18:06:09.094] Invocation finished in 6h1m4.692231072s with status FAILED