[21:57:09.277] New invocation is queued and will start shortly
[21:57:11.589] Starting the invocation (attempt 1)
[21:57:11.639] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/fec874a6333cfae2f0f825c83c26acb5e71a9702"
[21:57:11.639] Popped gitiles commit info from properties and tags
[21:57:11.639] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:57:11.642] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:57:11.642] Buildbucket request:
{
"requestId": "8956481102638351808",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fec874a6333cfae2f0f825c83c26acb5e71a9702",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8956481102638351808"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:57:12.225] Scheduled build:
{
"id": "8791051039365049041",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60245,
"createdBy": "project:chromium",
"createTime": "2023-01-24T21:57:11.749600575Z",
"updateTime": "2023-01-24T21:57:11.749600575Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fec874a6333cfae2f0f825c83c26acb5e71a9702",
"ref": "refs/heads/main"
}
}
}
[21:57:12.225] Task URL: https://cr-buildbucket.appspot.com/build/8791051039365049041
[21:57:12.225] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:2:0) after 2m14s
[21:59:27.062] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:2:0)
[21:59:27.100] Build status: SCHEDULED
[21:59:27.100] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:3:0) after 4m30s
[22:03:57.320] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:3:0)
[22:03:57.348] Build status: SCHEDULED
[22:03:57.348] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:4:0) after 6m23s
[22:10:20.376] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:4:0)
[22:10:20.398] Build status: SCHEDULED
[22:10:20.398] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:5:0) after 1m8s
[22:11:28.488] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:5:0)
[22:11:28.526] Build status: SCHEDULED
[22:11:28.526] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:6:0) after 6m51s
[22:18:19.550] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:6:0)
[22:18:19.573] Build status: SCHEDULED
[22:18:19.573] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:7:0) after 5m54s
[22:24:13.603] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:7:0)
[22:24:13.626] Build status: SCHEDULED
[22:24:13.626] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:8:0) after 3m26s
[22:27:40.100] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:8:0)
[22:27:40.310] Build status: SCHEDULED
[22:27:40.310] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:9:0) after 2m36s
[22:30:16.348] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:9:0)
[22:30:16.379] Build status: SCHEDULED
[22:30:16.379] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:10:0) after 8m34s
[22:38:50.401] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:10:0)
[22:38:50.434] Build status: SCHEDULED
[22:38:50.434] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:11:0) after 3m40s
[22:42:30.828] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:11:0)
[22:42:30.853] Build status: SCHEDULED
[22:42:30.854] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:12:0) after 6m17s
[22:48:48.046] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:12:0)
[22:48:48.071] Build status: SCHEDULED
[22:48:48.072] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:13:0) after 3m13s
[22:52:01.227] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:13:0)
[22:52:01.253] Build status: SCHEDULED
[22:52:01.253] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:14:0) after 1m41s
[22:53:42.358] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:14:0)
[22:53:42.381] Build status: SCHEDULED
[22:53:42.381] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:15:0) after 2m43s
[22:56:25.406] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:15:0)
[22:56:25.432] Build status: SCHEDULED
[22:56:25.432] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:16:0) after 9m3s
[23:05:28.548] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:16:0)
[23:05:28.575] Build status: SCHEDULED
[23:05:28.575] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:17:0) after 5m28s
[23:10:56.604] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:17:0)
[23:10:56.629] Build status: SCHEDULED
[23:10:56.629] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:18:0) after 2m33s
[23:13:29.814] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:18:0)
[23:13:29.836] Build status: SCHEDULED
[23:13:29.837] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:19:0) after 4m3s
[23:17:32.836] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:19:0)
[23:17:32.857] Build status: SCHEDULED
[23:17:32.857] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:20:0) after 7m21s
[23:24:53.991] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:20:0)
[23:24:54.014] Build status: SCHEDULED
[23:24:54.014] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:21:0) after 1m48s
[23:26:42.039] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:21:0)
[23:26:42.063] Build status: SCHEDULED
[23:26:42.063] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:22:0) after 4m25s
[23:31:07.098] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:22:0)
[23:31:07.129] Build status: SCHEDULED
[23:31:07.130] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:23:0) after 7m28s
[23:38:35.200] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:23:0)
[23:38:35.229] Build status: SCHEDULED
[23:38:35.229] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:24:0) after 9m59s
[23:48:34.296] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:24:0)
[23:48:34.343] Build status: SCHEDULED
[23:48:34.344] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:25:0) after 6m55s
[23:55:29.504] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:25:0)
[23:55:29.533] Build status: SCHEDULED
[23:55:29.533] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:26:0) after 9m28s
[00:04:57.715] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:26:0)
[00:04:57.736] Build status: SCHEDULED
[00:04:57.737] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:27:0) after 6m1s
[00:10:58.765] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:27:0)
[00:10:58.808] Build status: SCHEDULED
[00:10:58.808] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:28:0) after 8m45s
[00:19:43.831] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:28:0)
[00:19:43.849] Build status: SCHEDULED
[00:19:43.849] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:29:0) after 3m46s
[00:23:30.122] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:29:0)
[00:23:30.143] Build status: SCHEDULED
[00:23:30.143] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:30:0) after 6m0s
[00:29:30.167] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:30:0)
[00:29:30.193] Build status: SCHEDULED
[00:29:30.193] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:31:0) after 9m11s
[00:38:41.358] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:31:0)
[00:38:41.384] Build status: SCHEDULED
[00:38:41.384] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:32:0) after 2m56s
[00:41:37.391] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:32:0)
[00:41:37.423] Build status: SCHEDULED
[00:41:37.423] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:33:0) after 2m31s
[00:44:08.599] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:33:0)
[00:44:08.629] Build status: SCHEDULED
[00:44:08.629] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:34:0) after 8m59s
[00:53:07.655] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:34:0)
[00:53:07.679] Build status: SCHEDULED
[00:53:07.680] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:35:0) after 5m17s
[00:58:24.782] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:35:0)
[00:58:24.802] Build status: SCHEDULED
[00:58:24.802] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:36:0) after 9m55s
[01:08:20.121] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:36:0)
[01:08:20.147] Build status: SCHEDULED
[01:08:20.147] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:37:0) after 1m25s
[01:09:45.316] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:37:0)
[01:09:45.338] Build status: SCHEDULED
[01:09:45.338] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:38:0) after 3m41s
[01:13:26.467] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:38:0)
[01:13:26.487] Build status: SCHEDULED
[01:13:26.487] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:39:0) after 5m12s
[01:18:38.737] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:39:0)
[01:18:38.825] Build status: SCHEDULED
[01:18:38.825] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:40:0) after 2m18s
[01:20:56.852] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:40:0)
[01:20:56.878] Build status: SCHEDULED
[01:20:56.878] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:41:0) after 3m44s
[01:24:41.115] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:41:0)
[01:24:41.141] Build status: SCHEDULED
[01:24:41.141] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:42:0) after 2m43s
[01:27:24.554] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:42:0)
[01:27:24.578] Build status: SCHEDULED
[01:27:24.578] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:43:0) after 9m24s
[01:36:48.781] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:43:0)
[01:36:48.800] Build status: SCHEDULED
[01:36:48.800] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:44:0) after 7m49s
[01:44:37.840] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:44:0)
[01:44:37.861] Build status: SCHEDULED
[01:44:37.861] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:45:0) after 5m23s
[01:50:00.895] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:45:0)
[01:50:00.918] Build status: SCHEDULED
[01:50:00.918] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:46:0) after 2m34s
[01:52:35.180] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:46:0)
[01:52:35.215] Build status: SCHEDULED
[01:52:35.215] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:47:0) after 7m0s
[01:59:35.250] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:47:0)
[01:59:35.273] Build status: SCHEDULED
[01:59:35.273] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:48:0) after 2m50s
[02:02:25.573] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:48:0)
[02:02:25.629] Build status: SCHEDULED
[02:02:25.629] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:49:0) after 1m11s
[02:03:36.749] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:49:0)
[02:03:36.774] Build status: SCHEDULED
[02:03:36.774] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:50:0) after 8m48s
[02:12:24.809] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:50:0)
[02:12:24.831] Build status: SCHEDULED
[02:12:24.831] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:51:0) after 9m8s
[02:21:32.850] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:51:0)
[02:21:32.870] Build status: SCHEDULED
[02:21:32.870] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:52:0) after 2m42s
[02:24:14.950] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:52:0)
[02:24:14.969] Build status: SCHEDULED
[02:24:14.969] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:53:0) after 9m59s
[02:34:14.002] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:53:0)
[02:34:14.025] Build status: SCHEDULED
[02:34:14.025] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:54:0) after 9m37s
[02:43:51.602] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:54:0)
[02:43:51.621] Build status: SCHEDULED
[02:43:51.621] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:55:0) after 4m25s
[02:48:16.726] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:55:0)
[02:48:16.747] Build status: SCHEDULED
[02:48:16.747] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:56:0) after 9m28s
[02:57:44.786] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:56:0)
[02:57:44.808] Build status: SCHEDULED
[02:57:44.808] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:57:0) after 9m30s
[03:07:14.836] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:57:0)
[03:07:14.854] Build status: SCHEDULED
[03:07:14.854] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:58:0) after 9m52s
[03:17:06.948] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:58:0)
[03:17:06.970] Build status: SCHEDULED
[03:17:06.970] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:59:0) after 5m39s
[03:22:46.154] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:59:0)
[03:22:46.173] Build status: SCHEDULED
[03:22:46.173] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:60:0) after 5m57s
[03:28:43.212] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:60:0)
[03:28:43.234] Build status: SCHEDULED
[03:28:43.234] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:61:0) after 7m59s
[03:36:42.270] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:61:0)
[03:36:42.288] Build status: SCHEDULED
[03:36:42.288] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:62:0) after 4m34s
[03:41:16.309] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:62:0)
[03:41:16.329] Build status: SCHEDULED
[03:41:16.329] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:63:0) after 7m49s
[03:49:05.705] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:63:0)
[03:49:05.729] Build status: SCHEDULED
[03:49:05.730] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:64:0) after 8m44s
[03:57:49.830] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:64:0)
[03:57:49.866] Build status: SCHEDULED
[03:57:49.866] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956481102638351808:65:0) after 7m44s
[03:58:05.825] Received PubSub notification, asking Buildbucket for the build status
[03:58:05.848] Build:
{
"id": "8791051039365049041",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60245,
"createdBy": "project:chromium",
"createTime": "2023-01-24T21:57:11.749600575Z",
"endTime": "2023-01-25T03:58:05.252429Z",
"updateTime": "2023-01-25T03:58:05.252429Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fec874a6333cfae2f0f825c83c26acb5e71a9702",
"ref": "refs/heads/main"
}
}
}
[03:58:05.848] Invocation finished in 6h0m56.605197259s with status FAILED