[15:06:10.182] New invocation is queued and will start shortly
[15:06:11.262] Starting the invocation (attempt 1)
[15:06:11.297] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/705644553523b1884303d2d35ceef1d1358e81b8"
[15:06:11.297] Popped gitiles commit info from properties and tags
[15:06:11.297] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:06:11.297] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:06:11.297] Buildbucket request:
{
"requestId": "8950346365837752624",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "705644553523b1884303d2d35ceef1d1358e81b8",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8950346365837752624"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:06:11.742] Scheduled build:
{
"id": "8784916303916773361",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60529,
"createdBy": "project:chromium",
"createTime": "2023-04-02T15:06:11.384241714Z",
"updateTime": "2023-04-02T15:06:11.384241714Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "705644553523b1884303d2d35ceef1d1358e81b8",
"ref": "refs/heads/main"
}
}
}
[15:06:11.742] Task URL: https://cr-buildbucket.appspot.com/build/8784916303916773361
[15:06:11.742] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:2:0) after 9m20s
[15:15:31.723] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:2:0)
[15:15:31.755] Build status: SCHEDULED
[15:15:31.755] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:3:0) after 9m29s
[15:25:00.783] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:3:0)
[15:25:00.808] Build status: SCHEDULED
[15:25:00.808] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:4:0) after 9m24s
[15:34:24.926] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:4:0)
[15:34:24.950] Build status: SCHEDULED
[15:34:24.950] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:5:0) after 6m36s
[15:41:00.970] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:5:0)
[15:41:00.993] Build status: SCHEDULED
[15:41:00.993] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:6:0) after 9m5s
[15:50:06.001] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:6:0)
[15:50:06.027] Build status: SCHEDULED
[15:50:06.027] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:7:0) after 3m34s
[15:53:40.044] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:7:0)
[15:53:40.066] Build status: SCHEDULED
[15:53:40.066] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:8:0) after 8m13s
[16:01:53.106] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:8:0)
[16:01:53.130] Build status: SCHEDULED
[16:01:53.130] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:9:0) after 1m36s
[16:03:29.151] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:9:0)
[16:03:29.179] Build status: SCHEDULED
[16:03:29.180] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:10:0) after 3m54s
[16:07:23.207] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:10:0)
[16:07:23.231] Build status: SCHEDULED
[16:07:23.231] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:11:0) after 8m32s
[16:15:55.406] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:11:0)
[16:15:55.459] Build status: SCHEDULED
[16:15:55.459] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:12:0) after 5m46s
[16:21:41.452] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:12:0)
[16:21:41.483] Build status: SCHEDULED
[16:21:41.483] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:13:0) after 5m9s
[16:26:50.733] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:13:0)
[16:26:50.755] Build status: SCHEDULED
[16:26:50.755] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:14:0) after 5m59s
[16:32:49.777] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:14:0)
[16:32:49.864] Build status: SCHEDULED
[16:32:49.864] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:15:0) after 4m23s
[16:37:12.939] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:15:0)
[16:37:12.958] Build status: SCHEDULED
[16:37:12.958] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:16:0) after 8m43s
[16:45:55.979] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:16:0)
[16:45:56.000] Build status: SCHEDULED
[16:45:56.000] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:17:0) after 9m0s
[16:54:56.026] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:17:0)
[16:54:56.046] Build status: SCHEDULED
[16:54:56.046] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:18:0) after 4m31s
[16:59:27.066] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:18:0)
[16:59:27.086] Build status: SCHEDULED
[16:59:27.086] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:19:0) after 7m44s
[17:07:11.106] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:19:0)
[17:07:11.128] Build status: SCHEDULED
[17:07:11.128] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:20:0) after 6m20s
[17:13:31.157] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:20:0)
[17:13:31.181] Build status: SCHEDULED
[17:13:31.181] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:21:0) after 2m36s
[17:16:07.203] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:21:0)
[17:16:07.227] Build status: SCHEDULED
[17:16:07.227] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:22:0) after 5m2s
[17:21:09.416] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:22:0)
[17:21:09.471] Build status: SCHEDULED
[17:21:09.471] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:23:0) after 4m39s
[17:25:48.488] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:23:0)
[17:25:48.521] Build status: SCHEDULED
[17:25:48.521] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:24:0) after 2m45s
[17:28:34.077] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:24:0)
[17:28:34.104] Build status: SCHEDULED
[17:28:34.104] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:25:0) after 1m45s
[17:30:19.229] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:25:0)
[17:30:19.261] Build status: SCHEDULED
[17:30:19.261] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:26:0) after 7m21s
[17:37:40.272] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:26:0)
[17:37:40.333] Build status: SCHEDULED
[17:37:40.333] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:27:0) after 7m57s
[17:45:37.432] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:27:0)
[17:45:37.456] Build status: SCHEDULED
[17:45:37.456] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:28:0) after 3m25s
[17:49:02.480] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:28:0)
[17:49:02.502] Build status: SCHEDULED
[17:49:02.502] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:29:0) after 8m23s
[17:57:25.715] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:29:0)
[17:57:25.739] Build status: SCHEDULED
[17:57:25.739] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:30:0) after 8m44s
[18:06:09.762] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:30:0)
[18:06:09.789] Build status: SCHEDULED
[18:06:09.789] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:31:0) after 1m0s
[18:07:09.811] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:31:0)
[18:07:09.829] Build status: SCHEDULED
[18:07:09.829] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:32:0) after 2m49s
[18:09:58.862] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:32:0)
[18:09:58.984] Build status: SCHEDULED
[18:09:58.984] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:33:0) after 8m24s
[18:18:23.049] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:33:0)
[18:18:23.075] Build status: SCHEDULED
[18:18:23.075] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:34:0) after 8m45s
[18:27:08.284] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:34:0)
[18:27:08.315] Build status: SCHEDULED
[18:27:08.315] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:35:0) after 1m6s
[18:28:14.374] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:35:0)
[18:28:14.392] Build status: SCHEDULED
[18:28:14.392] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:36:0) after 7m27s
[18:35:41.458] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:36:0)
[18:35:41.485] Build status: SCHEDULED
[18:35:41.485] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:37:0) after 5m30s
[18:41:11.604] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:37:0)
[18:41:11.624] Build status: SCHEDULED
[18:41:11.624] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:38:0) after 8m0s
[18:49:11.648] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:38:0)
[18:49:11.679] Build status: SCHEDULED
[18:49:11.679] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:39:0) after 4m8s
[18:53:19.697] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:39:0)
[18:53:19.721] Build status: SCHEDULED
[18:53:19.721] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:40:0) after 8m33s
[19:01:52.878] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:40:0)
[19:01:52.921] Build status: SCHEDULED
[19:01:52.921] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:41:0) after 3m10s
[19:05:02.942] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:41:0)
[19:05:02.996] Build status: SCHEDULED
[19:05:02.996] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:42:0) after 2m32s
[19:07:35.117] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:42:0)
[19:07:35.218] Build status: SCHEDULED
[19:07:35.218] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:43:0) after 3m44s
[19:11:19.328] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:43:0)
[19:11:19.351] Build status: SCHEDULED
[19:11:19.351] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:44:0) after 2m24s
[19:13:43.451] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:44:0)
[19:13:43.472] Build status: SCHEDULED
[19:13:43.472] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:45:0) after 7m27s
[19:21:10.555] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:45:0)
[19:21:10.577] Build status: SCHEDULED
[19:21:10.577] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:46:0) after 7m0s
[19:28:10.607] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:46:0)
[19:28:10.659] Build status: SCHEDULED
[19:28:10.659] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:47:0) after 8m27s
[19:36:37.723] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:47:0)
[19:36:37.871] Build status: SCHEDULED
[19:36:37.871] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:48:0) after 7m23s
[19:44:01.165] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:48:0)
[19:44:01.189] Build status: SCHEDULED
[19:44:01.189] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:49:0) after 2m33s
[19:46:34.198] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:49:0)
[19:46:34.231] Build status: SCHEDULED
[19:46:34.231] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:50:0) after 8m21s
[19:54:55.253] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:50:0)
[19:54:55.293] Build status: SCHEDULED
[19:54:55.294] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:51:0) after 3m0s
[19:57:55.491] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:51:0)
[19:57:55.512] Build status: SCHEDULED
[19:57:55.512] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:52:0) after 8m1s
[20:05:56.811] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:52:0)
[20:05:56.834] Build status: SCHEDULED
[20:05:56.834] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:53:0) after 8m6s
[20:14:02.893] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:53:0)
[20:14:02.912] Build status: SCHEDULED
[20:14:02.912] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:54:0) after 5m51s
[20:19:54.088] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:54:0)
[20:19:54.111] Build status: SCHEDULED
[20:19:54.111] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:55:0) after 4m43s
[20:24:37.234] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:55:0)
[20:24:37.261] Build status: SCHEDULED
[20:24:37.261] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:56:0) after 1m43s
[20:26:20.351] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:56:0)
[20:26:20.379] Build status: SCHEDULED
[20:26:20.379] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:57:0) after 1m43s
[20:28:03.510] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:57:0)
[20:28:03.546] Build status: SCHEDULED
[20:28:03.546] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:58:0) after 1m35s
[20:29:38.672] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:58:0)
[20:29:38.692] Build status: SCHEDULED
[20:29:38.692] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:59:0) after 2m15s
[20:31:53.717] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:59:0)
[20:31:53.743] Build status: SCHEDULED
[20:31:53.743] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:60:0) after 4m44s
[20:36:37.814] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:60:0)
[20:36:37.836] Build status: SCHEDULED
[20:36:37.836] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:61:0) after 9m35s
[20:46:12.856] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:61:0)
[20:46:13.101] Build status: SCHEDULED
[20:46:13.101] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:62:0) after 7m29s
[20:53:42.289] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:62:0)
[20:53:42.314] Build status: SCHEDULED
[20:53:42.314] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:63:0) after 8m27s
[21:02:09.333] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:63:0)
[21:02:09.353] Build status: SCHEDULED
[21:02:09.353] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950346365837752624:64:0) after 5m29s
[21:07:02.987] Received PubSub notification, asking Buildbucket for the build status
[21:07:03.009] Build:
{
"id": "8784916303916773361",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60529,
"createdBy": "project:chromium",
"createTime": "2023-04-02T15:06:11.384241714Z",
"endTime": "2023-04-02T21:07:02.063988Z",
"updateTime": "2023-04-02T21:07:02.063988Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "705644553523b1884303d2d35ceef1d1358e81b8",
"ref": "refs/heads/main"
}
}
}
[21:07:03.009] Invocation finished in 6h0m52.841831136s with status FAILED