[21:18:11.542] New invocation is queued and will start shortly
[21:18:12.721] Starting the invocation (attempt 1)
[21:18:12.750] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/0ba95d50332926b9e99c7f276e386d6b94be7726"
[21:18:12.750] Popped gitiles commit info from properties and tags
[21:18:12.750] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:18:12.750] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:18:12.750] Buildbucket request:
{
"requestId": "8957389523574080944",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0ba95d50332926b9e99c7f276e386d6b94be7726",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8957389523574080944"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:18:13.234] Scheduled build:
{
"id": "8791959461579829665",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60205,
"createdBy": "project:chromium",
"createTime": "2023-01-14T21:18:12.814269890Z",
"updateTime": "2023-01-14T21:18:12.814269890Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0ba95d50332926b9e99c7f276e386d6b94be7726",
"ref": "refs/heads/main"
}
}
}
[21:18:13.234] Task URL: https://cr-buildbucket.appspot.com/build/8791959461579829665
[21:18:13.234] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:2:0) after 6m56s
[21:25:09.274] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:2:0)
[21:25:09.294] Build status: SCHEDULED
[21:25:09.294] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:3:0) after 2m48s
[21:27:57.322] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:3:0)
[21:27:57.341] Build status: SCHEDULED
[21:27:57.341] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:4:0) after 3m55s
[21:31:52.357] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:4:0)
[21:31:52.379] Build status: SCHEDULED
[21:31:52.379] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:5:0) after 6m20s
[21:38:12.397] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:5:0)
[21:38:12.430] Build status: SCHEDULED
[21:38:12.430] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:6:0) after 4m33s
[21:42:45.447] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:6:0)
[21:42:45.489] Build status: SCHEDULED
[21:42:45.489] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:7:0) after 3m5s
[21:45:50.509] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:7:0)
[21:45:50.540] Build status: SCHEDULED
[21:45:50.540] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:8:0) after 9m34s
[21:55:24.577] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:8:0)
[21:55:24.599] Build status: SCHEDULED
[21:55:24.599] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:9:0) after 7m41s
[22:03:05.616] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:9:0)
[22:03:05.639] Build status: SCHEDULED
[22:03:05.639] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:10:0) after 3m33s
[22:06:38.657] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:10:0)
[22:06:38.683] Build status: SCHEDULED
[22:06:38.683] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:11:0) after 1m18s
[22:07:56.665] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:11:0)
[22:07:56.715] Build status: SCHEDULED
[22:07:56.715] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:12:0) after 1m45s
[22:09:41.732] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:12:0)
[22:09:41.766] Build status: SCHEDULED
[22:09:41.766] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:13:0) after 7m6s
[22:16:47.796] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:13:0)
[22:16:47.818] Build status: SCHEDULED
[22:16:47.819] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:14:0) after 6m22s
[22:23:09.837] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:14:0)
[22:23:09.859] Build status: SCHEDULED
[22:23:09.859] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:15:0) after 9m33s
[22:32:43.035] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:15:0)
[22:32:43.066] Build status: SCHEDULED
[22:32:43.066] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:16:0) after 6m43s
[22:39:26.164] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:16:0)
[22:39:26.181] Build status: SCHEDULED
[22:39:26.181] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:17:0) after 5m3s
[22:44:29.333] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:17:0)
[22:44:29.359] Build status: SCHEDULED
[22:44:29.359] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:18:0) after 8m24s
[22:52:53.380] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:18:0)
[22:52:53.402] Build status: SCHEDULED
[22:52:53.402] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:19:0) after 1m11s
[22:54:04.433] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:19:0)
[22:54:04.459] Build status: SCHEDULED
[22:54:04.459] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:20:0) after 7m19s
[23:01:23.618] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:20:0)
[23:01:23.638] Build status: SCHEDULED
[23:01:23.638] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:21:0) after 4m33s
[23:05:56.727] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:21:0)
[23:05:56.751] Build status: SCHEDULED
[23:05:56.751] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:22:0) after 9m54s
[23:15:50.784] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:22:0)
[23:15:50.813] Build status: SCHEDULED
[23:15:50.813] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:23:0) after 5m43s
[23:21:33.839] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:23:0)
[23:21:33.905] Build status: SCHEDULED
[23:21:33.905] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:24:0) after 2m8s
[23:23:41.934] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:24:0)
[23:23:41.955] Build status: SCHEDULED
[23:23:41.955] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:25:0) after 7m4s
[23:30:46.008] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:25:0)
[23:30:46.032] Build status: SCHEDULED
[23:30:46.032] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:26:0) after 7m19s
[23:38:05.760] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:26:0)
[23:38:05.787] Build status: SCHEDULED
[23:38:05.787] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:27:0) after 9m9s
[23:47:14.804] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:27:0)
[23:47:14.824] Build status: SCHEDULED
[23:47:14.824] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:28:0) after 4m51s
[23:52:06.130] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:28:0)
[23:52:06.153] Build status: SCHEDULED
[23:52:06.153] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:29:0) after 7m34s
[23:59:40.173] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:29:0)
[23:59:40.236] Build status: SCHEDULED
[23:59:40.236] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:30:0) after 5m10s
[00:04:50.254] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:30:0)
[00:04:50.281] Build status: SCHEDULED
[00:04:50.281] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:31:0) after 3m30s
[00:08:20.257] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:31:0)
[00:08:20.301] Build status: SCHEDULED
[00:08:20.302] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:32:0) after 1m30s
[00:09:50.320] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:32:0)
[00:09:50.366] Build status: SCHEDULED
[00:09:50.366] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:33:0) after 1m22s
[00:11:12.393] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:33:0)
[00:11:12.415] Build status: SCHEDULED
[00:11:12.415] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:34:0) after 4m34s
[00:15:46.539] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:34:0)
[00:15:46.564] Build status: SCHEDULED
[00:15:46.564] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:35:0) after 6m46s
[00:22:32.612] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:35:0)
[00:22:32.638] Build status: SCHEDULED
[00:22:32.638] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:36:0) after 6m9s
[00:28:41.715] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:36:0)
[00:28:41.740] Build status: SCHEDULED
[00:28:41.740] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:37:0) after 3m46s
[00:32:29.499] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:37:0)
[00:32:29.598] Build status: SCHEDULED
[00:32:29.598] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:38:0) after 2m47s
[00:35:18.305] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:38:0)
[00:35:18.323] Build status: SCHEDULED
[00:35:18.323] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:39:0) after 3m2s
[00:38:20.360] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:39:0)
[00:38:20.381] Build status: SCHEDULED
[00:38:20.381] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:40:0) after 6m8s
[00:44:28.504] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:40:0)
[00:44:28.596] Build status: SCHEDULED
[00:44:28.596] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:41:0) after 5m17s
[00:49:45.617] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:41:0)
[00:49:45.643] Build status: SCHEDULED
[00:49:45.643] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:42:0) after 5m23s
[00:55:08.665] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:42:0)
[00:55:08.688] Build status: SCHEDULED
[00:55:08.688] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:43:0) after 1m34s
[00:56:42.702] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:43:0)
[00:56:42.728] Build status: SCHEDULED
[00:56:42.728] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:44:0) after 3m13s
[00:59:55.960] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:44:0)
[00:59:55.981] Build status: SCHEDULED
[00:59:55.981] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:45:0) after 2m24s
[01:02:19.992] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:45:0)
[01:02:20.021] Build status: SCHEDULED
[01:02:20.021] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:46:0) after 3m51s
[01:06:11.106] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:46:0)
[01:06:11.129] Build status: SCHEDULED
[01:06:11.129] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:47:0) after 1m48s
[01:07:59.214] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:47:0)
[01:07:59.238] Build status: SCHEDULED
[01:07:59.238] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:48:0) after 7m7s
[01:15:06.227] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:48:0)
[01:15:06.251] Build status: SCHEDULED
[01:15:06.251] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:49:0) after 1m46s
[01:16:52.309] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:49:0)
[01:16:52.329] Build status: SCHEDULED
[01:16:52.330] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:50:0) after 9m44s
[01:26:36.367] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:50:0)
[01:26:36.385] Build status: SCHEDULED
[01:26:36.385] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:51:0) after 9m10s
[01:35:46.411] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:51:0)
[01:35:46.429] Build status: SCHEDULED
[01:35:46.429] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:52:0) after 8m1s
[01:43:47.475] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:52:0)
[01:43:47.496] Build status: SCHEDULED
[01:43:47.496] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:53:0) after 4m46s
[01:48:33.516] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:53:0)
[01:48:33.545] Build status: SCHEDULED
[01:48:33.545] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:54:0) after 5m55s
[01:54:28.884] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:54:0)
[01:54:28.928] Build status: SCHEDULED
[01:54:28.928] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:55:0) after 2m33s
[01:57:02.048] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:55:0)
[01:57:02.070] Build status: SCHEDULED
[01:57:02.070] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:56:0) after 6m39s
[02:03:41.089] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:56:0)
[02:03:41.112] Build status: SCHEDULED
[02:03:41.112] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:57:0) after 9m30s
[02:13:11.154] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:57:0)
[02:13:11.172] Build status: SCHEDULED
[02:13:11.172] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:58:0) after 9m16s
[02:22:27.193] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:58:0)
[02:22:27.213] Build status: SCHEDULED
[02:22:27.213] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:59:0) after 9m37s
[02:32:04.381] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:59:0)
[02:32:04.403] Build status: SCHEDULED
[02:32:04.403] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:60:0) after 5m39s
[02:37:43.580] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:60:0)
[02:37:43.619] Build status: SCHEDULED
[02:37:43.619] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:61:0) after 7m44s
[02:45:27.629] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:61:0)
[02:45:27.662] Build status: SCHEDULED
[02:45:27.662] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:62:0) after 6m42s
[02:52:09.697] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:62:0)
[02:52:09.723] Build status: SCHEDULED
[02:52:09.723] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:63:0) after 5m22s
[02:57:31.985] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:63:0)
[02:57:32.003] Build status: SCHEDULED
[02:57:32.003] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:64:0) after 3m33s
[03:01:05.051] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:64:0)
[03:01:05.073] Build status: SCHEDULED
[03:01:05.073] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:65:0) after 9m12s
[03:10:17.106] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:65:0)
[03:10:17.126] Build status: SCHEDULED
[03:10:17.126] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:66:0) after 3m14s
[03:13:31.157] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:66:0)
[03:13:31.179] Build status: SCHEDULED
[03:13:31.179] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:67:0) after 1m25s
[03:14:56.232] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:67:0)
[03:14:56.258] Build status: SCHEDULED
[03:14:56.258] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957389523574080944:68:0) after 7m49s
[03:19:04.640] Received PubSub notification, asking Buildbucket for the build status
[03:19:04.675] Build:
{
"id": "8791959461579829665",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60205,
"createdBy": "project:chromium",
"createTime": "2023-01-14T21:18:12.814269890Z",
"endTime": "2023-01-15T03:19:01.852189Z",
"updateTime": "2023-01-15T03:19:01.852189Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0ba95d50332926b9e99c7f276e386d6b94be7726",
"ref": "refs/heads/main"
}
}
}
[03:19:04.675] Invocation finished in 6h0m53.147600137s with status FAILED