[21:38:12.282] New invocation is queued and will start shortly
[21:38:13.462] Starting the invocation (attempt 1)
[21:38:13.501] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d4e92f2f34e582fcba09eb71b4546d31821a2e4f"
[21:38:13.501] Popped gitiles commit info from properties and tags
[21:38:13.501] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:38:13.502] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:38:13.502] Buildbucket request:
{
"requestId": "8956935279674447712",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d4e92f2f34e582fcba09eb71b4546d31821a2e4f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8956935279674447712"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:38:13.956] Scheduled build:
{
"id": "8791505217655391089",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60225,
"createdBy": "project:chromium",
"createTime": "2023-01-19T21:38:13.578171654Z",
"updateTime": "2023-01-19T21:38:13.578171654Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d4e92f2f34e582fcba09eb71b4546d31821a2e4f",
"ref": "refs/heads/main"
}
}
}
[21:38:13.956] Task URL: https://cr-buildbucket.appspot.com/build/8791505217655391089
[21:38:13.956] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:2:0) after 4m52s
[21:43:06.139] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:2:0)
[21:43:06.165] Build status: SCHEDULED
[21:43:06.165] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:3:0) after 2m49s
[21:45:55.525] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:3:0)
[21:45:55.635] Build status: SCHEDULED
[21:45:55.635] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:4:0) after 8m7s
[21:54:02.746] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:4:0)
[21:54:02.785] Build status: SCHEDULED
[21:54:02.785] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:5:0) after 6m47s
[22:00:50.074] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:5:0)
[22:00:50.098] Build status: SCHEDULED
[22:00:50.098] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:6:0) after 7m36s
[22:08:26.134] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:6:0)
[22:08:26.171] Build status: SCHEDULED
[22:08:26.171] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:7:0) after 7m9s
[22:15:35.304] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:7:0)
[22:15:35.324] Build status: SCHEDULED
[22:15:35.324] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:8:0) after 8m53s
[22:24:28.423] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:8:0)
[22:24:28.665] Build status: SCHEDULED
[22:24:28.665] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:9:0) after 9m53s
[22:34:21.716] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:9:0)
[22:34:21.738] Build status: SCHEDULED
[22:34:21.738] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:10:0) after 3m20s
[22:37:41.835] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:10:0)
[22:37:41.860] Build status: SCHEDULED
[22:37:41.860] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:11:0) after 2m13s
[22:39:54.893] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:11:0)
[22:39:54.971] Build status: SCHEDULED
[22:39:54.971] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:12:0) after 8m3s
[22:47:58.230] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:12:0)
[22:47:58.259] Build status: SCHEDULED
[22:47:58.259] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:13:0) after 9m43s
[22:57:41.853] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:13:0)
[22:57:41.886] Build status: SCHEDULED
[22:57:41.886] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:14:0) after 6m35s
[23:04:16.957] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:14:0)
[23:04:16.998] Build status: SCHEDULED
[23:04:16.998] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:15:0) after 1m32s
[23:05:49.199] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:15:0)
[23:05:49.249] Build status: SCHEDULED
[23:05:49.249] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:16:0) after 6m53s
[23:12:42.520] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:16:0)
[23:12:42.608] Build status: SCHEDULED
[23:12:42.608] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:17:0) after 1m32s
[23:14:14.653] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:17:0)
[23:14:14.678] Build status: SCHEDULED
[23:14:14.678] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:18:0) after 2m8s
[23:16:23.111] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:18:0)
[23:16:23.134] Build status: SCHEDULED
[23:16:23.134] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:19:0) after 8m33s
[23:24:56.156] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:19:0)
[23:24:56.176] Build status: SCHEDULED
[23:24:56.176] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:20:0) after 7m1s
[23:31:57.329] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:20:0)
[23:31:57.357] Build status: SCHEDULED
[23:31:57.357] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:21:0) after 8m34s
[23:40:31.448] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:21:0)
[23:40:31.471] Build status: SCHEDULED
[23:40:31.471] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:22:0) after 9m22s
[23:49:53.739] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:22:0)
[23:49:53.803] Build status: SCHEDULED
[23:49:53.803] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:23:0) after 5m13s
[23:55:06.995] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:23:0)
[23:55:07.015] Build status: SCHEDULED
[23:55:07.015] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:24:0) after 6m34s
[00:01:41.081] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:24:0)
[00:01:41.101] Build status: SCHEDULED
[00:01:41.101] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:25:0) after 7m55s
[00:09:36.163] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:25:0)
[00:09:36.195] Build status: SCHEDULED
[00:09:36.195] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:26:0) after 5m16s
[00:14:52.284] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:26:0)
[00:14:52.310] Build status: SCHEDULED
[00:14:52.310] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:27:0) after 5m47s
[00:20:39.512] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:27:0)
[00:20:39.535] Build status: SCHEDULED
[00:20:39.535] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:28:0) after 6m17s
[00:26:56.621] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:28:0)
[00:26:56.713] Build status: SCHEDULED
[00:26:56.713] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:29:0) after 3m11s
[00:30:07.813] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:29:0)
[00:30:07.847] Build status: SCHEDULED
[00:30:07.847] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:30:0) after 6m5s
[00:36:12.870] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:30:0)
[00:36:12.889] Build status: SCHEDULED
[00:36:12.889] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:31:0) after 8m11s
[00:44:24.150] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:31:0)
[00:44:24.174] Build status: SCHEDULED
[00:44:24.174] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:32:0) after 7m57s
[00:52:21.381] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:32:0)
[00:52:21.411] Build status: SCHEDULED
[00:52:21.411] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:33:0) after 9m5s
[01:01:26.509] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:33:0)
[01:01:26.662] Build status: SCHEDULED
[01:01:26.663] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:34:0) after 9m0s
[01:10:26.745] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:34:0)
[01:10:26.773] Build status: SCHEDULED
[01:10:26.773] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:35:0) after 3m56s
[01:14:22.800] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:35:0)
[01:14:22.855] Build status: SCHEDULED
[01:14:22.855] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:36:0) after 6m5s
[01:20:27.886] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:36:0)
[01:20:27.907] Build status: SCHEDULED
[01:20:27.907] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:37:0) after 2m39s
[01:23:07.095] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:37:0)
[01:23:07.121] Build status: SCHEDULED
[01:23:07.121] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:38:0) after 9m38s
[01:32:45.207] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:38:0)
[01:32:45.232] Build status: SCHEDULED
[01:32:45.232] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:39:0) after 2m28s
[01:35:13.289] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:39:0)
[01:35:13.312] Build status: SCHEDULED
[01:35:13.313] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:40:0) after 3m15s
[01:38:28.347] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:40:0)
[01:38:28.383] Build status: SCHEDULED
[01:38:28.383] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:41:0) after 1m0s
[01:39:28.395] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:41:0)
[01:39:28.415] Build status: SCHEDULED
[01:39:28.415] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:42:0) after 2m51s
[01:42:19.654] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:42:0)
[01:42:19.678] Build status: SCHEDULED
[01:42:19.678] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:43:0) after 9m48s
[01:52:07.759] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:43:0)
[01:52:07.781] Build status: SCHEDULED
[01:52:07.781] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:44:0) after 4m35s
[01:56:42.895] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:44:0)
[01:56:42.922] Build status: SCHEDULED
[01:56:42.922] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:45:0) after 7m32s
[02:04:15.584] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:45:0)
[02:04:15.648] Build status: SCHEDULED
[02:04:15.648] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:46:0) after 2m32s
[02:06:47.802] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:46:0)
[02:06:47.825] Build status: SCHEDULED
[02:06:47.825] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:47:0) after 7m28s
[02:14:15.857] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:47:0)
[02:14:15.881] Build status: SCHEDULED
[02:14:15.881] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:48:0) after 9m33s
[02:23:49.002] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:48:0)
[02:23:49.029] Build status: SCHEDULED
[02:23:49.029] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:49:0) after 6m42s
[02:30:31.054] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:49:0)
[02:30:31.071] Build status: SCHEDULED
[02:30:31.072] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:50:0) after 9m55s
[02:40:26.292] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:50:0)
[02:40:26.318] Build status: SCHEDULED
[02:40:26.318] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:51:0) after 5m39s
[02:46:05.381] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:51:0)
[02:46:05.402] Build status: SCHEDULED
[02:46:05.402] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:52:0) after 1m35s
[02:47:40.434] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:52:0)
[02:47:40.456] Build status: SCHEDULED
[02:47:40.456] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:53:0) after 2m50s
[02:50:30.682] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:53:0)
[02:50:30.703] Build status: SCHEDULED
[02:50:30.703] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:54:0) after 4m53s
[02:55:24.297] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:54:0)
[02:55:24.324] Build status: SCHEDULED
[02:55:24.324] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:55:0) after 5m38s
[03:01:02.357] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:55:0)
[03:01:02.392] Build status: SCHEDULED
[03:01:02.392] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:56:0) after 6m35s
[03:07:37.423] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:56:0)
[03:07:37.446] Build status: SCHEDULED
[03:07:37.446] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:57:0) after 3m19s
[03:10:56.503] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:57:0)
[03:10:56.526] Build status: SCHEDULED
[03:10:56.526] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:58:0) after 2m36s
[03:13:32.593] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:58:0)
[03:13:32.613] Build status: SCHEDULED
[03:13:32.614] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:59:0) after 1m54s
[03:15:26.645] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:59:0)
[03:15:26.666] Build status: SCHEDULED
[03:15:26.666] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:60:0) after 3m24s
[03:18:51.010] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:60:0)
[03:18:51.032] Build status: SCHEDULED
[03:18:51.032] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:61:0) after 4m10s
[03:23:01.117] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:61:0)
[03:23:01.153] Build status: SCHEDULED
[03:23:01.153] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:62:0) after 5m46s
[03:28:47.184] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:62:0)
[03:28:47.245] Build status: SCHEDULED
[03:28:47.245] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:63:0) after 2m6s
[03:30:53.472] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:63:0)
[03:30:53.494] Build status: SCHEDULED
[03:30:53.494] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:64:0) after 7m53s
[03:38:46.663] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:64:0)
[03:38:46.682] Build status: SCHEDULED
[03:38:46.682] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956935279674447712:65:0) after 7m25s
[03:39:05.307] Received PubSub notification, asking Buildbucket for the build status
[03:39:05.326] Build:
{
"id": "8791505217655391089",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60225,
"createdBy": "project:chromium",
"createTime": "2023-01-19T21:38:13.578171654Z",
"endTime": "2023-01-20T03:39:04.586277Z",
"updateTime": "2023-01-20T03:39:04.586277Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d4e92f2f34e582fcba09eb71b4546d31821a2e4f",
"ref": "refs/heads/main"
}
}
}
[03:39:05.326] Invocation finished in 6h0m53.056416516s with status FAILED