[10:20:07.525] New invocation is queued and will start shortly
[10:20:08.666] Starting the invocation (attempt 1)
[10:20:08.708] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/094b3669f84ef41d1a3c63cf42eb884269f7002d"
[10:20:08.708] Popped gitiles commit info from properties and tags
[10:20:08.708] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:20:08.708] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:20:08.708] Buildbucket request:
{
"requestId": "8955981374101741728",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "094b3669f84ef41d1a3c63cf42eb884269f7002d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8955981374101741728"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:20:09.260] Scheduled build:
{
"id": "8790551312124560449",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60267,
"createdBy": "project:chromium",
"createTime": "2023-01-30T10:20:08.783337513Z",
"updateTime": "2023-01-30T10:20:08.783337513Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "094b3669f84ef41d1a3c63cf42eb884269f7002d",
"ref": "refs/heads/main"
}
}
}
[10:20:09.260] Task URL: https://cr-buildbucket.appspot.com/build/8790551312124560449
[10:20:09.260] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:2:0) after 7m52s
[10:28:01.247] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:2:0)
[10:28:01.277] Build status: SCHEDULED
[10:28:01.277] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:3:0) after 4m28s
[10:32:29.399] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:3:0)
[10:32:29.461] Build status: SCHEDULED
[10:32:29.461] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:4:0) after 6m49s
[10:39:18.595] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:4:0)
[10:39:18.620] Build status: SCHEDULED
[10:39:18.620] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:5:0) after 9m8s
[10:48:26.641] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:5:0)
[10:48:26.662] Build status: SCHEDULED
[10:48:26.662] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:6:0) after 9m43s
[10:58:09.681] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:6:0)
[10:58:09.711] Build status: SCHEDULED
[10:58:09.711] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:7:0) after 9m7s
[11:07:16.740] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:7:0)
[11:07:16.770] Build status: SCHEDULED
[11:07:16.770] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:8:0) after 6m5s
[11:13:21.869] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:8:0)
[11:13:21.897] Build status: SCHEDULED
[11:13:21.897] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:9:0) after 2m38s
[11:15:59.916] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:9:0)
[11:15:59.939] Build status: SCHEDULED
[11:15:59.939] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:10:0) after 1m23s
[11:17:22.969] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:10:0)
[11:17:22.988] Build status: SCHEDULED
[11:17:22.988] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:11:0) after 2m56s
[11:20:19.107] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:11:0)
[11:20:19.130] Build status: SCHEDULED
[11:20:19.130] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:12:0) after 4m31s
[11:24:50.149] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:12:0)
[11:24:50.169] Build status: SCHEDULED
[11:24:50.169] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:13:0) after 3m51s
[11:28:41.260] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:13:0)
[11:28:41.282] Build status: SCHEDULED
[11:28:41.282] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:14:0) after 6m32s
[11:35:13.386] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:14:0)
[11:35:13.474] Build status: SCHEDULED
[11:35:13.474] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:15:0) after 2m40s
[11:37:53.495] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:15:0)
[11:37:53.516] Build status: SCHEDULED
[11:37:53.516] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:16:0) after 4m11s
[11:42:04.637] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:16:0)
[11:42:04.662] Build status: SCHEDULED
[11:42:04.662] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:17:0) after 7m24s
[11:49:28.692] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:17:0)
[11:49:28.717] Build status: SCHEDULED
[11:49:28.717] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:18:0) after 9m33s
[11:59:01.737] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:18:0)
[11:59:01.760] Build status: SCHEDULED
[11:59:01.760] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:19:0) after 7m56s
[12:06:57.778] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:19:0)
[12:06:57.803] Build status: SCHEDULED
[12:06:57.803] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:20:0) after 5m23s
[12:12:20.923] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:20:0)
[12:12:20.948] Build status: SCHEDULED
[12:12:20.948] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:21:0) after 6m10s
[12:18:30.974] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:21:0)
[12:18:30.997] Build status: SCHEDULED
[12:18:30.997] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:22:0) after 9m58s
[12:28:29.106] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:22:0)
[12:28:29.128] Build status: SCHEDULED
[12:28:29.128] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:23:0) after 3m40s
[12:32:09.249] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:23:0)
[12:32:09.296] Build status: SCHEDULED
[12:32:09.296] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:24:0) after 5m12s
[12:37:21.309] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:24:0)
[12:37:21.349] Build status: SCHEDULED
[12:37:21.349] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:25:0) after 3m30s
[12:40:51.375] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:25:0)
[12:40:51.396] Build status: SCHEDULED
[12:40:51.396] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:26:0) after 6m22s
[12:47:13.417] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:26:0)
[12:47:13.445] Build status: SCHEDULED
[12:47:13.445] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:27:0) after 9m19s
[12:56:32.473] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:27:0)
[12:56:32.493] Build status: SCHEDULED
[12:56:32.493] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:28:0) after 1m21s
[12:57:53.518] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:28:0)
[12:57:53.542] Build status: SCHEDULED
[12:57:53.542] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:29:0) after 6m58s
[13:04:51.775] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:29:0)
[13:04:51.809] Build status: SCHEDULED
[13:04:51.809] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:30:0) after 5m19s
[13:10:11.025] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:30:0)
[13:10:11.044] Build status: SCHEDULED
[13:10:11.044] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:31:0) after 6m37s
[13:16:48.067] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:31:0)
[13:16:48.093] Build status: SCHEDULED
[13:16:48.093] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:32:0) after 7m44s
[13:24:32.114] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:32:0)
[13:24:32.173] Build status: SCHEDULED
[13:24:32.173] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:33:0) after 3m47s
[13:28:19.212] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:33:0)
[13:28:19.231] Build status: SCHEDULED
[13:28:19.232] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:34:0) after 2m23s
[13:30:42.442] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:34:0)
[13:30:42.481] Build status: SCHEDULED
[13:30:42.481] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:35:0) after 6m37s
[13:37:19.506] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:35:0)
[13:37:19.526] Build status: SCHEDULED
[13:37:19.526] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:36:0) after 6m2s
[13:43:21.630] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:36:0)
[13:43:21.652] Build status: SCHEDULED
[13:43:21.652] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:37:0) after 2m32s
[13:45:53.881] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:37:0)
[13:45:53.900] Build status: SCHEDULED
[13:45:53.900] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:38:0) after 7m40s
[13:53:33.920] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:38:0)
[13:53:33.943] Build status: SCHEDULED
[13:53:33.943] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:39:0) after 7m45s
[14:01:18.963] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:39:0)
[14:01:18.992] Build status: SCHEDULED
[14:01:18.993] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:40:0) after 5m51s
[14:07:10.105] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:40:0)
[14:07:10.134] Build status: SCHEDULED
[14:07:10.134] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:41:0) after 1m11s
[14:08:21.154] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:41:0)
[14:08:21.176] Build status: SCHEDULED
[14:08:21.176] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:42:0) after 4m23s
[14:12:44.313] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:42:0)
[14:12:44.338] Build status: SCHEDULED
[14:12:44.338] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:43:0) after 8m20s
[14:21:04.382] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:43:0)
[14:21:04.442] Build status: SCHEDULED
[14:21:04.442] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:44:0) after 3m22s
[14:24:26.566] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:44:0)
[14:24:26.592] Build status: SCHEDULED
[14:24:26.592] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:45:0) after 3m36s
[14:28:02.621] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:45:0)
[14:28:02.647] Build status: SCHEDULED
[14:28:02.647] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:46:0) after 4m41s
[14:32:43.729] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:46:0)
[14:32:43.755] Build status: SCHEDULED
[14:32:43.755] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:47:0) after 2m35s
[14:35:18.891] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:47:0)
[14:35:18.924] Build status: SCHEDULED
[14:35:18.924] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:48:0) after 8m27s
[14:43:45.953] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:48:0)
[14:43:45.977] Build status: SCHEDULED
[14:43:45.977] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:49:0) after 6m47s
[14:50:33.147] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:49:0)
[14:50:33.298] Build status: SCHEDULED
[14:50:33.298] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:50:0) after 2m25s
[14:52:58.406] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:50:0)
[14:52:58.427] Build status: SCHEDULED
[14:52:58.427] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:51:0) after 1m33s
[14:54:31.588] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:51:0)
[14:54:31.611] Build status: SCHEDULED
[14:54:31.611] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:52:0) after 9m18s
[15:03:49.841] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:52:0)
[15:03:49.920] Build status: SCHEDULED
[15:03:49.920] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:53:0) after 3m33s
[15:07:22.940] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:53:0)
[15:07:22.976] Build status: SCHEDULED
[15:07:22.976] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:54:0) after 6m57s
[15:14:20.000] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:54:0)
[15:14:20.023] Build status: SCHEDULED
[15:14:20.023] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:55:0) after 8m8s
[15:22:28.237] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:55:0)
[15:22:28.315] Build status: SCHEDULED
[15:22:28.315] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:56:0) after 4m3s
[15:26:31.936] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:56:0)
[15:26:31.969] Build status: SCHEDULED
[15:26:31.969] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:57:0) after 8m38s
[15:35:10.241] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:57:0)
[15:35:10.268] Build status: SCHEDULED
[15:35:10.268] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:58:0) after 1m22s
[15:36:32.366] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:58:0)
[15:36:32.388] Build status: SCHEDULED
[15:36:32.388] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:59:0) after 6m48s
[15:43:20.647] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:59:0)
[15:43:20.715] Build status: SCHEDULED
[15:43:20.715] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:60:0) after 6m12s
[15:49:32.738] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:60:0)
[15:49:32.761] Build status: SCHEDULED
[15:49:32.761] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:61:0) after 3m48s
[15:53:20.880] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:61:0)
[15:53:20.899] Build status: SCHEDULED
[15:53:20.899] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:62:0) after 4m44s
[15:58:05.072] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:62:0)
[15:58:05.104] Build status: SCHEDULED
[15:58:05.104] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:63:0) after 1m59s
[16:00:04.175] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:63:0)
[16:00:04.209] Build status: SCHEDULED
[16:00:04.209] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:64:0) after 6m25s
[16:06:29.234] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:64:0)
[16:06:29.293] Build status: SCHEDULED
[16:06:29.293] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:65:0) after 6m14s
[16:12:43.545] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:65:0)
[16:12:43.568] Build status: SCHEDULED
[16:12:43.568] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:66:0) after 5m31s
[16:18:14.950] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:66:0)
[16:18:14.971] Build status: SCHEDULED
[16:18:14.971] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955981374101741728:67:0) after 7m1s
[16:21:05.860] Received PubSub notification, asking Buildbucket for the build status
[16:21:05.898] Build:
{
"id": "8790551312124560449",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60267,
"createdBy": "project:chromium",
"createTime": "2023-01-30T10:20:08.783337513Z",
"endTime": "2023-01-30T16:21:05.210834Z",
"updateTime": "2023-01-30T16:21:05.210834Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "094b3669f84ef41d1a3c63cf42eb884269f7002d",
"ref": "refs/heads/main"
}
}
}
[16:21:05.898] Invocation finished in 6h0m58.383483898s with status FAILED