[05:21:04.974] New invocation is queued and will start shortly
[05:21:06.167] Starting the invocation (attempt 1)
[05:21:06.194] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/735f0848d9633683ea8d9f1cbb9f2d5b9ba2e5f9"
[05:21:06.194] Popped gitiles commit info from properties and tags
[05:21:06.194] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:21:06.194] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:21:06.194] Buildbucket request:
{
"requestId": "8947212282494130704",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "735f0848d9633683ea8d9f1cbb9f2d5b9ba2e5f9",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8947212282494130704"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[05:21:06.741] Scheduled build:
{
"id": "8781782220394868161",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60667,
"createdBy": "project:chromium",
"createTime": "2023-05-07T05:21:06.344791760Z",
"updateTime": "2023-05-07T05:21:06.344791760Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "735f0848d9633683ea8d9f1cbb9f2d5b9ba2e5f9",
"ref": "refs/heads/main"
}
}
}
[05:21:06.742] Task URL: https://cr-buildbucket.appspot.com/build/8781782220394868161
[05:21:06.742] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:2:0) after 6m14s
[05:27:20.980] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:2:0)
[05:27:21.011] Build status: SCHEDULED
[05:27:21.011] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:3:0) after 9m16s
[05:36:37.027] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:3:0)
[05:36:37.048] Build status: SCHEDULED
[05:36:37.048] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:4:0) after 2m6s
[05:38:43.067] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:4:0)
[05:38:43.093] Build status: SCHEDULED
[05:38:43.093] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:5:0) after 5m36s
[05:44:19.173] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:5:0)
[05:44:19.191] Build status: SCHEDULED
[05:44:19.191] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:6:0) after 3m25s
[05:47:44.363] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:6:0)
[05:47:44.380] Build status: SCHEDULED
[05:47:44.381] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:7:0) after 8m18s
[05:56:02.413] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:7:0)
[05:56:02.433] Build status: SCHEDULED
[05:56:02.433] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:8:0) after 4m26s
[06:00:28.452] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:8:0)
[06:00:28.479] Build status: SCHEDULED
[06:00:28.479] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:9:0) after 6m58s
[06:07:26.493] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:9:0)
[06:07:26.528] Build status: SCHEDULED
[06:07:26.528] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:10:0) after 7m25s
[06:14:51.549] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:10:0)
[06:14:51.568] Build status: SCHEDULED
[06:14:51.569] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:11:0) after 8m7s
[06:22:58.669] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:11:0)
[06:22:58.771] Build status: SCHEDULED
[06:22:58.771] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:12:0) after 2m21s
[06:25:19.786] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:12:0)
[06:25:19.819] Build status: SCHEDULED
[06:25:19.820] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:13:0) after 5m12s
[06:30:31.994] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:13:0)
[06:30:32.012] Build status: SCHEDULED
[06:30:32.012] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:14:0) after 4m4s
[06:34:36.030] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:14:0)
[06:34:36.049] Build status: SCHEDULED
[06:34:36.049] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:15:0) after 9m40s
[06:44:16.065] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:15:0)
[06:44:16.083] Build status: SCHEDULED
[06:44:16.083] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:16:0) after 2m58s
[06:47:14.098] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:16:0)
[06:47:14.176] Build status: SCHEDULED
[06:47:14.176] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:17:0) after 3m13s
[06:50:27.197] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:17:0)
[06:50:27.216] Build status: SCHEDULED
[06:50:27.216] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:18:0) after 9m24s
[06:59:51.343] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:18:0)
[06:59:51.384] Build status: SCHEDULED
[06:59:51.384] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:19:0) after 6m47s
[07:06:38.421] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:19:0)
[07:06:38.456] Build status: SCHEDULED
[07:06:38.456] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:20:0) after 5m46s
[07:12:24.470] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:20:0)
[07:12:24.490] Build status: SCHEDULED
[07:12:24.490] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:21:0) after 5m47s
[07:18:11.529] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:21:0)
[07:18:11.548] Build status: SCHEDULED
[07:18:11.548] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:22:0) after 7m20s
[07:25:31.565] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:22:0)
[07:25:31.616] Build status: SCHEDULED
[07:25:31.616] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:23:0) after 9m56s
[07:35:27.731] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:23:0)
[07:35:27.753] Build status: SCHEDULED
[07:35:27.753] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:24:0) after 4m29s
[07:39:56.770] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:24:0)
[07:39:56.789] Build status: SCHEDULED
[07:39:56.789] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:25:0) after 7m43s
[07:47:39.810] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:25:0)
[07:47:39.835] Build status: SCHEDULED
[07:47:39.835] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:26:0) after 1m49s
[07:49:28.851] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:26:0)
[07:49:28.872] Build status: SCHEDULED
[07:49:28.872] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:27:0) after 3m30s
[07:52:58.888] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:27:0)
[07:52:58.907] Build status: SCHEDULED
[07:52:58.907] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:28:0) after 7m26s
[08:00:24.924] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:28:0)
[08:00:24.946] Build status: SCHEDULED
[08:00:24.946] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:29:0) after 5m48s
[08:06:13.074] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:29:0)
[08:06:13.134] Build status: SCHEDULED
[08:06:13.134] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:30:0) after 8m42s
[08:14:55.475] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:30:0)
[08:14:55.492] Build status: SCHEDULED
[08:14:55.493] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:31:0) after 6m20s
[08:21:15.604] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:31:0)
[08:21:15.620] Build status: SCHEDULED
[08:21:15.620] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:32:0) after 6m30s
[08:27:45.638] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:32:0)
[08:27:45.657] Build status: SCHEDULED
[08:27:45.657] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:33:0) after 2m56s
[08:30:41.679] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:33:0)
[08:30:41.697] Build status: SCHEDULED
[08:30:41.697] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:34:0) after 2m48s
[08:33:30.007] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:34:0)
[08:33:30.026] Build status: SCHEDULED
[08:33:30.026] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:35:0) after 6m50s
[08:40:20.238] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:35:0)
[08:40:20.257] Build status: SCHEDULED
[08:40:20.257] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:36:0) after 6m22s
[08:46:42.340] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:36:0)
[08:46:42.445] Build status: SCHEDULED
[08:46:42.445] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:37:0) after 7m53s
[08:54:35.468] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:37:0)
[08:54:35.659] Build status: SCHEDULED
[08:54:35.659] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:38:0) after 5m46s
[09:00:21.642] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:38:0)
[09:00:21.663] Build status: SCHEDULED
[09:00:21.663] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:39:0) after 8m47s
[09:09:08.679] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:39:0)
[09:09:08.698] Build status: SCHEDULED
[09:09:08.698] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:40:0) after 9m30s
[09:18:38.811] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:40:0)
[09:18:38.835] Build status: SCHEDULED
[09:18:38.835] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:41:0) after 1m56s
[09:20:34.843] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:41:0)
[09:20:34.863] Build status: SCHEDULED
[09:20:34.863] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:42:0) after 9m17s
[09:29:51.938] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:42:0)
[09:29:51.983] Build status: SCHEDULED
[09:29:51.983] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:43:0) after 6m31s
[09:36:23.005] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:43:0)
[09:36:23.023] Build status: SCHEDULED
[09:36:23.023] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:44:0) after 5m6s
[09:41:29.105] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:44:0)
[09:41:29.123] Build status: SCHEDULED
[09:41:29.123] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:45:0) after 6m36s
[09:48:05.138] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:45:0)
[09:48:05.155] Build status: SCHEDULED
[09:48:05.155] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:46:0) after 6m38s
[09:54:43.221] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:46:0)
[09:54:43.240] Build status: SCHEDULED
[09:54:43.240] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:47:0) after 8m57s
[10:03:40.274] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:47:0)
[10:03:40.302] Build status: SCHEDULED
[10:03:40.302] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:48:0) after 2m43s
[10:06:23.305] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:48:0)
[10:06:23.325] Build status: SCHEDULED
[10:06:23.325] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:49:0) after 4m7s
[10:10:30.528] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:49:0)
[10:10:30.547] Build status: SCHEDULED
[10:10:30.547] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:50:0) after 7m6s
[10:17:36.817] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:50:0)
[10:17:36.836] Build status: SCHEDULED
[10:17:36.836] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:51:0) after 3m50s
[10:21:26.855] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:51:0)
[10:21:26.966] Build status: SCHEDULED
[10:21:26.966] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:52:0) after 7m43s
[10:29:09.982] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:52:0)
[10:29:10.024] Build status: SCHEDULED
[10:29:10.024] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:53:0) after 5m8s
[10:34:18.334] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:53:0)
[10:34:18.358] Build status: SCHEDULED
[10:34:18.359] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:54:0) after 3m9s
[10:37:27.375] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:54:0)
[10:37:27.394] Build status: SCHEDULED
[10:37:27.394] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:55:0) after 8m23s
[10:45:50.537] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:55:0)
[10:45:50.556] Build status: SCHEDULED
[10:45:50.556] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:56:0) after 3m11s
[10:49:01.913] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:56:0)
[10:49:01.933] Build status: SCHEDULED
[10:49:01.933] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:57:0) after 3m13s
[10:52:14.953] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:57:0)
[10:52:14.973] Build status: SCHEDULED
[10:52:14.973] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:58:0) after 2m23s
[10:54:38.303] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:58:0)
[10:54:38.321] Build status: SCHEDULED
[10:54:38.321] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:59:0) after 7m23s
[11:02:01.348] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:59:0)
[11:02:01.370] Build status: SCHEDULED
[11:02:01.370] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:60:0) after 9m10s
[11:11:11.401] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:60:0)
[11:11:11.431] Build status: SCHEDULED
[11:11:11.431] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:61:0) after 8m39s
[11:19:50.450] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:61:0)
[11:19:50.471] Build status: SCHEDULED
[11:19:50.471] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947212282494130704:62:0) after 3m42s
[11:22:06.999] Received PubSub notification, asking Buildbucket for the build status
[11:22:07.020] Build:
{
"id": "8781782220394868161",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60667,
"createdBy": "project:chromium",
"createTime": "2023-05-07T05:21:06.344791760Z",
"endTime": "2023-05-07T11:22:06.001388Z",
"updateTime": "2023-05-07T11:22:06.001388Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "735f0848d9633683ea8d9f1cbb9f2d5b9ba2e5f9",
"ref": "refs/heads/main"
}
}
}
[11:22:07.020] Invocation finished in 6h1m2.061601647s with status FAILED