[13:54:08.305] New invocation is queued and will start shortly
[13:54:09.388] Starting the invocation (attempt 1)
[13:54:09.418] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/79df138216eb4d7f007135c9de57b6cbd6521b20"
[13:54:09.418] Popped gitiles commit info from properties and tags
[13:54:09.418] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:54:09.418] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:54:09.419] Buildbucket request:
{
"requestId": "8950622688556475248",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "79df138216eb4d7f007135c9de57b6cbd6521b20",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8950622688556475248"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:54:09.893] Scheduled build:
{
"id": "8785192626657588545",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60517,
"createdBy": "project:chromium",
"createTime": "2023-03-30T13:54:09.483121911Z",
"updateTime": "2023-03-30T13:54:09.483121911Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "79df138216eb4d7f007135c9de57b6cbd6521b20",
"ref": "refs/heads/main"
}
}
}
[13:54:09.893] Task URL: https://cr-buildbucket.appspot.com/build/8785192626657588545
[13:54:09.893] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:2:0) after 9m6s
[14:03:16.060] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:2:0)
[14:03:16.254] Build status: SCHEDULED
[14:03:16.254] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:3:0) after 3m39s
[14:06:55.360] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:3:0)
[14:06:55.443] Build status: SCHEDULED
[14:06:55.443] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:4:0) after 5m18s
[14:12:13.480] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:4:0)
[14:12:13.644] Build status: SCHEDULED
[14:12:13.645] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:5:0) after 1m42s
[14:13:55.636] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:5:0)
[14:13:55.664] Build status: SCHEDULED
[14:13:55.664] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:6:0) after 4m37s
[14:18:32.879] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:6:0)
[14:18:32.992] Build status: SCHEDULED
[14:18:32.992] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:7:0) after 6m9s
[14:24:42.076] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:7:0)
[14:24:42.103] Build status: SCHEDULED
[14:24:42.103] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:8:0) after 9m7s
[14:33:49.273] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:8:0)
[14:33:49.349] Build status: SCHEDULED
[14:33:49.350] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:9:0) after 8m41s
[14:42:30.827] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:9:0)
[14:42:30.849] Build status: SCHEDULED
[14:42:30.849] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:10:0) after 6m58s
[14:49:28.868] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:10:0)
[14:49:28.892] Build status: SCHEDULED
[14:49:28.892] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:11:0) after 7m5s
[14:56:33.920] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:11:0)
[14:56:33.941] Build status: SCHEDULED
[14:56:33.941] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:12:0) after 1m20s
[14:57:53.973] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:12:0)
[14:57:53.993] Build status: SCHEDULED
[14:57:53.993] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:13:0) after 1m49s
[14:59:42.984] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:13:0)
[14:59:43.003] Build status: SCHEDULED
[14:59:43.003] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:14:0) after 5m53s
[15:05:36.031] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:14:0)
[15:05:36.065] Build status: SCHEDULED
[15:05:36.065] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:15:0) after 7m51s
[15:13:27.211] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:15:0)
[15:13:27.237] Build status: SCHEDULED
[15:13:27.237] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:16:0) after 2m27s
[15:15:54.342] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:16:0)
[15:15:54.362] Build status: SCHEDULED
[15:15:54.362] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:17:0) after 2m24s
[15:18:18.486] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:17:0)
[15:18:18.538] Build status: SCHEDULED
[15:18:18.538] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:18:0) after 7m15s
[15:25:33.608] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:18:0)
[15:25:33.635] Build status: SCHEDULED
[15:25:33.635] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:19:0) after 7m23s
[15:32:56.709] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:19:0)
[15:32:56.732] Build status: SCHEDULED
[15:32:56.732] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:20:0) after 8m25s
[15:41:21.754] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:20:0)
[15:41:21.776] Build status: SCHEDULED
[15:41:21.776] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:21:0) after 9m37s
[15:50:58.799] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:21:0)
[15:50:58.837] Build status: SCHEDULED
[15:50:58.837] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:22:0) after 7m12s
[15:58:10.912] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:22:0)
[15:58:10.933] Build status: SCHEDULED
[15:58:10.933] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:23:0) after 4m39s
[16:02:49.963] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:23:0)
[16:02:49.984] Build status: SCHEDULED
[16:02:49.984] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:24:0) after 9m45s
[16:12:35.035] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:24:0)
[16:12:35.137] Build status: SCHEDULED
[16:12:35.137] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:25:0) after 8m54s
[16:21:29.231] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:25:0)
[16:21:29.268] Build status: SCHEDULED
[16:21:29.268] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:26:0) after 2m21s
[16:23:50.578] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:26:0)
[16:23:50.602] Build status: SCHEDULED
[16:23:50.602] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:27:0) after 8m47s
[16:32:37.624] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:27:0)
[16:32:37.646] Build status: SCHEDULED
[16:32:37.646] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:28:0) after 3m19s
[16:35:56.758] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:28:0)
[16:35:56.794] Build status: SCHEDULED
[16:35:56.794] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:29:0) after 1m58s
[16:37:55.029] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:29:0)
[16:37:55.053] Build status: SCHEDULED
[16:37:55.053] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:30:0) after 2m4s
[16:39:59.232] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:30:0)
[16:39:59.254] Build status: SCHEDULED
[16:39:59.254] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:31:0) after 3m17s
[16:43:16.250] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:31:0)
[16:43:16.277] Build status: SCHEDULED
[16:43:16.278] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:32:0) after 7m11s
[16:50:27.353] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:32:0)
[16:50:27.384] Build status: SCHEDULED
[16:50:27.384] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:33:0) after 9m56s
[17:00:23.411] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:33:0)
[17:00:23.461] Build status: SCHEDULED
[17:00:23.462] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:34:0) after 5m52s
[17:06:15.441] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:34:0)
[17:06:15.465] Build status: SCHEDULED
[17:06:15.465] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:35:0) after 6m9s
[17:12:24.500] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:35:0)
[17:12:24.530] Build status: SCHEDULED
[17:12:24.530] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:36:0) after 4m0s
[17:16:24.559] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:36:0)
[17:16:24.606] Build status: SCHEDULED
[17:16:24.606] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:37:0) after 2m50s
[17:19:14.679] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:37:0)
[17:19:14.721] Build status: SCHEDULED
[17:19:14.721] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:38:0) after 9m56s
[17:29:10.759] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:38:0)
[17:29:10.782] Build status: SCHEDULED
[17:29:10.782] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:39:0) after 4m39s
[17:33:49.816] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:39:0)
[17:33:49.835] Build status: SCHEDULED
[17:33:49.835] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:40:0) after 4m17s
[17:38:06.859] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:40:0)
[17:38:06.897] Build status: SCHEDULED
[17:38:06.897] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:41:0) after 8m12s
[17:46:19.293] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:41:0)
[17:46:19.315] Build status: SCHEDULED
[17:46:19.315] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:42:0) after 8m14s
[17:54:33.368] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:42:0)
[17:54:33.393] Build status: SCHEDULED
[17:54:33.393] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:43:0) after 6m29s
[18:01:02.677] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:43:0)
[18:01:02.699] Build status: SCHEDULED
[18:01:02.699] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:44:0) after 9m26s
[18:10:29.028] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:44:0)
[18:10:29.051] Build status: SCHEDULED
[18:10:29.051] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:45:0) after 2m40s
[18:13:09.197] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:45:0)
[18:13:09.315] Build status: SCHEDULED
[18:13:09.315] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:46:0) after 1m59s
[18:15:08.369] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:46:0)
[18:15:08.401] Build status: SCHEDULED
[18:15:08.401] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:47:0) after 8m54s
[18:24:02.395] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:47:0)
[18:24:02.418] Build status: SCHEDULED
[18:24:02.418] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:48:0) after 9m55s
[18:33:57.818] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:48:0)
[18:33:57.842] Build status: SCHEDULED
[18:33:57.842] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:49:0) after 4m3s
[18:38:01.003] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:49:0)
[18:38:01.055] Build status: SCHEDULED
[18:38:01.055] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:50:0) after 2m55s
[18:40:56.829] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:50:0)
[18:40:56.904] Build status: SCHEDULED
[18:40:56.904] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:51:0) after 7m44s
[18:48:41.052] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:51:0)
[18:48:41.077] Build status: SCHEDULED
[18:48:41.077] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:52:0) after 6m7s
[18:54:48.131] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:52:0)
[18:54:48.169] Build status: SCHEDULED
[18:54:48.169] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:53:0) after 9m54s
[19:04:42.221] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:53:0)
[19:04:42.250] Build status: SCHEDULED
[19:04:42.250] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:54:0) after 8m28s
[19:13:10.356] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:54:0)
[19:13:10.388] Build status: SCHEDULED
[19:13:10.388] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:55:0) after 9m11s
[19:22:21.442] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:55:0)
[19:22:21.491] Build status: SCHEDULED
[19:22:21.491] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:56:0) after 5m39s
[19:28:00.570] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:56:0)
[19:28:00.598] Build status: SCHEDULED
[19:28:00.598] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:57:0) after 1m36s
[19:29:36.722] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:57:0)
[19:29:36.744] Build status: SCHEDULED
[19:29:36.744] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:58:0) after 1m26s
[19:31:03.134] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:58:0)
[19:31:03.159] Build status: SCHEDULED
[19:31:03.159] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:59:0) after 2m29s
[19:33:32.320] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:59:0)
[19:33:32.355] Build status: SCHEDULED
[19:33:32.355] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:60:0) after 7m9s
[19:40:41.415] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:60:0)
[19:40:41.442] Build status: SCHEDULED
[19:40:41.442] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:61:0) after 7m54s
[19:48:35.571] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:61:0)
[19:48:35.635] Build status: SCHEDULED
[19:48:35.635] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:62:0) after 2m31s
[19:51:06.669] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:62:0)
[19:51:06.691] Build status: SCHEDULED
[19:51:06.691] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:63:0) after 1m15s
[19:52:21.715] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:63:0)
[19:52:21.741] Build status: SCHEDULED
[19:52:21.741] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950622688556475248:64:0) after 4m43s
[19:55:07.915] Received PubSub notification, asking Buildbucket for the build status
[19:55:07.944] Build:
{
"id": "8785192626657588545",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60517,
"createdBy": "project:chromium",
"createTime": "2023-03-30T13:54:09.483121911Z",
"endTime": "2023-03-30T19:55:05.903965Z",
"updateTime": "2023-03-30T19:55:05.903965Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "79df138216eb4d7f007135c9de57b6cbd6521b20",
"ref": "refs/heads/main"
}
}
}
[19:55:07.944] Invocation finished in 6h0m59.655612873s with status FAILED