[08:38:05.352] New invocation is queued and will start shortly
[08:38:06.603] Starting the invocation (attempt 1)
[08:38:06.651] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/5b6979c43621893d550e829e4e68ef13980a2415"
[08:38:06.651] Popped gitiles commit info from properties and tags
[08:38:06.651] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:38:06.651] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:38:06.651] Buildbucket request:
{
"requestId": "8953179287705874896",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5b6979c43621893d550e829e4e68ef13980a2415",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8953179287705874896"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:38:07.233] Scheduled build:
{
"id": "8787749225548495809",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60387,
"createdBy": "project:chromium",
"createTime": "2023-03-02T08:38:06.783443428Z",
"updateTime": "2023-03-02T08:38:06.783443428Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5b6979c43621893d550e829e4e68ef13980a2415",
"ref": "refs/heads/main"
}
}
}
[08:38:07.233] Task URL: https://cr-buildbucket.appspot.com/build/8787749225548495809
[08:38:07.233] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:2:0) after 8m39s
[08:46:46.401] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:2:0)
[08:46:46.421] Build status: SCHEDULED
[08:46:46.421] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:3:0) after 4m53s
[08:51:39.667] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:3:0)
[08:51:39.690] Build status: SCHEDULED
[08:51:39.690] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:4:0) after 9m43s
[09:01:22.709] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:4:0)
[09:01:22.748] Build status: SCHEDULED
[09:01:22.748] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:5:0) after 9m27s
[09:10:49.865] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:5:0)
[09:10:49.887] Build status: SCHEDULED
[09:10:49.887] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:6:0) after 9m53s
[09:20:42.909] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:6:0)
[09:20:42.934] Build status: SCHEDULED
[09:20:42.934] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:7:0) after 4m56s
[09:25:38.956] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:7:0)
[09:25:38.975] Build status: SCHEDULED
[09:25:38.975] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:8:0) after 5m31s
[09:31:10.001] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:8:0)
[09:31:10.020] Build status: SCHEDULED
[09:31:10.020] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:9:0) after 4m18s
[09:35:28.232] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:9:0)
[09:35:28.254] Build status: SCHEDULED
[09:35:28.254] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:10:0) after 1m48s
[09:37:16.349] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:10:0)
[09:37:16.387] Build status: SCHEDULED
[09:37:16.387] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:11:0) after 6m14s
[09:43:30.634] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:11:0)
[09:43:30.653] Build status: SCHEDULED
[09:43:30.653] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:12:0) after 9m26s
[09:52:56.914] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:12:0)
[09:52:56.957] Build status: SCHEDULED
[09:52:56.957] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:13:0) after 1m36s
[09:54:33.077] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:13:0)
[09:54:33.103] Build status: SCHEDULED
[09:54:33.103] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:14:0) after 8m10s
[10:02:43.239] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:14:0)
[10:02:43.267] Build status: SCHEDULED
[10:02:43.267] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:15:0) after 7m17s
[10:10:00.290] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:15:0)
[10:10:00.320] Build status: SCHEDULED
[10:10:00.320] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:16:0) after 6m56s
[10:16:56.457] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:16:0)
[10:16:56.478] Build status: SCHEDULED
[10:16:56.478] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:17:0) after 6m52s
[10:23:48.710] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:17:0)
[10:23:48.730] Build status: SCHEDULED
[10:23:48.730] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:18:0) after 9m42s
[10:33:30.762] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:18:0)
[10:33:30.785] Build status: SCHEDULED
[10:33:30.785] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:19:0) after 9m42s
[10:43:13.137] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:19:0)
[10:43:13.336] Build status: SCHEDULED
[10:43:13.336] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:20:0) after 5m40s
[10:48:53.472] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:20:0)
[10:48:53.490] Build status: SCHEDULED
[10:48:53.490] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:21:0) after 4m23s
[10:53:16.770] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:21:0)
[10:53:16.793] Build status: SCHEDULED
[10:53:16.793] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:22:0) after 2m21s
[10:55:37.823] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:22:0)
[10:55:37.849] Build status: SCHEDULED
[10:55:37.849] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:23:0) after 7m30s
[11:03:08.058] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:23:0)
[11:03:08.080] Build status: SCHEDULED
[11:03:08.080] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:24:0) after 8m46s
[11:11:54.261] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:24:0)
[11:11:54.288] Build status: SCHEDULED
[11:11:54.288] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:25:0) after 2m16s
[11:14:10.311] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:25:0)
[11:14:10.389] Build status: SCHEDULED
[11:14:10.389] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:26:0) after 1m0s
[11:15:10.630] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:26:0)
[11:15:10.657] Build status: SCHEDULED
[11:15:10.657] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:27:0) after 4m2s
[11:19:12.677] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:27:0)
[11:19:12.698] Build status: SCHEDULED
[11:19:12.698] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:28:0) after 8m19s
[11:27:31.779] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:28:0)
[11:27:31.800] Build status: SCHEDULED
[11:27:31.800] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:29:0) after 6m32s
[11:34:04.040] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:29:0)
[11:34:04.063] Build status: SCHEDULED
[11:34:04.063] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:30:0) after 3m27s
[11:37:31.800] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:30:0)
[11:37:31.821] Build status: SCHEDULED
[11:37:31.821] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:31:0) after 9m13s
[11:46:44.917] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:31:0)
[11:46:44.940] Build status: SCHEDULED
[11:46:44.940] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:32:0) after 6m6s
[11:52:51.067] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:32:0)
[11:52:51.085] Build status: SCHEDULED
[11:52:51.085] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:33:0) after 7m49s
[12:00:40.158] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:33:0)
[12:00:40.188] Build status: SCHEDULED
[12:00:40.188] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:34:0) after 2m43s
[12:03:23.292] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:34:0)
[12:03:23.312] Build status: SCHEDULED
[12:03:23.312] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:35:0) after 8m37s
[12:12:00.438] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:35:0)
[12:12:00.489] Build status: SCHEDULED
[12:12:00.489] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:36:0) after 8m50s
[12:20:50.585] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:36:0)
[12:20:50.611] Build status: SCHEDULED
[12:20:50.612] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:37:0) after 1m42s
[12:22:32.607] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:37:0)
[12:22:32.858] Build status: SCHEDULED
[12:22:32.858] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:38:0) after 2m19s
[12:24:52.045] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:38:0)
[12:24:52.086] Build status: SCHEDULED
[12:24:52.086] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:39:0) after 4m7s
[12:28:59.191] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:39:0)
[12:28:59.214] Build status: SCHEDULED
[12:28:59.214] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:40:0) after 1m11s
[12:30:10.424] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:40:0)
[12:30:10.447] Build status: SCHEDULED
[12:30:10.447] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:41:0) after 3m56s
[12:34:06.476] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:41:0)
[12:34:06.503] Build status: SCHEDULED
[12:34:06.503] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:42:0) after 1m43s
[12:35:49.654] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:42:0)
[12:35:49.714] Build status: SCHEDULED
[12:35:49.714] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:43:0) after 1m31s
[12:37:20.773] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:43:0)
[12:37:20.796] Build status: SCHEDULED
[12:37:20.796] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:44:0) after 4m37s
[12:41:57.930] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:44:0)
[12:41:57.948] Build status: SCHEDULED
[12:41:57.948] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:45:0) after 7m31s
[12:49:29.144] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:45:0)
[12:49:29.170] Build status: SCHEDULED
[12:49:29.170] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:46:0) after 5m41s
[12:55:10.257] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:46:0)
[12:55:10.281] Build status: SCHEDULED
[12:55:10.281] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:47:0) after 1m18s
[12:56:28.358] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:47:0)
[12:56:28.384] Build status: SCHEDULED
[12:56:28.384] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:48:0) after 3m25s
[12:59:53.459] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:48:0)
[12:59:53.476] Build status: SCHEDULED
[12:59:53.476] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:49:0) after 8m55s
[13:08:48.520] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:49:0)
[13:08:48.700] Build status: SCHEDULED
[13:08:48.700] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:50:0) after 4m3s
[13:12:51.882] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:50:0)
[13:12:51.901] Build status: SCHEDULED
[13:12:51.901] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:51:0) after 4m29s
[13:17:21.020] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:51:0)
[13:17:21.042] Build status: SCHEDULED
[13:17:21.042] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:52:0) after 1m33s
[13:18:54.062] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:52:0)
[13:18:54.082] Build status: SCHEDULED
[13:18:54.082] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:53:0) after 8m44s
[13:27:38.190] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:53:0)
[13:27:38.214] Build status: SCHEDULED
[13:27:38.214] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:54:0) after 2m13s
[13:29:51.567] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:54:0)
[13:29:51.598] Build status: SCHEDULED
[13:29:51.598] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:55:0) after 7m6s
[13:36:58.020] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:55:0)
[13:36:58.041] Build status: SCHEDULED
[13:36:58.042] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:56:0) after 8m45s
[13:45:43.261] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:56:0)
[13:45:43.284] Build status: SCHEDULED
[13:45:43.284] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:57:0) after 9m46s
[13:55:29.331] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:57:0)
[13:55:29.377] Build status: SCHEDULED
[13:55:29.377] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:58:0) after 8m9s
[14:03:39.057] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:58:0)
[14:03:39.100] Build status: SCHEDULED
[14:03:39.100] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:59:0) after 5m38s
[14:09:17.249] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:59:0)
[14:09:17.277] Build status: SCHEDULED
[14:09:17.277] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:60:0) after 7m46s
[14:17:03.302] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:60:0)
[14:17:03.329] Build status: SCHEDULED
[14:17:03.329] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:61:0) after 8m14s
[14:25:17.555] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:61:0)
[14:25:17.578] Build status: SCHEDULED
[14:25:17.578] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:62:0) after 2m6s
[14:27:23.682] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:62:0)
[14:27:23.702] Build status: SCHEDULED
[14:27:23.702] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:63:0) after 1m41s
[14:29:04.983] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:63:0)
[14:29:05.011] Build status: SCHEDULED
[14:29:05.011] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:64:0) after 8m56s
[14:38:01.275] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:64:0)
[14:38:01.316] Build status: SCHEDULED
[14:38:01.316] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:65:0) after 1m19s
[14:39:20.649] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:65:0)
[14:39:20.673] Build status: SCHEDULED
[14:39:20.673] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953179287705874896:66:0) after 1m16s
[14:39:38.449] Received PubSub notification, asking Buildbucket for the build status
[14:39:38.473] Build:
{
"id": "8787749225548495809",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60387,
"createdBy": "project:chromium",
"createTime": "2023-03-02T08:38:06.783443428Z",
"endTime": "2023-03-02T14:39:37.770718Z",
"updateTime": "2023-03-02T14:39:37.770718Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5b6979c43621893d550e829e4e68ef13980a2415",
"ref": "refs/heads/main"
}
}
}
[14:39:38.473] Invocation finished in 6h1m33.130956828s with status FAILED