[19:29:09.005] New invocation is queued and will start shortly
[19:29:10.470] Starting the invocation (attempt 1)
[19:29:10.499] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/09bf5504365c2f176ea1ba0e2b5b1f20f1aafc1a"
[19:29:10.499] Popped gitiles commit info from properties and tags
[19:29:10.499] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:29:10.500] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:29:10.500] Buildbucket request:
{
"requestId": "8944259823793824160",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "09bf5504365c2f176ea1ba0e2b5b1f20f1aafc1a",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8944259823793824160"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:29:10.930] Scheduled build:
{
"id": "8778829761464172145",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60797,
"createdBy": "project:chromium",
"createTime": "2023-06-08T19:29:10.596154941Z",
"updateTime": "2023-06-08T19:29:10.596154941Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "09bf5504365c2f176ea1ba0e2b5b1f20f1aafc1a",
"ref": "refs/heads/main"
}
}
}
[19:29:10.930] Task URL: https://cr-buildbucket.appspot.com/build/8778829761464172145
[19:29:10.930] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:2:0) after 2m21s
[19:31:31.936] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:2:0)
[19:31:31.954] Build status: SCHEDULED
[19:31:31.954] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:3:0) after 3m59s
[19:35:30.978] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:3:0)
[19:35:31.002] Build status: SCHEDULED
[19:35:31.002] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:4:0) after 8m47s
[19:44:18.541] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:4:0)
[19:44:18.580] Build status: SCHEDULED
[19:44:18.580] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:5:0) after 5m29s
[19:49:47.642] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:5:0)
[19:49:47.665] Build status: SCHEDULED
[19:49:47.665] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:6:0) after 2m15s
[19:52:02.725] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:6:0)
[19:52:02.755] Build status: SCHEDULED
[19:52:02.755] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:7:0) after 4m16s
[19:56:18.751] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:7:0)
[19:56:18.771] Build status: SCHEDULED
[19:56:18.771] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:8:0) after 6m40s
[20:02:58.896] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:8:0)
[20:02:58.916] Build status: SCHEDULED
[20:02:58.916] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:9:0) after 6m46s
[20:09:45.383] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:9:0)
[20:09:45.408] Build status: SCHEDULED
[20:09:45.408] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:10:0) after 8m2s
[20:17:47.434] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:10:0)
[20:17:47.506] Build status: SCHEDULED
[20:17:47.506] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:11:0) after 2m33s
[20:20:20.721] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:11:0)
[20:20:20.739] Build status: SCHEDULED
[20:20:20.739] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:12:0) after 7m49s
[20:28:10.167] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:12:0)
[20:28:10.183] Build status: SCHEDULED
[20:28:10.183] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:13:0) after 4m33s
[20:32:43.206] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:13:0)
[20:32:43.226] Build status: SCHEDULED
[20:32:43.226] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:14:0) after 5m46s
[20:38:29.245] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:14:0)
[20:38:29.259] Build status: SCHEDULED
[20:38:29.259] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:15:0) after 2m22s
[20:40:51.600] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:15:0)
[20:40:51.617] Build status: SCHEDULED
[20:40:51.617] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:16:0) after 1m27s
[20:42:18.637] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:16:0)
[20:42:18.653] Build status: SCHEDULED
[20:42:18.653] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:17:0) after 9m31s
[20:51:49.730] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:17:0)
[20:51:49.749] Build status: SCHEDULED
[20:51:49.749] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:18:0) after 4m58s
[20:56:47.912] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:18:0)
[20:56:47.936] Build status: SCHEDULED
[20:56:47.936] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:19:0) after 9m51s
[21:06:39.000] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:19:0)
[21:06:39.018] Build status: SCHEDULED
[21:06:39.018] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:20:0) after 9m54s
[21:16:33.148] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:20:0)
[21:16:33.165] Build status: SCHEDULED
[21:16:33.165] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:21:0) after 4m55s
[21:21:28.287] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:21:0)
[21:21:28.342] Build status: SCHEDULED
[21:21:28.342] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:22:0) after 1m8s
[21:22:36.626] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:22:0)
[21:22:36.642] Build status: SCHEDULED
[21:22:36.643] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:23:0) after 8m43s
[21:31:19.730] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:23:0)
[21:31:19.750] Build status: SCHEDULED
[21:31:19.750] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:24:0) after 5m24s
[21:36:43.780] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:24:0)
[21:36:43.798] Build status: SCHEDULED
[21:36:43.798] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:25:0) after 1m42s
[21:38:25.787] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:25:0)
[21:38:25.808] Build status: SCHEDULED
[21:38:25.808] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:26:0) after 1m31s
[21:39:57.160] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:26:0)
[21:39:57.179] Build status: SCHEDULED
[21:39:57.179] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:27:0) after 8m37s
[21:48:34.568] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:27:0)
[21:48:34.587] Build status: SCHEDULED
[21:48:34.587] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:28:0) after 1m34s
[21:50:08.962] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:28:0)
[21:50:08.993] Build status: SCHEDULED
[21:50:08.994] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:29:0) after 8m36s
[21:58:45.393] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:29:0)
[21:58:45.413] Build status: SCHEDULED
[21:58:45.413] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:30:0) after 6m4s
[22:04:49.689] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:30:0)
[22:04:49.710] Build status: SCHEDULED
[22:04:49.710] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:31:0) after 1m36s
[22:06:25.959] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:31:0)
[22:06:25.978] Build status: SCHEDULED
[22:06:25.978] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:32:0) after 6m53s
[22:13:18.996] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:32:0)
[22:13:19.013] Build status: SCHEDULED
[22:13:19.013] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:33:0) after 3m13s
[22:16:32.134] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:33:0)
[22:16:32.149] Build status: SCHEDULED
[22:16:32.149] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:34:0) after 7m37s
[22:24:09.338] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:34:0)
[22:24:09.355] Build status: SCHEDULED
[22:24:09.355] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:35:0) after 9m42s
[22:33:51.466] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:35:0)
[22:33:51.487] Build status: SCHEDULED
[22:33:51.487] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:36:0) after 7m36s
[22:41:27.640] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:36:0)
[22:41:27.658] Build status: SCHEDULED
[22:41:27.658] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:37:0) after 6m40s
[22:48:07.945] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:37:0)
[22:48:08.039] Build status: SCHEDULED
[22:48:08.039] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:38:0) after 7m45s
[22:55:53.360] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:38:0)
[22:55:53.399] Build status: SCHEDULED
[22:55:53.399] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:39:0) after 5m18s
[23:01:11.671] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:39:0)
[23:01:11.686] Build status: SCHEDULED
[23:01:11.687] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:40:0) after 2m32s
[23:03:43.800] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:40:0)
[23:03:43.820] Build status: SCHEDULED
[23:03:43.820] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:41:0) after 8m29s
[23:12:13.087] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:41:0)
[23:12:13.105] Build status: SCHEDULED
[23:12:13.106] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:42:0) after 8m34s
[23:20:47.197] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:42:0)
[23:20:47.304] Build status: SCHEDULED
[23:20:47.304] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:43:0) after 9m30s
[23:30:17.527] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:43:0)
[23:30:17.547] Build status: SCHEDULED
[23:30:17.547] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:44:0) after 2m51s
[23:33:09.501] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:44:0)
[23:33:09.525] Build status: SCHEDULED
[23:33:09.525] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:45:0) after 9m17s
[23:42:26.726] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:45:0)
[23:42:26.754] Build status: SCHEDULED
[23:42:26.754] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:46:0) after 8m11s
[23:50:38.177] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:46:0)
[23:50:38.194] Build status: SCHEDULED
[23:50:38.194] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:47:0) after 6m0s
[23:56:38.316] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:47:0)
[23:56:38.331] Build status: SCHEDULED
[23:56:38.331] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:48:0) after 2m51s
[23:59:29.758] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:48:0)
[23:59:29.774] Build status: SCHEDULED
[23:59:29.774] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:49:0) after 3m58s
[00:03:27.854] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:49:0)
[00:03:27.890] Build status: SCHEDULED
[00:03:27.890] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:50:0) after 3m13s
[00:06:41.216] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:50:0)
[00:06:41.234] Build status: SCHEDULED
[00:06:41.234] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:51:0) after 1m10s
[00:07:51.387] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:51:0)
[00:07:51.500] Build status: SCHEDULED
[00:07:51.500] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:52:0) after 9m46s
[00:17:37.525] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:52:0)
[00:17:37.542] Build status: SCHEDULED
[00:17:37.542] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:53:0) after 5m52s
[00:23:29.881] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:53:0)
[00:23:29.902] Build status: SCHEDULED
[00:23:29.902] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:54:0) after 1m47s
[00:25:16.961] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:54:0)
[00:25:16.980] Build status: SCHEDULED
[00:25:16.980] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:55:0) after 6m40s
[00:31:56.999] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:55:0)
[00:31:57.021] Build status: SCHEDULED
[00:31:57.021] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:56:0) after 6m8s
[00:38:05.165] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:56:0)
[00:38:05.189] Build status: SCHEDULED
[00:38:05.189] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:57:0) after 8m6s
[00:46:11.232] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:57:0)
[00:46:11.255] Build status: SCHEDULED
[00:46:11.255] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:58:0) after 6m25s
[00:52:36.287] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:58:0)
[00:52:36.309] Build status: SCHEDULED
[00:52:36.309] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:59:0) after 5m44s
[00:58:20.450] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:59:0)
[00:58:20.471] Build status: SCHEDULED
[00:58:20.471] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:60:0) after 7m54s
[01:06:14.551] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:60:0)
[01:06:14.573] Build status: SCHEDULED
[01:06:14.573] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:61:0) after 4m16s
[01:10:30.739] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:61:0)
[01:10:30.792] Build status: SCHEDULED
[01:10:30.792] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:62:0) after 4m16s
[01:14:47.049] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:62:0)
[01:14:47.092] Build status: SCHEDULED
[01:14:47.092] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:63:0) after 5m2s
[01:19:49.203] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:63:0)
[01:19:49.224] Build status: SCHEDULED
[01:19:49.225] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:64:0) after 4m49s
[01:24:38.316] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:64:0)
[01:24:38.334] Build status: SCHEDULED
[01:24:38.334] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:65:0) after 1m53s
[01:26:31.361] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:65:0)
[01:26:31.378] Build status: SCHEDULED
[01:26:31.378] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944259823793824160:66:0) after 5m49s
[01:30:18.968] Received PubSub notification, asking Buildbucket for the build status
[01:30:18.985] Build:
{
"id": "8778829761464172145",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60797,
"createdBy": "project:chromium",
"createTime": "2023-06-08T19:29:10.596154941Z",
"endTime": "2023-06-09T01:30:02.762427Z",
"updateTime": "2023-06-09T01:30:02.762427Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "09bf5504365c2f176ea1ba0e2b5b1f20f1aafc1a",
"ref": "refs/heads/main"
}
}
}
[01:30:18.985] Invocation finished in 6h1m9.9936707s with status FAILED