[01:24:04.197] New invocation is queued and will start shortly
[01:24:05.245] Starting the invocation (attempt 1)
[01:24:05.283] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/b8f9b7c085ea97fbb0d6ceb74ec2650aa210d75d"
[01:24:05.283] Popped gitiles commit info from properties and tags
[01:24:05.283] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:24:05.283] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:24:05.283] Buildbucket request:
{
"requestId": "8954927936201722736",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b8f9b7c085ea97fbb0d6ceb74ec2650aa210d75d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8954927936201722736"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:24:05.839] Scheduled build:
{
"id": "8789497874193920961",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60309,
"createdBy": "project:chromium",
"createTime": "2023-02-11T01:24:05.481500689Z",
"updateTime": "2023-02-11T01:24:05.481500689Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b8f9b7c085ea97fbb0d6ceb74ec2650aa210d75d",
"ref": "refs/heads/main"
}
}
}
[01:24:05.839] Task URL: https://cr-buildbucket.appspot.com/build/8789497874193920961
[01:24:05.839] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:2:0) after 8m45s
[01:32:50.873] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:2:0)
[01:32:50.901] Build status: SCHEDULED
[01:32:50.901] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:3:0) after 8m45s
[01:41:36.091] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:3:0)
[01:41:36.109] Build status: SCHEDULED
[01:41:36.109] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:4:0) after 4m47s
[01:46:23.188] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:4:0)
[01:46:23.209] Build status: SCHEDULED
[01:46:23.209] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:5:0) after 7m29s
[01:53:52.330] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:5:0)
[01:53:52.353] Build status: SCHEDULED
[01:53:52.353] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:6:0) after 7m19s
[02:01:11.340] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:6:0)
[02:01:11.361] Build status: SCHEDULED
[02:01:11.361] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:7:0) after 9m41s
[02:10:52.649] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:7:0)
[02:10:52.677] Build status: SCHEDULED
[02:10:52.677] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:8:0) after 3m23s
[02:14:15.703] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:8:0)
[02:14:15.732] Build status: SCHEDULED
[02:14:15.732] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:9:0) after 8m26s
[02:22:41.825] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:9:0)
[02:22:41.847] Build status: SCHEDULED
[02:22:41.847] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:10:0) after 6m47s
[02:29:29.026] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:10:0)
[02:29:29.090] Build status: SCHEDULED
[02:29:29.091] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:11:0) after 1m1s
[02:30:30.114] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:11:0)
[02:30:30.140] Build status: SCHEDULED
[02:30:30.140] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:12:0) after 7m39s
[02:38:09.325] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:12:0)
[02:38:09.350] Build status: SCHEDULED
[02:38:09.350] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:13:0) after 5m33s
[02:43:42.728] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:13:0)
[02:43:42.752] Build status: SCHEDULED
[02:43:42.752] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:14:0) after 5m23s
[02:49:05.869] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:14:0)
[02:49:05.891] Build status: SCHEDULED
[02:49:05.891] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:15:0) after 6m15s
[02:55:21.089] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:15:0)
[02:55:21.111] Build status: SCHEDULED
[02:55:21.111] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:16:0) after 3m45s
[02:59:06.180] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:16:0)
[02:59:06.206] Build status: SCHEDULED
[02:59:06.206] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:17:0) after 5m51s
[03:04:57.298] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:17:0)
[03:04:57.374] Build status: SCHEDULED
[03:04:57.374] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:18:0) after 9m10s
[03:14:07.529] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:18:0)
[03:14:07.560] Build status: SCHEDULED
[03:14:07.560] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:19:0) after 3m55s
[03:18:02.581] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:19:0)
[03:18:02.603] Build status: SCHEDULED
[03:18:02.603] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:20:0) after 1m4s
[03:19:06.624] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:20:0)
[03:19:06.680] Build status: SCHEDULED
[03:19:06.680] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:21:0) after 4m51s
[03:23:57.840] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:21:0)
[03:23:57.876] Build status: SCHEDULED
[03:23:57.876] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:22:0) after 6m11s
[03:30:08.903] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:22:0)
[03:30:08.939] Build status: SCHEDULED
[03:30:08.939] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:23:0) after 7m36s
[03:37:45.373] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:23:0)
[03:37:45.397] Build status: SCHEDULED
[03:37:45.397] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:24:0) after 2m40s
[03:40:25.418] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:24:0)
[03:40:25.469] Build status: SCHEDULED
[03:40:25.469] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:25:0) after 1m11s
[03:41:36.496] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:25:0)
[03:41:36.516] Build status: SCHEDULED
[03:41:36.516] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:26:0) after 6m35s
[03:48:11.669] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:26:0)
[03:48:11.716] Build status: SCHEDULED
[03:48:11.716] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:27:0) after 3m26s
[03:51:37.781] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:27:0)
[03:51:37.800] Build status: SCHEDULED
[03:51:37.800] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:28:0) after 9m27s
[04:01:05.106] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:28:0)
[04:01:05.243] Build status: SCHEDULED
[04:01:05.243] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:29:0) after 7m13s
[04:08:18.305] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:29:0)
[04:08:18.363] Build status: SCHEDULED
[04:08:18.363] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:30:0) after 4m58s
[04:13:16.505] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:30:0)
[04:13:16.532] Build status: SCHEDULED
[04:13:16.533] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:31:0) after 2m50s
[04:16:06.518] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:31:0)
[04:16:06.541] Build status: SCHEDULED
[04:16:06.541] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:32:0) after 7m47s
[04:23:53.637] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:32:0)
[04:23:53.665] Build status: SCHEDULED
[04:23:53.665] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:33:0) after 6m5s
[04:29:58.727] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:33:0)
[04:29:58.748] Build status: SCHEDULED
[04:29:58.748] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:34:0) after 5m12s
[04:35:10.770] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:34:0)
[04:35:10.794] Build status: SCHEDULED
[04:35:10.794] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:35:0) after 1m53s
[04:37:03.818] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:35:0)
[04:37:03.839] Build status: SCHEDULED
[04:37:03.839] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:36:0) after 3m9s
[04:40:12.963] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:36:0)
[04:40:12.986] Build status: SCHEDULED
[04:40:12.986] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:37:0) after 9m46s
[04:49:59.012] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:37:0)
[04:49:59.078] Build status: SCHEDULED
[04:49:59.079] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:38:0) after 5m33s
[04:55:32.076] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:38:0)
[04:55:32.113] Build status: SCHEDULED
[04:55:32.114] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:39:0) after 2m50s
[04:58:22.351] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:39:0)
[04:58:22.415] Build status: SCHEDULED
[04:58:22.415] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:40:0) after 3m51s
[05:02:13.546] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:40:0)
[05:02:13.570] Build status: SCHEDULED
[05:02:13.570] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:41:0) after 9m17s
[05:11:30.592] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:41:0)
[05:11:30.673] Build status: SCHEDULED
[05:11:30.673] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:42:0) after 8m14s
[05:19:44.694] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:42:0)
[05:19:44.715] Build status: SCHEDULED
[05:19:44.715] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:43:0) after 8m50s
[05:28:34.736] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:43:0)
[05:28:34.761] Build status: SCHEDULED
[05:28:34.761] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:44:0) after 7m6s
[05:35:40.848] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:44:0)
[05:35:40.883] Build status: SCHEDULED
[05:35:40.883] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:45:0) after 4m47s
[05:40:27.910] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:45:0)
[05:40:27.937] Build status: SCHEDULED
[05:40:27.937] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:46:0) after 6m44s
[05:47:12.155] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:46:0)
[05:47:12.175] Build status: SCHEDULED
[05:47:12.175] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:47:0) after 2m7s
[05:49:19.259] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:47:0)
[05:49:19.283] Build status: SCHEDULED
[05:49:19.283] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:48:0) after 9m0s
[05:58:19.304] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:48:0)
[05:58:19.327] Build status: SCHEDULED
[05:58:19.327] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:49:0) after 5m14s
[06:03:33.419] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:49:0)
[06:03:33.466] Build status: SCHEDULED
[06:03:33.466] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:50:0) after 2m58s
[06:06:31.583] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:50:0)
[06:06:31.608] Build status: SCHEDULED
[06:06:31.608] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:51:0) after 6m0s
[06:12:31.637] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:51:0)
[06:12:31.667] Build status: SCHEDULED
[06:12:31.667] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:52:0) after 1m45s
[06:14:16.693] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:52:0)
[06:14:16.716] Build status: SCHEDULED
[06:14:16.716] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:53:0) after 7m28s
[06:21:44.741] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:53:0)
[06:21:44.763] Build status: SCHEDULED
[06:21:44.763] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:54:0) after 7m42s
[06:29:26.993] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:54:0)
[06:29:27.063] Build status: SCHEDULED
[06:29:27.063] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:55:0) after 9m27s
[06:38:54.062] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:55:0)
[06:38:54.082] Build status: SCHEDULED
[06:38:54.082] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:56:0) after 3m35s
[06:42:29.109] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:56:0)
[06:42:29.139] Build status: SCHEDULED
[06:42:29.139] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:57:0) after 5m7s
[06:47:36.170] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:57:0)
[06:47:36.194] Build status: SCHEDULED
[06:47:36.194] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:58:0) after 6m43s
[06:54:19.928] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:58:0)
[06:54:19.955] Build status: SCHEDULED
[06:54:19.955] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:59:0) after 1m19s
[06:55:39.651] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:59:0)
[06:55:39.700] Build status: SCHEDULED
[06:55:39.700] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:60:0) after 8m51s
[07:04:30.725] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:60:0)
[07:04:30.746] Build status: SCHEDULED
[07:04:30.746] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:61:0) after 4m13s
[07:08:43.770] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:61:0)
[07:08:43.794] Build status: SCHEDULED
[07:08:43.795] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:62:0) after 7m21s
[07:16:04.844] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:62:0)
[07:16:04.867] Build status: SCHEDULED
[07:16:04.867] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:63:0) after 2m33s
[07:18:38.668] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:63:0)
[07:18:38.687] Build status: SCHEDULED
[07:18:38.687] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:64:0) after 1m55s
[07:20:33.709] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:64:0)
[07:20:33.729] Build status: SCHEDULED
[07:20:33.729] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954927936201722736:65:0) after 4m41s
[07:24:11.910] Received PubSub notification, asking Buildbucket for the build status
[07:24:11.937] Build:
{
"id": "8789497874193920961",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60309,
"createdBy": "project:chromium",
"createTime": "2023-02-11T01:24:05.481500689Z",
"endTime": "2023-02-11T07:24:11.047995Z",
"updateTime": "2023-02-11T07:24:11.047995Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b8f9b7c085ea97fbb0d6ceb74ec2650aa210d75d",
"ref": "refs/heads/main"
}
}
}
[07:24:11.937] Invocation finished in 6h0m7.754065695s with status FAILED