[16:29:06.403] New invocation is queued and will start shortly
[16:29:07.479] Starting the invocation (attempt 1)
[16:29:07.512] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e60656941d2ad75dd81fdde832ea47c6ec129cbf"
[16:29:07.512] Popped gitiles commit info from properties and tags
[16:29:07.512] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:29:07.512] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:29:07.512] Buildbucket request:
{
"requestId": "8955776965878385920",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e60656941d2ad75dd81fdde832ea47c6ec129cbf",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8955776965878385920"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:29:09.760] Scheduled build:
{
"id": "8790346902086985409",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60276,
"createdBy": "project:chromium",
"createTime": "2023-02-01T16:29:09.386476196Z",
"updateTime": "2023-02-01T16:29:09.386476196Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e60656941d2ad75dd81fdde832ea47c6ec129cbf",
"ref": "refs/heads/main"
}
}
}
[16:29:09.760] Task URL: https://cr-buildbucket.appspot.com/build/8790346902086985409
[16:29:09.760] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:2:0) after 2m19s
[16:31:28.783] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:2:0)
[16:31:28.842] Build status: SCHEDULED
[16:31:28.842] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:3:0) after 9m6s
[16:40:35.059] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:3:0)
[16:40:35.084] Build status: SCHEDULED
[16:40:35.084] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:4:0) after 4m19s
[16:44:54.273] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:4:0)
[16:44:54.309] Build status: SCHEDULED
[16:44:54.309] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:5:0) after 6m43s
[16:51:37.455] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:5:0)
[16:51:37.478] Build status: SCHEDULED
[16:51:37.478] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:6:0) after 9m42s
[17:01:19.677] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:6:0)
[17:01:19.700] Build status: SCHEDULED
[17:01:19.700] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:7:0) after 7m43s
[17:09:02.758] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:7:0)
[17:09:02.781] Build status: SCHEDULED
[17:09:02.781] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:8:0) after 1m12s
[17:10:14.841] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:8:0)
[17:10:14.865] Build status: SCHEDULED
[17:10:14.865] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:9:0) after 8m1s
[17:18:15.892] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:9:0)
[17:18:15.918] Build status: SCHEDULED
[17:18:15.919] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:10:0) after 9m38s
[17:27:53.943] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:10:0)
[17:27:53.969] Build status: SCHEDULED
[17:27:53.969] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:11:0) after 4m18s
[17:32:11.998] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:11:0)
[17:32:12.029] Build status: SCHEDULED
[17:32:12.029] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:12:0) after 4m39s
[17:36:51.053] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:12:0)
[17:36:51.080] Build status: SCHEDULED
[17:36:51.080] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:13:0) after 6m35s
[17:43:26.103] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:13:0)
[17:43:26.139] Build status: SCHEDULED
[17:43:26.139] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:14:0) after 3m51s
[17:47:17.251] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:14:0)
[17:47:17.274] Build status: SCHEDULED
[17:47:17.274] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:15:0) after 9m36s
[17:56:53.343] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:15:0)
[17:56:53.363] Build status: SCHEDULED
[17:56:53.363] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:16:0) after 7m48s
[18:04:41.416] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:16:0)
[18:04:41.452] Build status: SCHEDULED
[18:04:41.452] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:17:0) after 8m0s
[18:12:41.746] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:17:0)
[18:12:41.771] Build status: SCHEDULED
[18:12:41.771] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:18:0) after 2m36s
[18:15:17.960] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:18:0)
[18:15:17.981] Build status: SCHEDULED
[18:15:17.981] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:19:0) after 6m18s
[18:21:36.001] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:19:0)
[18:21:36.021] Build status: SCHEDULED
[18:21:36.021] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:20:0) after 9m55s
[18:31:31.190] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:20:0)
[18:31:31.217] Build status: SCHEDULED
[18:31:31.217] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:21:0) after 9m8s
[18:40:39.441] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:21:0)
[18:40:39.463] Build status: SCHEDULED
[18:40:39.463] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:22:0) after 2m33s
[18:43:12.504] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:22:0)
[18:43:12.535] Build status: SCHEDULED
[18:43:12.535] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:23:0) after 8m55s
[18:52:07.867] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:23:0)
[18:52:07.892] Build status: SCHEDULED
[18:52:07.892] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:24:0) after 1m22s
[18:53:29.963] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:24:0)
[18:53:29.986] Build status: SCHEDULED
[18:53:29.986] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:25:0) after 7m58s
[19:01:28.022] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:25:0)
[19:01:28.052] Build status: SCHEDULED
[19:01:28.052] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:26:0) after 4m55s
[19:06:23.053] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:26:0)
[19:06:23.156] Build status: SCHEDULED
[19:06:23.156] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:27:0) after 1m59s
[19:08:22.182] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:27:0)
[19:08:22.203] Build status: SCHEDULED
[19:08:22.203] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:28:0) after 7m8s
[19:15:30.191] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:28:0)
[19:15:30.211] Build status: SCHEDULED
[19:15:30.211] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:29:0) after 5m26s
[19:20:56.282] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:29:0)
[19:20:56.305] Build status: SCHEDULED
[19:20:56.306] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:30:0) after 2m25s
[19:23:21.334] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:30:0)
[19:23:21.359] Build status: SCHEDULED
[19:23:21.359] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:31:0) after 1m27s
[19:24:48.395] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:31:0)
[19:24:48.417] Build status: SCHEDULED
[19:24:48.417] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:32:0) after 8m29s
[19:33:17.449] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:32:0)
[19:33:17.546] Build status: SCHEDULED
[19:33:17.546] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:33:0) after 8m56s
[19:42:13.564] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:33:0)
[19:42:13.627] Build status: SCHEDULED
[19:42:13.627] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:34:0) after 8m56s
[19:51:09.699] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:34:0)
[19:51:09.722] Build status: SCHEDULED
[19:51:09.722] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:35:0) after 2m39s
[19:53:48.753] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:35:0)
[19:53:48.777] Build status: SCHEDULED
[19:53:48.777] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:36:0) after 4m9s
[19:57:57.830] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:36:0)
[19:57:57.849] Build status: SCHEDULED
[19:57:57.849] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:37:0) after 7m49s
[20:05:46.882] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:37:0)
[20:05:46.905] Build status: SCHEDULED
[20:05:46.905] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:38:0) after 9m3s
[20:14:49.930] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:38:0)
[20:14:49.951] Build status: SCHEDULED
[20:14:49.951] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:39:0) after 2m36s
[20:17:25.986] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:39:0)
[20:17:26.009] Build status: SCHEDULED
[20:17:26.009] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:40:0) after 9m21s
[20:26:47.091] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:40:0)
[20:26:47.114] Build status: SCHEDULED
[20:26:47.114] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:41:0) after 9m21s
[20:36:08.127] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:41:0)
[20:36:08.163] Build status: SCHEDULED
[20:36:08.163] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:42:0) after 6m42s
[20:42:50.234] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:42:0)
[20:42:50.256] Build status: SCHEDULED
[20:42:50.256] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:43:0) after 1m4s
[20:43:54.279] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:43:0)
[20:43:54.299] Build status: SCHEDULED
[20:43:54.299] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:44:0) after 5m42s
[20:49:36.328] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:44:0)
[20:49:36.351] Build status: SCHEDULED
[20:49:36.351] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:45:0) after 7m52s
[20:57:28.726] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:45:0)
[20:57:28.751] Build status: SCHEDULED
[20:57:28.751] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:46:0) after 1m57s
[20:59:26.499] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:46:0)
[20:59:26.523] Build status: SCHEDULED
[20:59:26.523] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:47:0) after 2m40s
[21:02:06.790] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:47:0)
[21:02:06.817] Build status: SCHEDULED
[21:02:06.817] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:48:0) after 4m1s
[21:06:07.898] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:48:0)
[21:06:07.972] Build status: SCHEDULED
[21:06:07.972] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:49:0) after 1m32s
[21:07:40.171] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:49:0)
[21:07:40.233] Build status: SCHEDULED
[21:07:40.233] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:50:0) after 6m0s
[21:13:40.266] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:50:0)
[21:13:40.426] Build status: SCHEDULED
[21:13:40.426] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:51:0) after 5m7s
[21:18:48.089] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:51:0)
[21:18:48.112] Build status: SCHEDULED
[21:18:48.112] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:52:0) after 2m29s
[21:21:17.147] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:52:0)
[21:21:17.186] Build status: SCHEDULED
[21:21:17.186] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:53:0) after 4m13s
[21:25:30.208] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:53:0)
[21:25:30.229] Build status: SCHEDULED
[21:25:30.230] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:54:0) after 5m6s
[21:30:36.254] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:54:0)
[21:30:36.277] Build status: SCHEDULED
[21:30:36.277] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:55:0) after 3m26s
[21:34:02.255] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:55:0)
[21:34:02.282] Build status: SCHEDULED
[21:34:02.282] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:56:0) after 9m55s
[21:43:57.367] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:56:0)
[21:43:57.392] Build status: SCHEDULED
[21:43:57.392] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:57:0) after 9m58s
[21:53:55.414] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:57:0)
[21:53:55.448] Build status: SCHEDULED
[21:53:55.448] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:58:0) after 5m7s
[21:59:02.576] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:58:0)
[21:59:02.601] Build status: SCHEDULED
[21:59:02.601] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:59:0) after 6m4s
[22:05:06.671] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:59:0)
[22:05:06.697] Build status: SCHEDULED
[22:05:06.697] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:60:0) after 9m55s
[22:15:01.772] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:60:0)
[22:15:01.803] Build status: SCHEDULED
[22:15:01.803] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:61:0) after 2m8s
[22:17:09.883] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:61:0)
[22:17:09.905] Build status: SCHEDULED
[22:17:09.905] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:62:0) after 4m59s
[22:22:09.339] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:62:0)
[22:22:09.362] Build status: SCHEDULED
[22:22:09.362] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:63:0) after 7m14s
[22:29:23.394] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:63:0)
[22:29:23.437] Build status: SCHEDULED
[22:29:23.437] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955776965878385920:64:0) after 9m17s
[22:30:08.070] Received PubSub notification, asking Buildbucket for the build status
[22:30:08.098] Build:
{
"id": "8790346902086985409",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60276,
"createdBy": "project:chromium",
"createTime": "2023-02-01T16:29:09.386476196Z",
"endTime": "2023-02-01T22:30:07.517891Z",
"updateTime": "2023-02-01T22:30:07.517891Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e60656941d2ad75dd81fdde832ea47c6ec129cbf",
"ref": "refs/heads/main"
}
}
}
[22:30:08.098] Invocation finished in 6h1m1.710310697s with status FAILED