[03:11:08.691] New invocation is queued and will start shortly
[03:11:09.866] Starting the invocation (attempt 1)
[03:11:09.902] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/6ccb388d17cd0cdc403d218f7164b989f8032527"
[03:11:09.902] Popped gitiles commit info from properties and tags
[03:11:09.902] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:11:09.903] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:11:09.903] Buildbucket request:
{
"requestId": "8957548511660387712",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6ccb388d17cd0cdc403d218f7164b989f8032527",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8957548511660387712"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:11:10.345] Scheduled build:
{
"id": "8792118449645237553",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60198,
"createdBy": "project:chromium",
"createTime": "2023-01-13T03:11:09.979447663Z",
"updateTime": "2023-01-13T03:11:09.979447663Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6ccb388d17cd0cdc403d218f7164b989f8032527",
"ref": "refs/heads/main"
}
}
}
[03:11:10.345] Task URL: https://cr-buildbucket.appspot.com/build/8792118449645237553
[03:11:10.345] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:2:0) after 7m50s
[03:19:00.389] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:2:0)
[03:19:00.413] Build status: SCHEDULED
[03:19:00.413] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:3:0) after 2m29s
[03:21:29.434] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:3:0)
[03:21:29.477] Build status: SCHEDULED
[03:21:29.477] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:4:0) after 9m57s
[03:31:26.502] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:4:0)
[03:31:26.526] Build status: SCHEDULED
[03:31:26.526] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:5:0) after 1m50s
[03:33:16.553] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:5:0)
[03:33:16.576] Build status: SCHEDULED
[03:33:16.576] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:6:0) after 6m51s
[03:40:07.699] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:6:0)
[03:40:07.725] Build status: SCHEDULED
[03:40:07.725] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:7:0) after 2m13s
[03:42:20.847] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:7:0)
[03:42:20.877] Build status: SCHEDULED
[03:42:20.877] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:8:0) after 2m7s
[03:44:28.002] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:8:0)
[03:44:28.046] Build status: SCHEDULED
[03:44:28.046] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:9:0) after 5m8s
[03:49:36.172] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:9:0)
[03:49:36.190] Build status: SCHEDULED
[03:49:36.190] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:10:0) after 9m32s
[03:59:08.309] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:10:0)
[03:59:08.330] Build status: SCHEDULED
[03:59:08.330] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:11:0) after 4m3s
[04:03:11.364] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:11:0)
[04:03:11.386] Build status: SCHEDULED
[04:03:11.386] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:12:0) after 2m9s
[04:05:20.514] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:12:0)
[04:05:20.547] Build status: SCHEDULED
[04:05:20.547] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:13:0) after 1m27s
[04:06:47.677] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:13:0)
[04:06:47.698] Build status: SCHEDULED
[04:06:47.698] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:14:0) after 8m30s
[04:15:17.726] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:14:0)
[04:15:17.784] Build status: SCHEDULED
[04:15:17.784] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:15:0) after 4m6s
[04:19:23.805] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:15:0)
[04:19:23.836] Build status: SCHEDULED
[04:19:23.836] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:16:0) after 3m53s
[04:23:17.086] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:16:0)
[04:23:17.109] Build status: SCHEDULED
[04:23:17.109] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:17:0) after 8m17s
[04:31:34.237] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:17:0)
[04:31:34.303] Build status: SCHEDULED
[04:31:34.303] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:18:0) after 4m9s
[04:35:43.329] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:18:0)
[04:35:43.359] Build status: SCHEDULED
[04:35:43.359] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:19:0) after 9m45s
[04:45:28.577] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:19:0)
[04:45:28.601] Build status: SCHEDULED
[04:45:28.602] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:20:0) after 8m6s
[04:53:34.631] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:20:0)
[04:53:34.653] Build status: SCHEDULED
[04:53:34.653] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:21:0) after 7m20s
[05:00:54.678] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:21:0)
[05:00:54.709] Build status: SCHEDULED
[05:00:54.709] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:22:0) after 5m0s
[05:05:54.737] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:22:0)
[05:05:54.846] Build status: SCHEDULED
[05:05:54.846] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:23:0) after 9m23s
[05:15:17.872] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:23:0)
[05:15:17.949] Build status: SCHEDULED
[05:15:17.949] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:24:0) after 9m6s
[05:24:23.977] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:24:0)
[05:24:23.999] Build status: SCHEDULED
[05:24:24.000] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:25:0) after 1m34s
[05:25:58.023] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:25:0)
[05:25:58.041] Build status: SCHEDULED
[05:25:58.041] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:26:0) after 9m10s
[05:35:08.073] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:26:0)
[05:35:08.101] Build status: SCHEDULED
[05:35:08.101] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:27:0) after 1m33s
[05:36:41.200] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:27:0)
[05:36:41.248] Build status: SCHEDULED
[05:36:41.248] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:28:0) after 9m25s
[05:46:06.279] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:28:0)
[05:46:06.304] Build status: SCHEDULED
[05:46:06.304] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:29:0) after 9m9s
[05:55:15.341] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:29:0)
[05:55:15.364] Build status: SCHEDULED
[05:55:15.364] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:30:0) after 9m25s
[06:04:40.387] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:30:0)
[06:04:40.427] Build status: SCHEDULED
[06:04:40.427] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:31:0) after 6m32s
[06:11:12.775] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:31:0)
[06:11:12.793] Build status: SCHEDULED
[06:11:12.793] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:32:0) after 9m29s
[06:20:41.815] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:32:0)
[06:20:41.873] Build status: SCHEDULED
[06:20:41.873] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:33:0) after 9m53s
[06:30:34.919] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:33:0)
[06:30:34.941] Build status: SCHEDULED
[06:30:34.941] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:34:0) after 9m8s
[06:39:43.063] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:34:0)
[06:39:43.086] Build status: SCHEDULED
[06:39:43.086] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:35:0) after 7m42s
[06:47:25.131] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:35:0)
[06:47:25.162] Build status: SCHEDULED
[06:47:25.162] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:36:0) after 8m11s
[06:55:36.195] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:36:0)
[06:55:36.215] Build status: SCHEDULED
[06:55:36.215] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:37:0) after 4m26s
[07:00:02.246] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:37:0)
[07:00:02.274] Build status: SCHEDULED
[07:00:02.274] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:38:0) after 4m54s
[07:04:56.379] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:38:0)
[07:04:56.426] Build status: SCHEDULED
[07:04:56.426] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:39:0) after 4m13s
[07:09:09.691] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:39:0)
[07:09:09.712] Build status: SCHEDULED
[07:09:09.712] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:40:0) after 4m36s
[07:13:45.895] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:40:0)
[07:13:45.922] Build status: SCHEDULED
[07:13:45.922] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:41:0) after 1m23s
[07:15:08.960] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:41:0)
[07:15:08.985] Build status: SCHEDULED
[07:15:08.985] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:42:0) after 2m10s
[07:17:19.008] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:42:0)
[07:17:19.031] Build status: SCHEDULED
[07:17:19.031] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:43:0) after 7m15s
[07:24:34.057] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:43:0)
[07:24:34.087] Build status: SCHEDULED
[07:24:34.087] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:44:0) after 2m35s
[07:27:09.242] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:44:0)
[07:27:09.345] Build status: SCHEDULED
[07:27:09.345] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:45:0) after 2m9s
[07:29:18.369] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:45:0)
[07:29:18.531] Build status: SCHEDULED
[07:29:18.531] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:46:0) after 1m33s
[07:30:51.601] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:46:0)
[07:30:51.625] Build status: SCHEDULED
[07:30:51.625] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:47:0) after 2m55s
[07:33:46.647] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:47:0)
[07:33:46.680] Build status: SCHEDULED
[07:33:46.680] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:48:0) after 8m13s
[07:41:59.927] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:48:0)
[07:41:59.947] Build status: SCHEDULED
[07:41:59.947] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:49:0) after 4m8s
[07:46:07.979] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:49:0)
[07:46:08.002] Build status: SCHEDULED
[07:46:08.002] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:50:0) after 6m55s
[07:53:03.031] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:50:0)
[07:53:03.051] Build status: SCHEDULED
[07:53:03.051] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:51:0) after 1m32s
[07:54:35.075] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:51:0)
[07:54:35.099] Build status: SCHEDULED
[07:54:35.099] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:52:0) after 8m19s
[08:02:54.132] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:52:0)
[08:02:54.155] Build status: SCHEDULED
[08:02:54.155] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:53:0) after 2m26s
[08:05:20.167] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:53:0)
[08:05:20.201] Build status: SCHEDULED
[08:05:20.201] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:54:0) after 5m23s
[08:10:43.322] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:54:0)
[08:10:43.344] Build status: SCHEDULED
[08:10:43.344] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:55:0) after 5m20s
[08:16:03.375] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:55:0)
[08:16:03.399] Build status: SCHEDULED
[08:16:03.399] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:56:0) after 8m11s
[08:24:14.421] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:56:0)
[08:24:14.443] Build status: SCHEDULED
[08:24:14.443] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:57:0) after 2m41s
[08:26:55.491] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:57:0)
[08:26:55.511] Build status: SCHEDULED
[08:26:55.511] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:58:0) after 9m52s
[08:36:47.705] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:58:0)
[08:36:47.740] Build status: SCHEDULED
[08:36:47.740] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:59:0) after 2m7s
[08:38:54.764] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:59:0)
[08:38:54.785] Build status: SCHEDULED
[08:38:54.785] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:60:0) after 2m30s
[08:41:24.998] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:60:0)
[08:41:25.028] Build status: SCHEDULED
[08:41:25.028] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:61:0) after 6m20s
[08:47:45.053] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:61:0)
[08:47:45.075] Build status: SCHEDULED
[08:47:45.075] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:62:0) after 4m2s
[08:51:47.196] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:62:0)
[08:51:47.216] Build status: SCHEDULED
[08:51:47.216] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:63:0) after 8m8s
[08:59:55.269] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:63:0)
[08:59:55.306] Build status: SCHEDULED
[08:59:55.306] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:64:0) after 8m28s
[09:08:23.343] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:64:0)
[09:08:23.365] Build status: SCHEDULED
[09:08:23.365] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957548511660387712:65:0) after 4m46s
[09:12:08.670] Received PubSub notification, asking Buildbucket for the build status
[09:12:08.694] Build:
{
"id": "8792118449645237553",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60198,
"createdBy": "project:chromium",
"createTime": "2023-01-13T03:11:09.979447663Z",
"endTime": "2023-01-13T09:12:08.082948Z",
"updateTime": "2023-01-13T09:12:08.082948Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6ccb388d17cd0cdc403d218f7164b989f8032527",
"ref": "refs/heads/main"
}
}
}
[09:12:08.694] Invocation finished in 6h1m0.019572014s with status FAILED