[02:23:40.233] New invocation is queued and will start shortly
[02:23:41.318] Starting the invocation (attempt 1)
[02:23:41.350] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/350a7465a669639e0248ccabbce3ff7a98a20a09"
[02:23:41.350] Popped gitiles commit info from properties and tags
[02:23:41.350] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:23:41.350] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:23:41.351] Buildbucket request:
{
"requestId": "8960994183202765152",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "350a7465a669639e0248ccabbce3ff7a98a20a09",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8960994183202765152"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:23:41.881] Scheduled build:
{
"id": "8795564121289290065",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 59760,
"createdBy": "project:chromium",
"createTime": "2022-12-06T02:23:41.430229906Z",
"updateTime": "2022-12-06T02:23:41.430229906Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "350a7465a669639e0248ccabbce3ff7a98a20a09",
"ref": "refs/heads/main"
}
}
}
[02:23:41.881] Task URL: https://cr-buildbucket.appspot.com/build/8795564121289290065
[02:23:41.881] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:2:0) after 3m54s
[02:26:17.238] Received PubSub notification, asking Buildbucket for the build status
[02:26:17.267] Build status: STARTED
[02:27:35.903] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:2:0)
[02:27:35.936] Build status: STARTED
[02:27:35.936] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:4:0) after 2m14s
[02:29:50.014] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:4:0)
[02:29:50.047] Build status: STARTED
[02:29:50.047] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:5:0) after 4m34s
[02:34:24.071] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:5:0)
[02:34:24.111] Build status: STARTED
[02:34:24.111] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:6:0) after 8m40s
[02:43:04.274] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:6:0)
[02:43:04.316] Build status: STARTED
[02:43:04.316] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:7:0) after 1m58s
[02:45:02.382] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:7:0)
[02:45:02.410] Build status: STARTED
[02:45:02.410] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:8:0) after 2m0s
[02:47:02.418] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:8:0)
[02:47:02.440] Build status: STARTED
[02:47:02.440] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:9:0) after 5m9s
[02:52:11.702] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:9:0)
[02:52:11.750] Build status: STARTED
[02:52:11.750] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:10:0) after 8m44s
[03:00:56.229] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:10:0)
[03:00:56.255] Build status: STARTED
[03:00:56.255] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:11:0) after 9m12s
[03:10:08.525] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:11:0)
[03:10:08.552] Build status: STARTED
[03:10:08.552] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:12:0) after 7m18s
[03:17:26.899] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:12:0)
[03:17:26.918] Build status: STARTED
[03:17:26.918] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:13:0) after 6m54s
[03:24:20.941] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:13:0)
[03:24:20.966] Build status: STARTED
[03:24:20.966] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:14:0) after 5m58s
[03:30:18.983] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:14:0)
[03:30:19.010] Build status: STARTED
[03:30:19.010] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:15:0) after 4m43s
[03:35:02.124] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:15:0)
[03:35:02.155] Build status: STARTED
[03:35:02.155] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:16:0) after 5m55s
[03:40:57.186] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:16:0)
[03:40:57.214] Build status: STARTED
[03:40:57.214] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:17:0) after 9m23s
[03:50:20.307] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:17:0)
[03:50:20.334] Build status: STARTED
[03:50:20.334] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:18:0) after 5m24s
[03:55:44.387] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:18:0)
[03:55:44.409] Build status: STARTED
[03:55:44.409] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:19:0) after 5m4s
[04:00:48.693] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:19:0)
[04:00:48.717] Build status: STARTED
[04:00:48.717] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:20:0) after 2m8s
[04:02:56.764] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:20:0)
[04:02:56.786] Build status: STARTED
[04:02:56.786] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:21:0) after 1m29s
[04:04:25.859] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:21:0)
[04:04:25.880] Build status: STARTED
[04:04:25.880] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:22:0) after 8m49s
[04:13:14.902] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:22:0)
[04:13:14.970] Build status: STARTED
[04:13:14.970] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:23:0) after 8m38s
[04:21:53.055] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:23:0)
[04:21:53.084] Build status: STARTED
[04:21:53.084] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:24:0) after 2m19s
[04:24:12.109] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:24:0)
[04:24:12.132] Build status: STARTED
[04:24:12.132] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:25:0) after 6m8s
[04:30:20.265] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:25:0)
[04:30:20.297] Build status: STARTED
[04:30:20.297] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:26:0) after 1m15s
[04:31:35.351] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:26:0)
[04:31:35.372] Build status: STARTED
[04:31:35.372] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:27:0) after 5m2s
[04:36:37.492] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:27:0)
[04:36:37.519] Build status: STARTED
[04:36:37.519] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:28:0) after 3m46s
[04:40:23.538] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:28:0)
[04:40:23.563] Build status: STARTED
[04:40:23.563] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:29:0) after 8m43s
[04:49:06.630] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:29:0)
[04:49:06.682] Build status: STARTED
[04:49:06.682] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:30:0) after 4m7s
[04:53:13.715] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:30:0)
[04:53:13.738] Build status: STARTED
[04:53:13.738] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:31:0) after 8m53s
[05:02:06.862] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:31:0)
[05:02:06.886] Build status: STARTED
[05:02:06.886] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:32:0) after 7m4s
[05:09:10.874] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:32:0)
[05:09:10.900] Build status: STARTED
[05:09:10.900] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:33:0) after 1m7s
[05:10:18.027] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:33:0)
[05:10:18.051] Build status: STARTED
[05:10:18.051] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:34:0) after 2m45s
[05:13:03.178] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:34:0)
[05:13:03.218] Build status: STARTED
[05:13:03.218] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:35:0) after 1m5s
[05:14:08.295] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:35:0)
[05:14:08.319] Build status: STARTED
[05:14:08.319] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:36:0) after 1m49s
[05:15:57.656] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:36:0)
[05:15:57.730] Build status: STARTED
[05:15:57.730] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:37:0) after 2m36s
[05:18:33.749] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:37:0)
[05:18:33.774] Build status: STARTED
[05:18:33.774] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:38:0) after 8m16s
[05:26:49.794] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:38:0)
[05:26:49.822] Build status: STARTED
[05:26:49.822] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:39:0) after 6m17s
[05:33:06.913] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:39:0)
[05:33:07.010] Build status: STARTED
[05:33:07.010] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:40:0) after 9m28s
[05:42:35.000] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:40:0)
[05:42:35.021] Build status: STARTED
[05:42:35.021] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:41:0) after 6m10s
[05:48:45.042] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:41:0)
[05:48:45.066] Build status: STARTED
[05:48:45.066] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:42:0) after 5m55s
[05:54:40.049] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:42:0)
[05:54:40.124] Build status: STARTED
[05:54:40.124] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:43:0) after 8m14s
[06:02:54.249] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:43:0)
[06:02:54.272] Build status: STARTED
[06:02:54.272] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:44:0) after 6m14s
[06:09:08.393] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:44:0)
[06:09:08.417] Build status: STARTED
[06:09:08.417] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:45:0) after 7m53s
[06:17:01.536] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:45:0)
[06:17:01.558] Build status: STARTED
[06:17:01.558] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:46:0) after 4m22s
[06:21:23.693] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:46:0)
[06:21:23.716] Build status: STARTED
[06:21:23.716] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:47:0) after 6m14s
[06:27:37.851] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:47:0)
[06:27:37.937] Build status: STARTED
[06:27:37.937] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:48:0) after 1m47s
[06:29:25.119] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:48:0)
[06:29:25.147] Build status: STARTED
[06:29:25.147] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:49:0) after 9m17s
[06:38:42.171] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:49:0)
[06:38:42.193] Build status: STARTED
[06:38:42.193] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:50:0) after 2m37s
[06:41:19.251] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:50:0)
[06:41:19.275] Build status: STARTED
[06:41:19.275] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:51:0) after 4m18s
[06:45:37.299] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:51:0)
[06:45:37.323] Build status: STARTED
[06:45:37.323] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:52:0) after 8m14s
[06:53:51.578] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:52:0)
[06:53:51.606] Build status: STARTED
[06:53:51.606] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:53:0) after 8m34s
[07:02:25.632] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:53:0)
[07:02:25.657] Build status: STARTED
[07:02:25.657] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:54:0) after 8m16s
[07:10:41.793] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:54:0)
[07:10:41.816] Build status: STARTED
[07:10:41.816] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:55:0) after 7m8s
[07:17:49.840] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:55:0)
[07:17:49.862] Build status: STARTED
[07:17:49.862] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:56:0) after 2m12s
[07:20:01.884] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:56:0)
[07:20:01.924] Build status: STARTED
[07:20:01.924] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:57:0) after 1m6s
[07:21:08.053] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:57:0)
[07:21:08.078] Build status: STARTED
[07:21:08.078] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:58:0) after 7m37s
[07:28:45.110] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:58:0)
[07:28:45.136] Build status: STARTED
[07:28:45.136] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:59:0) after 8m33s
[07:37:18.169] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:59:0)
[07:37:18.196] Build status: STARTED
[07:37:18.196] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:60:0) after 1m5s
[07:38:23.557] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:60:0)
[07:38:23.583] Build status: STARTED
[07:38:23.583] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:61:0) after 7m47s
[07:46:10.917] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:61:0)
[07:46:10.954] Build status: STARTED
[07:46:10.954] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:62:0) after 3m49s
[07:50:00.253] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:62:0)
[07:50:00.276] Build status: STARTED
[07:50:00.276] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:63:0) after 3m13s
[07:53:13.295] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:63:0)
[07:53:13.325] Build status: STARTED
[07:53:13.325] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:64:0) after 8m25s
[08:01:38.454] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:64:0)
[08:01:38.485] Build status: STARTED
[08:01:38.485] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:65:0) after 5m28s
[08:07:06.528] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:65:0)
[08:07:06.583] Build status: STARTED
[08:07:06.583] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:66:0) after 2m15s
[08:09:21.700] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:66:0)
[08:09:21.724] Build status: STARTED
[08:09:21.724] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:67:0) after 7m53s
[08:17:14.748] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:67:0)
[08:17:14.769] Build status: STARTED
[08:17:14.769] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:68:0) after 9m4s
[08:26:18.793] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:68:0)
[08:26:18.810] Build status: STARTED
[08:26:18.810] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8960994183202765152:69:0) after 4m59s
[08:26:34.860] Received PubSub notification, asking Buildbucket for the build status
[08:26:34.889] Build:
{
"id": "8795564121289290065",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 59760,
"createdBy": "project:chromium",
"createTime": "2022-12-06T02:23:41.430229906Z",
"startTime": "2022-12-06T02:26:16.042503Z",
"endTime": "2022-12-06T08:26:28.325632825Z",
"updateTime": "2022-12-06T08:26:28.325632825Z",
"status": "CANCELED",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "350a7465a669639e0248ccabbce3ff7a98a20a09",
"ref": "refs/heads/main"
}
}
}
[08:26:34.889] Invocation finished in 6h2m54.667753574s with status ABORTED