[19:35:39.528] New invocation is queued and will start shortly
[19:35:40.975] Starting the invocation (attempt 1)
[19:35:41.010] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/ccde4317580f1639205ddd310fe07f4f99d6b48d"
[19:35:41.010] Popped gitiles commit info from properties and tags
[19:35:41.011] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:35:41.012] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:35:41.012] Buildbucket request:
{
"requestId": "8961744628809367328",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ccde4317580f1639205ddd310fe07f4f99d6b48d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8961744628809367328"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:35:41.687] Scheduled build:
{
"id": "8796314566522598065",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 59636,
"createdBy": "project:chromium",
"createTime": "2022-11-27T19:35:41.085687961Z",
"updateTime": "2022-11-27T19:35:41.085687961Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ccde4317580f1639205ddd310fe07f4f99d6b48d",
"ref": "refs/heads/main"
}
}
}
[19:35:41.687] Task URL: https://cr-buildbucket.appspot.com/build/8796314566522598065
[19:35:41.687] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:2:0) after 9m40s
[19:37:55.852] Received PubSub notification, asking Buildbucket for the build status
[19:37:55.870] Build status: STARTED
[19:45:21.743] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:2:0)
[19:45:21.780] Build status: STARTED
[19:45:21.780] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:4:0) after 8m53s
[19:54:14.780] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:4:0)
[19:54:14.799] Build status: STARTED
[19:54:14.799] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:5:0) after 7m3s
[20:01:17.901] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:5:0)
[20:01:17.927] Build status: STARTED
[20:01:17.927] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:6:0) after 7m31s
[20:08:48.949] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:6:0)
[20:08:48.970] Build status: STARTED
[20:08:48.970] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:7:0) after 7m11s
[20:15:59.990] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:7:0)
[20:16:00.012] Build status: STARTED
[20:16:00.012] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:8:0) after 9m15s
[20:25:15.035] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:8:0)
[20:25:15.057] Build status: STARTED
[20:25:15.057] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:9:0) after 6m46s
[20:32:01.074] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:9:0)
[20:32:01.103] Build status: STARTED
[20:32:01.103] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:10:0) after 9m7s
[20:41:08.127] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:10:0)
[20:41:08.158] Build status: STARTED
[20:41:08.158] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:11:0) after 5m17s
[20:46:25.336] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:11:0)
[20:46:25.391] Build status: STARTED
[20:46:25.391] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:12:0) after 4m48s
[20:51:13.410] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:12:0)
[20:51:13.438] Build status: STARTED
[20:51:13.438] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:13:0) after 9m49s
[21:01:02.464] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:13:0)
[21:01:02.487] Build status: STARTED
[21:01:02.488] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:14:0) after 1m32s
[21:02:34.503] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:14:0)
[21:02:34.529] Build status: STARTED
[21:02:34.529] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:15:0) after 4m12s
[21:06:46.546] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:15:0)
[21:06:46.565] Build status: STARTED
[21:06:46.565] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:16:0) after 3m51s
[21:10:37.762] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:16:0)
[21:10:37.788] Build status: STARTED
[21:10:37.788] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:17:0) after 8m28s
[21:19:06.124] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:17:0)
[21:19:06.145] Build status: STARTED
[21:19:06.145] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:18:0) after 2m50s
[21:21:56.301] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:18:0)
[21:21:56.326] Build status: STARTED
[21:21:56.326] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:19:0) after 8m41s
[21:30:37.345] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:19:0)
[21:30:37.365] Build status: STARTED
[21:30:37.365] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:20:0) after 9m20s
[21:39:57.383] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:20:0)
[21:39:57.408] Build status: STARTED
[21:39:57.408] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:21:0) after 3m28s
[21:43:25.425] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:21:0)
[21:43:25.443] Build status: STARTED
[21:43:25.443] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:22:0) after 8m17s
[21:51:42.458] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:22:0)
[21:51:42.479] Build status: STARTED
[21:51:42.479] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:23:0) after 3m45s
[21:55:27.499] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:23:0)
[21:55:27.529] Build status: STARTED
[21:55:27.529] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:24:0) after 2m34s
[21:58:01.551] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:24:0)
[21:58:01.575] Build status: STARTED
[21:58:01.575] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:25:0) after 9m46s
[22:07:47.839] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:25:0)
[22:07:47.861] Build status: STARTED
[22:07:47.861] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:26:0) after 7m7s
[22:14:55.133] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:26:0)
[22:14:55.153] Build status: STARTED
[22:14:55.153] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:27:0) after 6m44s
[22:21:39.170] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:27:0)
[22:21:39.207] Build status: STARTED
[22:21:39.207] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:28:0) after 5m14s
[22:26:53.235] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:28:0)
[22:26:53.272] Build status: STARTED
[22:26:53.272] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:29:0) after 2m17s
[22:29:10.301] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:29:0)
[22:29:10.321] Build status: STARTED
[22:29:10.321] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:30:0) after 5m39s
[22:34:49.340] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:30:0)
[22:34:49.359] Build status: STARTED
[22:34:49.359] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:31:0) after 1m42s
[22:36:31.374] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:31:0)
[22:36:31.395] Build status: STARTED
[22:36:31.395] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:32:0) after 1m15s
[22:37:46.504] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:32:0)
[22:37:46.528] Build status: STARTED
[22:37:46.528] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:33:0) after 4m39s
[22:42:25.554] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:33:0)
[22:42:25.577] Build status: STARTED
[22:42:25.578] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:34:0) after 6m54s
[22:49:19.593] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:34:0)
[22:49:19.616] Build status: STARTED
[22:49:19.616] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:35:0) after 1m8s
[22:50:27.888] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:35:0)
[22:50:27.947] Build status: STARTED
[22:50:27.947] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:36:0) after 6m36s
[22:57:03.937] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:36:0)
[22:57:03.957] Build status: STARTED
[22:57:03.957] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:37:0) after 2m20s
[22:59:24.202] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:37:0)
[22:59:24.221] Build status: STARTED
[22:59:24.222] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:38:0) after 6m22s
[23:05:46.296] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:38:0)
[23:05:46.318] Build status: STARTED
[23:05:46.318] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:39:0) after 3m12s
[23:08:58.441] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:39:0)
[23:08:58.469] Build status: STARTED
[23:08:58.469] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:40:0) after 5m14s
[23:14:12.698] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:40:0)
[23:14:12.720] Build status: STARTED
[23:14:12.720] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:41:0) after 3m27s
[23:17:39.736] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:41:0)
[23:17:39.759] Build status: STARTED
[23:17:39.759] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:42:0) after 5m37s
[23:23:16.832] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:42:0)
[23:23:16.854] Build status: STARTED
[23:23:16.854] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:43:0) after 1m35s
[23:24:52.034] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:43:0)
[23:24:52.059] Build status: STARTED
[23:24:52.059] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:44:0) after 9m29s
[23:34:21.076] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:44:0)
[23:34:21.097] Build status: STARTED
[23:34:21.097] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:45:0) after 3m57s
[23:38:18.116] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:45:0)
[23:38:18.178] Build status: STARTED
[23:38:18.178] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:46:0) after 1m31s
[23:39:49.484] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:46:0)
[23:39:49.505] Build status: STARTED
[23:39:49.505] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:47:0) after 3m16s
[23:43:05.650] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:47:0)
[23:43:05.675] Build status: STARTED
[23:43:05.675] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:48:0) after 1m55s
[23:45:00.771] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:48:0)
[23:45:00.801] Build status: STARTED
[23:45:00.802] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:49:0) after 5m57s
[23:50:57.838] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:49:0)
[23:50:57.859] Build status: STARTED
[23:50:57.859] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:50:0) after 4m42s
[23:55:39.876] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:50:0)
[23:55:39.897] Build status: STARTED
[23:55:39.897] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:51:0) after 1m51s
[23:57:30.913] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:51:0)
[23:57:30.937] Build status: STARTED
[23:57:30.937] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:52:0) after 7m58s
[00:05:28.957] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:52:0)
[00:05:28.980] Build status: STARTED
[00:05:28.980] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:53:0) after 1m15s
[00:06:44.008] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:53:0)
[00:06:44.042] Build status: STARTED
[00:06:44.042] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:54:0) after 9m48s
[00:16:32.099] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:54:0)
[00:16:32.124] Build status: STARTED
[00:16:32.124] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:55:0) after 2m51s
[00:19:23.159] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:55:0)
[00:19:23.186] Build status: STARTED
[00:19:23.186] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:56:0) after 9m46s
[00:29:09.326] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:56:0)
[00:29:09.354] Build status: STARTED
[00:29:09.354] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:57:0) after 4m51s
[00:34:00.382] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:57:0)
[00:34:00.405] Build status: STARTED
[00:34:00.405] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:58:0) after 6m49s
[00:40:49.428] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:58:0)
[00:40:49.447] Build status: STARTED
[00:40:49.447] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:59:0) after 3m15s
[00:44:04.469] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:59:0)
[00:44:04.492] Build status: STARTED
[00:44:04.492] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:60:0) after 9m8s
[00:53:12.726] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:60:0)
[00:53:12.775] Build status: STARTED
[00:53:12.775] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:61:0) after 5m6s
[00:58:18.826] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:61:0)
[00:58:18.849] Build status: STARTED
[00:58:18.849] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:62:0) after 9m48s
[01:08:06.868] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:62:0)
[01:08:06.895] Build status: STARTED
[01:08:06.895] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:63:0) after 9m43s
[01:17:49.909] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:63:0)
[01:17:49.988] Build status: STARTED
[01:17:49.988] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:64:0) after 2m19s
[01:20:09.161] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:64:0)
[01:20:09.193] Build status: STARTED
[01:20:09.194] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:65:0) after 6m26s
[01:26:35.215] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:65:0)
[01:26:35.239] Build status: STARTED
[01:26:35.240] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:66:0) after 2m19s
[01:28:54.320] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:66:0)
[01:28:54.343] Build status: STARTED
[01:28:54.343] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:67:0) after 4m3s
[01:32:57.642] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:67:0)
[01:32:57.668] Build status: STARTED
[01:32:57.668] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8961744628809367328:68:0) after 7m56s
[01:38:07.527] Received PubSub notification, asking Buildbucket for the build status
[01:38:07.561] Build:
{
"id": "8796314566522598065",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 59636,
"createdBy": "project:chromium",
"createTime": "2022-11-27T19:35:41.085687961Z",
"startTime": "2022-11-27T19:37:55.380901Z",
"endTime": "2022-11-28T01:38:07.246337226Z",
"updateTime": "2022-11-28T01:38:07.246337226Z",
"status": "CANCELED",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ccde4317580f1639205ddd310fe07f4f99d6b48d",
"ref": "refs/heads/main"
}
}
}
[01:38:07.561] Invocation finished in 6h2m28.041190006s with status ABORTED