[10:10:02.959] New invocation is queued and will start shortly
[10:10:04.275] Starting the invocation (attempt 1)
[10:10:04.303] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d6f0ae508ecb940e4f6e2e5ca2fd8bed05c0691f"
[10:10:04.303] Popped gitiles commit info from properties and tags
[10:10:04.303] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:10:04.303] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:10:04.303] Buildbucket request:
{
"requestId": "8910139943044423760",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d6f0ae508ecb940e4f6e2e5ca2fd8bed05c0691f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8910139943044423760"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:10:04.973] Scheduled build:
{
"id": "8744709880911082481",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 32213,
"createdBy": "project:chromium",
"createTime": "2024-06-19T10:10:04.359980579Z",
"updateTime": "2024-06-19T10:10:04.359980579Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d6f0ae508ecb940e4f6e2e5ca2fd8bed05c0691f",
"ref": "refs/heads/main"
}
}
}
[10:10:04.973] Task URL: https://cr-buildbucket.appspot.com/build/8744709880911082481
[10:10:04.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:2:0) after 6m33s
[10:10:12.137] Received PubSub notification, asking Buildbucket for the build status
[10:10:12.159] Build status: SCHEDULED
[10:10:37.523] Received PubSub notification, asking Buildbucket for the build status
[10:10:37.546] Build status: STARTED
[10:16:38.222] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:2:0)
[10:16:38.239] Build status: STARTED
[10:16:38.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:5:0) after 7m45s
[10:24:23.259] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:5:0)
[10:24:23.330] Build status: STARTED
[10:24:23.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:6:0) after 1m11s
[10:25:34.378] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:6:0)
[10:25:34.407] Build status: STARTED
[10:25:34.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:7:0) after 4m12s
[10:29:46.592] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:7:0)
[10:29:46.618] Build status: STARTED
[10:29:46.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:8:0) after 5m49s
[10:35:35.865] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:8:0)
[10:35:35.884] Build status: STARTED
[10:35:35.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:9:0) after 2m50s
[10:38:25.900] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:9:0)
[10:38:25.943] Build status: STARTED
[10:38:25.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:10:0) after 7m50s
[10:46:16.149] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:10:0)
[10:46:16.246] Build status: STARTED
[10:46:16.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:11:0) after 4m31s
[10:50:47.268] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:11:0)
[10:50:47.287] Build status: STARTED
[10:50:47.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:12:0) after 2m16s
[10:53:03.305] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:12:0)
[10:53:03.327] Build status: STARTED
[10:53:03.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:13:0) after 6m27s
[10:59:30.385] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:13:0)
[10:59:30.409] Build status: STARTED
[10:59:30.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:14:0) after 9m21s
[11:08:51.439] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:14:0)
[11:08:51.459] Build status: STARTED
[11:08:51.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:15:0) after 6m35s
[11:15:26.608] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:15:0)
[11:15:26.650] Build status: STARTED
[11:15:26.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:16:0) after 8m31s
[11:23:58.007] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:16:0)
[11:23:58.025] Build status: STARTED
[11:23:58.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:17:0) after 2m54s
[11:26:52.038] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:17:0)
[11:26:52.067] Build status: STARTED
[11:26:52.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:18:0) after 4m19s
[11:31:11.093] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:18:0)
[11:31:11.124] Build status: STARTED
[11:31:11.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:19:0) after 6m55s
[11:38:06.343] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:19:0)
[11:38:06.360] Build status: STARTED
[11:38:06.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:20:0) after 5m49s
[11:43:56.003] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:20:0)
[11:43:56.102] Build status: STARTED
[11:43:56.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:21:0) after 6m38s
[11:50:34.273] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:21:0)
[11:50:34.356] Build status: STARTED
[11:50:34.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:22:0) after 4m53s
[11:55:27.382] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:22:0)
[11:55:27.403] Build status: STARTED
[11:55:27.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:23:0) after 9m7s
[12:04:34.485] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:23:0)
[12:04:34.528] Build status: STARTED
[12:04:34.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:24:0) after 7m3s
[12:11:37.906] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:24:0)
[12:11:37.927] Build status: STARTED
[12:11:37.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:25:0) after 3m36s
[12:15:14.073] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:25:0)
[12:15:14.096] Build status: STARTED
[12:15:14.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:26:0) after 3m46s
[12:19:00.193] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:26:0)
[12:19:00.234] Build status: STARTED
[12:19:00.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:27:0) after 2m55s
[12:21:55.426] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:27:0)
[12:21:55.445] Build status: STARTED
[12:21:55.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:28:0) after 6m11s
[12:28:07.055] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:28:0)
[12:28:07.073] Build status: STARTED
[12:28:07.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:29:0) after 3m34s
[12:31:41.283] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:29:0)
[12:31:41.307] Build status: STARTED
[12:31:41.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:30:0) after 3m19s
[12:35:00.341] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:30:0)
[12:35:00.409] Build status: STARTED
[12:35:00.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:31:0) after 7m38s
[12:42:38.522] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:31:0)
[12:42:38.650] Build status: STARTED
[12:42:38.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:32:0) after 7m20s
[12:49:58.718] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:32:0)
[12:49:58.737] Build status: STARTED
[12:49:58.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:33:0) after 6m14s
[12:56:13.009] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:33:0)
[12:56:13.027] Build status: STARTED
[12:56:13.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:34:0) after 7m10s
[13:03:23.354] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:34:0)
[13:03:23.376] Build status: STARTED
[13:03:23.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:35:0) after 7m40s
[13:11:03.555] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:35:0)
[13:11:03.691] Build status: STARTED
[13:11:03.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:36:0) after 5m57s
[13:17:00.717] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:36:0)
[13:17:00.743] Build status: STARTED
[13:17:00.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:37:0) after 8m40s
[13:25:40.863] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:37:0)
[13:25:40.884] Build status: STARTED
[13:25:40.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:38:0) after 2m45s
[13:28:26.141] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:38:0)
[13:28:26.166] Build status: STARTED
[13:28:26.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:39:0) after 9m16s
[13:37:42.190] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:39:0)
[13:37:42.220] Build status: STARTED
[13:37:42.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:40:0) after 8m55s
[13:46:37.254] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:40:0)
[13:46:37.276] Build status: STARTED
[13:46:37.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:41:0) after 9m12s
[13:55:49.302] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:41:0)
[13:55:49.321] Build status: STARTED
[13:55:49.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:42:0) after 7m7s
[14:02:56.423] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:42:0)
[14:02:56.444] Build status: STARTED
[14:02:56.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:43:0) after 7m30s
[14:10:26.717] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:43:0)
[14:10:26.799] Build status: STARTED
[14:10:26.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:44:0) after 9m56s
[14:20:22.815] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:44:0)
[14:20:22.835] Build status: STARTED
[14:20:22.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:45:0) after 1m23s
[14:21:45.829] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:45:0)
[14:21:45.863] Build status: STARTED
[14:21:45.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:46:0) after 7m28s
[14:29:14.040] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:46:0)
[14:29:14.206] Build status: STARTED
[14:29:14.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:47:0) after 1m32s
[14:30:46.908] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:47:0)
[14:30:46.927] Build status: STARTED
[14:30:46.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:48:0) after 8m55s
[14:39:41.984] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:48:0)
[14:39:42.004] Build status: STARTED
[14:39:42.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:49:0) after 9m28s
[14:49:10.087] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:49:0)
[14:49:10.105] Build status: STARTED
[14:49:10.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:50:0) after 2m5s
[14:51:15.126] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:50:0)
[14:51:15.141] Build status: STARTED
[14:51:15.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:51:0) after 2m46s
[14:54:01.164] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:51:0)
[14:54:01.186] Build status: STARTED
[14:54:01.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:52:0) after 1m43s
[14:55:44.215] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:52:0)
[14:55:44.231] Build status: STARTED
[14:55:44.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:53:0) after 9m2s
[15:04:46.303] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:53:0)
[15:04:46.325] Build status: STARTED
[15:04:46.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:54:0) after 9m15s
[15:14:01.347] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:54:0)
[15:14:01.376] Build status: STARTED
[15:14:01.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:55:0) after 9m30s
[15:23:31.373] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:55:0)
[15:23:31.394] Build status: STARTED
[15:23:31.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:56:0) after 6m5s
[15:29:36.413] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:56:0)
[15:29:36.455] Build status: STARTED
[15:29:36.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:57:0) after 8m35s
[15:38:11.519] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:57:0)
[15:38:11.535] Build status: STARTED
[15:38:11.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:58:0) after 6m4s
[15:44:15.557] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:58:0)
[15:44:15.575] Build status: STARTED
[15:44:15.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:59:0) after 7m5s
[15:51:20.810] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:59:0)
[15:51:20.832] Build status: STARTED
[15:51:20.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:60:0) after 9m12s
[16:00:33.260] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:60:0)
[16:00:33.354] Build status: STARTED
[16:00:33.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:61:0) after 7m58s
[16:08:31.412] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:61:0)
[16:08:31.461] Build status: STARTED
[16:08:31.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:62:0) after 3m31s
[16:12:02.500] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:62:0)
[16:12:02.526] Build status: STARTED
[16:12:02.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:63:0) after 1m36s
[16:13:38.551] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:63:0)
[16:13:38.571] Build status: STARTED
[16:13:38.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:64:0) after 1m55s
[16:15:33.644] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:64:0)
[16:15:33.672] Build status: STARTED
[16:15:33.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:65:0) after 2m32s
[16:18:05.692] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:65:0)
[16:18:05.707] Build status: STARTED
[16:18:05.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8910139943044423760:66:0) after 6m43s
[16:22:38.280] Received PubSub notification, asking Buildbucket for the build status
[16:22:38.301] Build:
{
"id": "8744709880911082481",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 32213,
"createdBy": "project:chromium",
"createTime": "2024-06-19T10:10:04.359980579Z",
"startTime": "2024-06-19T10:10:32.152079017Z",
"endTime": "2024-06-19T16:22:37.849930658Z",
"updateTime": "2024-06-19T16:22:37.849930658Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d6f0ae508ecb940e4f6e2e5ca2fd8bed05c0691f",
"ref": "refs/heads/main"
}
}
}
[16:22:38.301] Invocation finished in 6h12m35.359604158s with status FAILED