[08:26:41.001] New invocation is queued and will start shortly
[08:26:42.067] Starting the invocation (attempt 1)
[08:26:42.093] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/8f10beb34cd1a23a19aec49caa73dd043834a126"
[08:26:42.093] Popped gitiles commit info from properties and tags
[08:26:42.093] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:26:42.094] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:26:42.094] Buildbucket request:
{
"requestId": "8924551363921584992",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8f10beb34cd1a23a19aec49caa73dd043834a126",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8924551363921584992"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:26:42.965] Scheduled build:
{
"id": "8759121302054715201",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 30985,
"createdBy": "project:chromium",
"createTime": "2024-01-12T08:26:42.151018357Z",
"updateTime": "2024-01-12T08:26:42.151018357Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8f10beb34cd1a23a19aec49caa73dd043834a126",
"ref": "refs/heads/main"
}
}
}
[08:26:42.965] Task URL: https://cr-buildbucket.appspot.com/build/8759121302054715201
[08:26:42.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:2:0) after 3m15s
[08:26:48.856] Received PubSub notification, asking Buildbucket for the build status
[08:26:48.882] Build status: STARTED
[08:26:53.179] Received PubSub notification, asking Buildbucket for the build status
[08:26:53.244] Build status: STARTED
[08:29:58.081] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:2:0)
[08:29:58.103] Build status: STARTED
[08:29:58.103] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:5:0) after 1m28s
[08:31:26.124] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:5:0)
[08:31:26.143] Build status: STARTED
[08:31:26.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:6:0) after 5m16s
[08:36:42.335] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:6:0)
[08:36:42.358] Build status: STARTED
[08:36:42.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:7:0) after 3m43s
[08:40:25.453] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:7:0)
[08:40:25.483] Build status: STARTED
[08:40:25.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:8:0) after 1m57s
[08:42:22.523] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:8:0)
[08:42:22.540] Build status: STARTED
[08:42:22.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:9:0) after 6m8s
[08:48:30.563] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:9:0)
[08:48:30.592] Build status: STARTED
[08:48:30.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:10:0) after 7m26s
[08:55:56.889] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:10:0)
[08:55:56.908] Build status: STARTED
[08:55:56.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:11:0) after 1m17s
[08:57:14.049] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:11:0)
[08:57:14.128] Build status: STARTED
[08:57:14.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:12:0) after 4m1s
[09:01:15.187] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:12:0)
[09:01:15.209] Build status: STARTED
[09:01:15.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:13:0) after 3m23s
[09:04:38.486] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:13:0)
[09:04:38.502] Build status: STARTED
[09:04:38.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:14:0) after 5m29s
[09:10:07.643] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:14:0)
[09:10:07.665] Build status: STARTED
[09:10:07.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:15:0) after 9m54s
[09:20:01.781] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:15:0)
[09:20:01.802] Build status: STARTED
[09:20:01.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:16:0) after 1m28s
[09:21:29.970] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:16:0)
[09:21:29.998] Build status: STARTED
[09:21:29.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:17:0) after 3m44s
[09:25:14.144] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:17:0)
[09:25:14.161] Build status: STARTED
[09:25:14.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:18:0) after 7m6s
[09:32:20.134] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:18:0)
[09:32:20.247] Build status: STARTED
[09:32:20.248] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:19:0) after 5m15s
[09:37:35.363] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:19:0)
[09:37:35.390] Build status: STARTED
[09:37:35.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:20:0) after 4m9s
[09:41:44.409] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:20:0)
[09:41:44.433] Build status: STARTED
[09:41:44.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:21:0) after 7m0s
[09:48:44.503] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:21:0)
[09:48:44.522] Build status: STARTED
[09:48:44.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:22:0) after 8m51s
[09:57:35.611] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:22:0)
[09:57:35.629] Build status: STARTED
[09:57:35.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:23:0) after 1m41s
[09:59:16.960] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:23:0)
[09:59:17.044] Build status: STARTED
[09:59:17.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:24:0) after 9m11s
[10:08:28.199] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:24:0)
[10:08:28.222] Build status: STARTED
[10:08:28.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:25:0) after 1m19s
[10:09:47.336] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:25:0)
[10:09:47.354] Build status: STARTED
[10:09:47.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:26:0) after 1m28s
[10:11:15.428] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:26:0)
[10:11:15.473] Build status: STARTED
[10:11:15.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:27:0) after 2m47s
[10:14:02.746] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:27:0)
[10:14:02.768] Build status: STARTED
[10:14:02.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:28:0) after 3m29s
[10:17:31.943] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:28:0)
[10:17:31.964] Build status: STARTED
[10:17:31.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:29:0) after 8m50s
[10:26:22.016] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:29:0)
[10:26:22.036] Build status: STARTED
[10:26:22.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:30:0) after 3m27s
[10:29:49.557] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:30:0)
[10:29:49.579] Build status: STARTED
[10:29:49.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:31:0) after 8m31s
[10:38:21.233] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:31:0)
[10:38:21.249] Build status: STARTED
[10:38:21.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:32:0) after 6m17s
[10:44:38.277] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:32:0)
[10:44:38.310] Build status: STARTED
[10:44:38.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:33:0) after 7m56s
[10:52:34.484] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:33:0)
[10:52:34.501] Build status: STARTED
[10:52:34.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:34:0) after 3m33s
[10:56:07.531] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:34:0)
[10:56:07.556] Build status: STARTED
[10:56:07.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:35:0) after 8m27s
[11:04:34.578] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:35:0)
[11:04:34.647] Build status: STARTED
[11:04:34.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:36:0) after 5m35s
[11:10:09.661] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:36:0)
[11:10:09.718] Build status: STARTED
[11:10:09.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:37:0) after 6m56s
[11:17:05.767] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:37:0)
[11:17:05.787] Build status: STARTED
[11:17:05.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:38:0) after 1m56s
[11:19:01.807] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:38:0)
[11:19:01.826] Build status: STARTED
[11:19:01.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:39:0) after 1m40s
[11:20:41.969] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:39:0)
[11:20:41.997] Build status: STARTED
[11:20:41.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:40:0) after 6m36s
[11:27:17.980] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:40:0)
[11:27:18.024] Build status: STARTED
[11:27:18.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:41:0) after 5m13s
[11:32:31.542] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:41:0)
[11:32:31.574] Build status: STARTED
[11:32:31.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:42:0) after 2m36s
[11:35:07.560] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:42:0)
[11:35:07.612] Build status: STARTED
[11:35:07.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:43:0) after 9m56s
[11:45:03.822] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:43:0)
[11:45:03.857] Build status: STARTED
[11:45:03.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:44:0) after 6m39s
[11:51:42.973] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:44:0)
[11:51:42.991] Build status: STARTED
[11:51:42.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:45:0) after 8m8s
[11:59:51.314] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:45:0)
[11:59:51.330] Build status: STARTED
[11:59:51.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:46:0) after 7m29s
[12:07:20.396] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:46:0)
[12:07:20.416] Build status: STARTED
[12:07:20.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:47:0) after 7m21s
[12:14:41.445] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:47:0)
[12:14:41.465] Build status: STARTED
[12:14:41.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:48:0) after 4m43s
[12:19:24.514] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:48:0)
[12:19:24.530] Build status: STARTED
[12:19:24.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:49:0) after 6m42s
[12:26:07.009] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:49:0)
[12:26:07.038] Build status: STARTED
[12:26:07.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:50:0) after 5m28s
[12:31:35.054] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:50:0)
[12:31:35.125] Build status: STARTED
[12:31:35.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:51:0) after 6m48s
[12:38:23.210] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:51:0)
[12:38:23.228] Build status: STARTED
[12:38:23.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:52:0) after 7m27s
[12:45:50.264] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:52:0)
[12:45:50.282] Build status: STARTED
[12:45:50.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:53:0) after 7m20s
[12:53:10.912] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:53:0)
[12:53:10.936] Build status: STARTED
[12:53:10.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:54:0) after 3m55s
[12:57:06.192] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:54:0)
[12:57:06.221] Build status: STARTED
[12:57:06.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:55:0) after 5m18s
[13:02:24.378] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:55:0)
[13:02:24.400] Build status: STARTED
[13:02:24.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:56:0) after 2m13s
[13:04:37.545] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:56:0)
[13:04:37.609] Build status: STARTED
[13:04:37.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:57:0) after 2m26s
[13:07:03.773] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:57:0)
[13:07:03.832] Build status: STARTED
[13:07:03.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:58:0) after 1m39s
[13:08:42.862] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:58:0)
[13:08:42.886] Build status: STARTED
[13:08:42.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:59:0) after 7m5s
[13:15:48.034] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:59:0)
[13:15:48.054] Build status: STARTED
[13:15:48.054] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:60:0) after 6m40s
[13:22:28.074] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:60:0)
[13:22:28.107] Build status: STARTED
[13:22:28.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:61:0) after 8m15s
[13:30:43.220] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:61:0)
[13:30:43.241] Build status: STARTED
[13:30:43.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:62:0) after 6m23s
[13:37:06.432] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:62:0)
[13:37:06.453] Build status: STARTED
[13:37:06.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:63:0) after 3m35s
[13:40:41.472] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:63:0)
[13:40:41.489] Build status: STARTED
[13:40:41.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:64:0) after 6m26s
[13:47:07.535] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:64:0)
[13:47:07.583] Build status: STARTED
[13:47:07.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:65:0) after 1m25s
[13:48:32.659] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:65:0)
[13:48:32.675] Build status: STARTED
[13:48:32.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:66:0) after 6m23s
[13:54:55.698] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:66:0)
[13:54:55.720] Build status: STARTED
[13:54:55.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:67:0) after 6m22s
[14:01:17.830] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:67:0)
[14:01:17.852] Build status: STARTED
[14:01:17.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:68:0) after 8m59s
[14:10:16.880] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:68:0)
[14:10:16.911] Build status: STARTED
[14:10:16.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:69:0) after 1m9s
[14:11:26.008] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:69:0)
[14:11:26.041] Build status: STARTED
[14:11:26.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924551363921584992:70:0) after 9m24s
[14:13:25.638] Received PubSub notification, asking Buildbucket for the build status
[14:13:25.657] Build:
{
"id": "8759121302054715201",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 30985,
"createdBy": "project:chromium",
"createTime": "2024-01-12T08:26:42.151018357Z",
"startTime": "2024-01-12T08:26:47.406042Z",
"endTime": "2024-01-12T14:13:24.651391Z",
"updateTime": "2024-01-12T14:13:24.651391Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8f10beb34cd1a23a19aec49caa73dd043834a126",
"ref": "refs/heads/main"
}
}
}
[14:13:25.657] Invocation finished in 5h46m44.669904492s with status FAILED