[07:02:00.268] New invocation is queued and will start shortly
[07:02:01.336] Starting the invocation (attempt 1)
[07:02:01.362] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d91bfe5fca073e390ac3e524fd8243eca30fa0ae"
[07:02:01.362] Popped gitiles commit info from properties and tags
[07:02:01.362] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[07:02:01.362] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[07:02:01.362] Buildbucket request:
{
"requestId": "8916855949308651136",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d91bfe5fca073e390ac3e524fd8243eca30fa0ae",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8916855949308651136"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[07:02:02.203] Scheduled build:
{
"id": "8751425887316296961",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 31491,
"createdBy": "project:chromium",
"createTime": "2024-04-06T07:02:01.541688633Z",
"updateTime": "2024-04-06T07:02:01.541688633Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d91bfe5fca073e390ac3e524fd8243eca30fa0ae",
"ref": "refs/heads/main"
}
}
}
[07:02:02.203] Task URL: https://cr-buildbucket.appspot.com/build/8751425887316296961
[07:02:02.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:2:0) after 9m21s
[07:02:03.076] Received PubSub notification, asking Buildbucket for the build status
[07:02:03.120] Build status: SCHEDULED
[07:03:09.894] Received PubSub notification, asking Buildbucket for the build status
[07:03:09.974] Build status: STARTED
[07:11:23.251] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:2:0)
[07:11:23.275] Build status: STARTED
[07:11:23.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:5:0) after 9m44s
[07:21:07.309] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:5:0)
[07:21:07.337] Build status: STARTED
[07:21:07.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:6:0) after 5m18s
[07:26:25.576] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:6:0)
[07:26:25.649] Build status: STARTED
[07:26:25.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:7:0) after 8m18s
[07:34:43.663] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:7:0)
[07:34:43.691] Build status: STARTED
[07:34:43.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:8:0) after 2m0s
[07:36:43.709] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:8:0)
[07:36:43.734] Build status: STARTED
[07:36:43.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:9:0) after 9m12s
[07:45:55.784] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:9:0)
[07:45:55.825] Build status: STARTED
[07:45:55.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:10:0) after 8m51s
[07:54:46.839] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:10:0)
[07:54:46.858] Build status: STARTED
[07:54:46.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:11:0) after 2m54s
[07:57:40.912] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:11:0)
[07:57:40.939] Build status: STARTED
[07:57:40.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:12:0) after 1m23s
[07:59:04.084] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:12:0)
[07:59:04.106] Build status: STARTED
[07:59:04.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:13:0) after 4m48s
[08:03:52.138] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:13:0)
[08:03:52.156] Build status: STARTED
[08:03:52.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:14:0) after 4m4s
[08:07:56.275] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:14:0)
[08:07:56.294] Build status: STARTED
[08:07:56.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:15:0) after 8m48s
[08:16:44.350] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:15:0)
[08:16:44.372] Build status: STARTED
[08:16:44.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:16:0) after 5m39s
[08:22:23.345] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:16:0)
[08:22:23.364] Build status: STARTED
[08:22:23.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:17:0) after 2m19s
[08:24:42.380] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:17:0)
[08:24:42.542] Build status: STARTED
[08:24:42.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:18:0) after 7m32s
[08:32:14.657] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:18:0)
[08:32:14.745] Build status: STARTED
[08:32:14.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:19:0) after 5m52s
[08:38:06.761] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:19:0)
[08:38:06.783] Build status: STARTED
[08:38:06.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:20:0) after 7m49s
[08:45:55.990] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:20:0)
[08:45:56.037] Build status: STARTED
[08:45:56.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:21:0) after 7m4s
[08:53:00.154] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:21:0)
[08:53:00.176] Build status: STARTED
[08:53:00.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:22:0) after 6m28s
[08:59:28.302] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:22:0)
[08:59:28.321] Build status: STARTED
[08:59:28.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:23:0) after 8m26s
[09:07:54.503] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:23:0)
[09:07:54.535] Build status: STARTED
[09:07:54.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:24:0) after 6m13s
[09:14:07.564] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:24:0)
[09:14:07.585] Build status: STARTED
[09:14:07.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:25:0) after 7m14s
[09:21:21.699] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:25:0)
[09:21:21.723] Build status: STARTED
[09:21:21.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:26:0) after 3m46s
[09:25:07.867] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:26:0)
[09:25:07.885] Build status: STARTED
[09:25:07.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:27:0) after 1m3s
[09:26:11.008] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:27:0)
[09:26:11.026] Build status: STARTED
[09:26:11.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:28:0) after 3m41s
[09:29:52.043] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:28:0)
[09:29:52.057] Build status: STARTED
[09:29:52.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:29:0) after 8m29s
[09:38:21.060] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:29:0)
[09:38:21.087] Build status: STARTED
[09:38:21.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:30:0) after 4m56s
[09:43:17.496] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:30:0)
[09:43:17.518] Build status: STARTED
[09:43:17.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:31:0) after 7m53s
[09:51:10.733] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:31:0)
[09:51:10.755] Build status: STARTED
[09:51:10.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:32:0) after 6m5s
[09:57:15.807] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:32:0)
[09:57:15.835] Build status: STARTED
[09:57:15.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:33:0) after 5m35s
[10:02:51.060] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:33:0)
[10:02:51.156] Build status: STARTED
[10:02:51.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:34:0) after 3m49s
[10:06:40.176] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:34:0)
[10:06:40.197] Build status: STARTED
[10:06:40.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:35:0) after 1m29s
[10:08:09.337] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:35:0)
[10:08:09.390] Build status: STARTED
[10:08:09.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:36:0) after 8m36s
[10:16:45.466] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:36:0)
[10:16:45.494] Build status: STARTED
[10:16:45.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:37:0) after 2m10s
[10:18:55.530] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:37:0)
[10:18:55.650] Build status: STARTED
[10:18:55.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:38:0) after 9m41s
[10:28:36.769] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:38:0)
[10:28:36.792] Build status: STARTED
[10:28:36.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:39:0) after 6m27s
[10:35:03.811] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:39:0)
[10:35:03.828] Build status: STARTED
[10:35:03.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:40:0) after 5m42s
[10:40:45.851] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:40:0)
[10:40:45.971] Build status: STARTED
[10:40:45.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:41:0) after 6m17s
[10:47:03.018] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:41:0)
[10:47:03.104] Build status: STARTED
[10:47:03.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:42:0) after 1m40s
[10:48:43.120] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:42:0)
[10:48:43.224] Build status: STARTED
[10:48:43.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:43:0) after 3m18s
[10:52:01.266] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:43:0)
[10:52:01.289] Build status: STARTED
[10:52:01.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:44:0) after 5m44s
[10:57:45.663] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:44:0)
[10:57:45.682] Build status: STARTED
[10:57:45.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:45:0) after 5m29s
[11:03:15.010] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:45:0)
[11:03:15.032] Build status: STARTED
[11:03:15.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:46:0) after 1m1s
[11:04:17.179] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:46:0)
[11:04:17.203] Build status: STARTED
[11:04:17.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:47:0) after 6m28s
[11:10:45.403] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:47:0)
[11:10:45.424] Build status: STARTED
[11:10:45.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:48:0) after 6m58s
[11:17:43.451] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:48:0)
[11:17:43.469] Build status: STARTED
[11:17:43.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:49:0) after 8m43s
[11:26:26.800] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:49:0)
[11:26:26.849] Build status: STARTED
[11:26:26.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:50:0) after 8m26s
[11:34:52.860] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:50:0)
[11:34:52.885] Build status: STARTED
[11:34:52.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:51:0) after 2m0s
[11:36:53.029] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:51:0)
[11:36:53.055] Build status: STARTED
[11:36:53.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:52:0) after 3m27s
[11:40:20.218] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:52:0)
[11:40:20.252] Build status: STARTED
[11:40:20.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:53:0) after 5m10s
[11:45:30.350] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:53:0)
[11:45:30.377] Build status: STARTED
[11:45:30.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:54:0) after 5m10s
[11:50:40.405] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:54:0)
[11:50:40.420] Build status: STARTED
[11:50:40.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:55:0) after 6m28s
[11:57:08.431] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:55:0)
[11:57:08.457] Build status: STARTED
[11:57:08.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:56:0) after 7m7s
[12:04:15.617] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:56:0)
[12:04:15.650] Build status: STARTED
[12:04:15.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:57:0) after 9m4s
[12:13:19.813] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:57:0)
[12:13:19.839] Build status: STARTED
[12:13:19.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:58:0) after 5m4s
[12:18:23.919] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:58:0)
[12:18:23.950] Build status: STARTED
[12:18:23.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:59:0) after 3m0s
[12:21:23.966] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:59:0)
[12:21:23.984] Build status: STARTED
[12:21:23.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:60:0) after 5m17s
[12:26:41.152] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:60:0)
[12:26:41.176] Build status: STARTED
[12:26:41.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:61:0) after 3m36s
[12:30:17.199] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:61:0)
[12:30:17.265] Build status: STARTED
[12:30:17.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:62:0) after 6m32s
[12:36:49.336] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:62:0)
[12:36:49.358] Build status: STARTED
[12:36:49.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:63:0) after 9m2s
[12:45:51.375] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:63:0)
[12:45:51.454] Build status: STARTED
[12:45:51.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:64:0) after 8m17s
[12:54:08.686] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:64:0)
[12:54:08.771] Build status: STARTED
[12:54:08.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8916855949308651136:65:0) after 6m26s
[13:00:06.356] Received PubSub notification, asking Buildbucket for the build status
[13:00:06.425] Build:
{
"id": "8751425887316296961",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 31491,
"createdBy": "project:chromium",
"createTime": "2024-04-06T07:02:01.541688633Z",
"startTime": "2024-04-06T07:03:09.670718733Z",
"endTime": "2024-04-06T13:00:06.062306336Z",
"updateTime": "2024-04-06T13:00:06.062306336Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d91bfe5fca073e390ac3e524fd8243eca30fa0ae",
"ref": "refs/heads/main"
}
}
}
[13:00:06.425] Invocation finished in 5h58m6.167670674s with status FAILED