[06:40:48.246] New invocation is queued and will start shortly
[06:42:01.707] Starting the invocation (attempt 1)
[06:42:01.733] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/ac8c360346e2c320d33fbef46672f24ec05b16c8"
[06:42:01.733] Popped gitiles commit info from properties and tags
[06:42:01.733] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[06:42:01.733] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[06:42:01.733] Buildbucket request:
{
"requestId": "8885963717582066496",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ac8c360346e2c320d33fbef46672f24ec05b16c8",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8885963717582066496"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[06:42:02.357] Scheduled build:
{
"id": "8720533579796750993",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 35004,
"createdBy": "project:chromium",
"createTime": "2025-03-13T06:42:01.797149239Z",
"updateTime": "2025-03-13T06:42:01.797149239Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ac8c360346e2c320d33fbef46672f24ec05b16c8",
"ref": "refs/heads/main"
}
}
}
[06:42:02.357] Task URL: https://cr-buildbucket.appspot.com/build/8720533579796750993
[06:42:02.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:2:0) after 6m39s
[06:42:41.514] Received PubSub notification, asking Buildbucket for the build status
[06:42:41.543] Build status: STARTED
[06:42:55.949] Received PubSub notification, asking Buildbucket for the build status
[06:42:55.976] Build status: STARTED
[06:48:41.707] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:2:0)
[06:48:41.739] Build status: STARTED
[06:48:41.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:5:0) after 3m47s
[06:52:28.766] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:5:0)
[06:52:28.838] Build status: STARTED
[06:52:28.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:6:0) after 3m22s
[06:55:50.858] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:6:0)
[06:55:50.928] Build status: STARTED
[06:55:50.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:7:0) after 5m23s
[07:01:14.012] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:7:0)
[07:01:14.067] Build status: STARTED
[07:01:14.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:8:0) after 9m58s
[07:11:12.208] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:8:0)
[07:11:12.272] Build status: STARTED
[07:11:12.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:9:0) after 8m57s
[07:20:09.301] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:9:0)
[07:20:09.318] Build status: STARTED
[07:20:09.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:10:0) after 9m2s
[07:29:11.365] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:10:0)
[07:29:11.393] Build status: STARTED
[07:29:11.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:11:0) after 6m11s
[07:35:22.435] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:11:0)
[07:35:22.468] Build status: STARTED
[07:35:22.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:12:0) after 5m39s
[07:41:01.493] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:12:0)
[07:41:01.555] Build status: STARTED
[07:41:01.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:13:0) after 8m28s
[07:49:29.952] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:13:0)
[07:49:30.051] Build status: STARTED
[07:49:30.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:14:0) after 1m39s
[07:51:09.119] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:14:0)
[07:51:09.176] Build status: STARTED
[07:51:09.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:15:0) after 5m55s
[07:57:04.213] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:15:0)
[07:57:04.231] Build status: STARTED
[07:57:04.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:16:0) after 9m24s
[08:06:28.256] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:16:0)
[08:06:28.326] Build status: STARTED
[08:06:28.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:17:0) after 4m47s
[08:11:15.356] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:17:0)
[08:11:15.373] Build status: STARTED
[08:11:15.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:18:0) after 8m59s
[08:20:14.435] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:18:0)
[08:20:14.459] Build status: STARTED
[08:20:14.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:19:0) after 6m59s
[08:27:13.515] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:19:0)
[08:27:13.534] Build status: STARTED
[08:27:13.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:20:0) after 1m44s
[08:28:57.729] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:20:0)
[08:28:57.749] Build status: STARTED
[08:28:57.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:21:0) after 5m14s
[08:34:12.189] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:21:0)
[08:34:12.206] Build status: STARTED
[08:34:12.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:22:0) after 3m29s
[08:37:41.529] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:22:0)
[08:37:41.545] Build status: STARTED
[08:37:41.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:23:0) after 4m13s
[08:41:54.570] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:23:0)
[08:41:54.608] Build status: STARTED
[08:41:54.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:24:0) after 3m1s
[08:44:55.655] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:24:0)
[08:44:55.674] Build status: STARTED
[08:44:55.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:25:0) after 7m59s
[08:52:54.716] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:25:0)
[08:52:54.734] Build status: STARTED
[08:52:54.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:26:0) after 5m54s
[08:58:48.865] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:26:0)
[08:58:48.881] Build status: STARTED
[08:58:48.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:27:0) after 7m30s
[09:06:18.905] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:27:0)
[09:06:18.924] Build status: STARTED
[09:06:18.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:28:0) after 6m54s
[09:13:12.951] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:28:0)
[09:13:12.965] Build status: STARTED
[09:13:12.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:29:0) after 1m55s
[09:15:08.090] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:29:0)
[09:15:08.110] Build status: STARTED
[09:15:08.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:30:0) after 5m39s
[09:20:47.235] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:30:0)
[09:20:47.253] Build status: STARTED
[09:20:47.254] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:31:0) after 5m32s
[09:26:19.269] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:31:0)
[09:26:19.286] Build status: STARTED
[09:26:19.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:32:0) after 6m33s
[09:32:52.351] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:32:0)
[09:32:52.371] Build status: STARTED
[09:32:52.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:33:0) after 3m54s
[09:36:46.423] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:33:0)
[09:36:46.443] Build status: STARTED
[09:36:46.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:34:0) after 3m39s
[09:40:25.441] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:34:0)
[09:40:25.460] Build status: STARTED
[09:40:25.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:35:0) after 3m54s
[09:44:19.561] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:35:0)
[09:44:19.577] Build status: STARTED
[09:44:19.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:36:0) after 4m5s
[09:48:24.569] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:36:0)
[09:48:24.585] Build status: STARTED
[09:48:24.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:37:0) after 6m25s
[09:54:49.690] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:37:0)
[09:54:49.707] Build status: STARTED
[09:54:49.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:38:0) after 5m19s
[10:00:08.782] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:38:0)
[10:00:08.837] Build status: STARTED
[10:00:08.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:39:0) after 3m19s
[10:03:27.858] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:39:0)
[10:03:27.876] Build status: STARTED
[10:03:27.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:40:0) after 7m50s
[10:11:17.903] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:40:0)
[10:11:17.921] Build status: STARTED
[10:11:17.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:41:0) after 5m55s
[10:17:13.041] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:41:0)
[10:17:13.117] Build status: STARTED
[10:17:13.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:42:0) after 3m3s
[10:20:16.142] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:42:0)
[10:20:16.161] Build status: STARTED
[10:20:16.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:43:0) after 6m5s
[10:26:21.182] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:43:0)
[10:26:21.198] Build status: STARTED
[10:26:21.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:44:0) after 5m26s
[10:31:47.253] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:44:0)
[10:31:47.269] Build status: STARTED
[10:31:47.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:45:0) after 3m22s
[10:35:09.293] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:45:0)
[10:35:09.314] Build status: STARTED
[10:35:09.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:46:0) after 1m27s
[10:36:36.341] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:46:0)
[10:36:36.359] Build status: STARTED
[10:36:36.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:47:0) after 2m49s
[10:39:25.483] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:47:0)
[10:39:25.510] Build status: STARTED
[10:39:25.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:48:0) after 5m42s
[10:45:07.601] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:48:0)
[10:45:07.624] Build status: STARTED
[10:45:07.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:49:0) after 1m15s
[10:46:22.691] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:49:0)
[10:46:22.711] Build status: STARTED
[10:46:22.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:50:0) after 5m8s
[10:51:30.799] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:50:0)
[10:51:30.819] Build status: STARTED
[10:51:30.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:51:0) after 3m19s
[10:54:49.846] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:51:0)
[10:54:49.864] Build status: STARTED
[10:54:49.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:52:0) after 5m52s
[11:00:41.864] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:52:0)
[11:00:41.882] Build status: STARTED
[11:00:41.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:53:0) after 4m27s
[11:05:09.116] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:53:0)
[11:05:09.177] Build status: STARTED
[11:05:09.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:54:0) after 1m58s
[11:07:07.470] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:54:0)
[11:07:07.490] Build status: STARTED
[11:07:07.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:55:0) after 6m40s
[11:13:47.524] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:55:0)
[11:13:47.537] Build status: STARTED
[11:13:47.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:56:0) after 5m19s
[11:19:06.669] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:56:0)
[11:19:06.685] Build status: STARTED
[11:19:06.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:57:0) after 9m13s
[11:28:19.756] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:57:0)
[11:28:19.772] Build status: STARTED
[11:28:19.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:58:0) after 7m21s
[11:35:40.769] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:58:0)
[11:35:40.785] Build status: STARTED
[11:35:40.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:59:0) after 7m2s
[11:42:42.815] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:59:0)
[11:42:42.838] Build status: STARTED
[11:42:42.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:60:0) after 2m0s
[11:44:42.861] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:60:0)
[11:44:42.884] Build status: STARTED
[11:44:42.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:61:0) after 7m35s
[11:52:17.917] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:61:0)
[11:52:17.933] Build status: STARTED
[11:52:17.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:62:0) after 4m38s
[11:56:55.965] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:62:0)
[11:56:56.001] Build status: STARTED
[11:56:56.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:63:0) after 8m19s
[12:05:15.032] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:63:0)
[12:05:15.048] Build status: STARTED
[12:05:15.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:64:0) after 4m19s
[12:09:34.119] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:64:0)
[12:09:34.139] Build status: STARTED
[12:09:34.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885963717582066496:65:0) after 9m1s
[12:16:56.579] Received PubSub notification, asking Buildbucket for the build status
[12:16:56.594] Build:
{
"id": "8720533579796750993",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 35004,
"createdBy": "project:chromium",
"createTime": "2025-03-13T06:42:01.797149239Z",
"startTime": "2025-03-13T06:42:09.374065314Z",
"endTime": "2025-03-13T12:16:56.286204279Z",
"updateTime": "2025-03-13T12:16:56.286204279Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ac8c360346e2c320d33fbef46672f24ec05b16c8",
"ref": "refs/heads/main"
}
}
}
[12:16:56.594] Invocation finished in 5h36m8.362055154s with status FAILED