[09:48:50.301] New invocation is queued and will start shortly
[09:48:51.413] Starting the invocation (attempt 1)
[09:48:51.438] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f1509c79e15cd23ab9e8e72c22bee97120476ec4"
[09:48:51.438] Popped gitiles commit info from properties and tags
[09:48:51.438] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[09:48:51.438] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[09:48:51.438] Buildbucket request:
{
"requestId": "8893380838730891648",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f1509c79e15cd23ab9e8e72c22bee97120476ec4",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8893380838730891648"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[09:48:51.936] Scheduled build:
{
"id": "8727950776825869537",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 33951,
"createdBy": "project:chromium",
"createTime": "2024-12-21T09:48:51.491375402Z",
"updateTime": "2024-12-21T09:48:51.491375402Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f1509c79e15cd23ab9e8e72c22bee97120476ec4",
"ref": "refs/heads/main"
}
}
}
[09:48:51.936] Task URL: https://cr-buildbucket.appspot.com/build/8727950776825869537
[09:48:51.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:2:0) after 5m59s
[09:48:52.923] Received PubSub notification, asking Buildbucket for the build status
[09:48:53.000] Build status: SCHEDULED
[09:48:55.341] Received PubSub notification, asking Buildbucket for the build status
[09:48:55.383] Build status: STARTED
[09:54:50.959] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:2:0)
[09:54:51.025] Build status: STARTED
[09:54:51.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:5:0) after 1m44s
[09:56:35.062] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:5:0)
[09:56:35.086] Build status: STARTED
[09:56:35.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:6:0) after 6m28s
[10:03:03.311] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:6:0)
[10:03:03.331] Build status: STARTED
[10:03:03.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:7:0) after 7m32s
[10:10:35.357] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:7:0)
[10:10:35.376] Build status: STARTED
[10:10:35.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:8:0) after 8m25s
[10:19:00.532] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:8:0)
[10:19:00.554] Build status: STARTED
[10:19:00.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:9:0) after 6m22s
[10:25:22.609] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:9:0)
[10:25:22.636] Build status: STARTED
[10:25:22.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:10:0) after 1m33s
[10:26:55.873] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:10:0)
[10:26:55.890] Build status: STARTED
[10:26:55.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:11:0) after 7m54s
[10:34:49.914] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:11:0)
[10:34:49.939] Build status: STARTED
[10:34:49.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:12:0) after 9m45s
[10:44:34.965] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:12:0)
[10:44:34.985] Build status: STARTED
[10:44:34.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:13:0) after 1m59s
[10:46:34.020] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:13:0)
[10:46:34.046] Build status: STARTED
[10:46:34.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:14:0) after 3m6s
[10:49:40.068] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:14:0)
[10:49:40.092] Build status: STARTED
[10:49:40.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:15:0) after 3m18s
[10:52:58.116] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:15:0)
[10:52:58.132] Build status: STARTED
[10:52:58.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:16:0) after 9m36s
[11:02:34.388] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:16:0)
[11:02:34.411] Build status: STARTED
[11:02:34.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:17:0) after 9m7s
[11:11:41.445] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:17:0)
[11:11:41.477] Build status: STARTED
[11:11:41.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:18:0) after 6m28s
[11:18:09.598] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:18:0)
[11:18:09.619] Build status: STARTED
[11:18:09.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:19:0) after 8m5s
[11:26:14.696] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:19:0)
[11:26:14.736] Build status: STARTED
[11:26:14.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:20:0) after 1m55s
[11:28:09.909] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:20:0)
[11:28:10.001] Build status: STARTED
[11:28:10.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:21:0) after 6m29s
[11:34:39.267] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:21:0)
[11:34:39.300] Build status: STARTED
[11:34:39.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:22:0) after 4m4s
[11:38:43.326] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:22:0)
[11:38:43.403] Build status: STARTED
[11:38:43.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:23:0) after 7m18s
[11:46:01.434] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:23:0)
[11:46:01.459] Build status: STARTED
[11:46:01.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:24:0) after 3m8s
[11:49:09.482] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:24:0)
[11:49:09.595] Build status: STARTED
[11:49:09.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:25:0) after 4m51s
[11:54:00.831] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:25:0)
[11:54:00.854] Build status: STARTED
[11:54:00.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:26:0) after 7m30s
[12:01:30.971] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:26:0)
[12:01:30.992] Build status: STARTED
[12:01:30.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:27:0) after 4m59s
[12:06:30.020] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:27:0)
[12:06:30.038] Build status: STARTED
[12:06:30.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:28:0) after 2m57s
[12:09:27.058] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:28:0)
[12:09:27.085] Build status: STARTED
[12:09:27.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:29:0) after 1m25s
[12:10:52.128] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:29:0)
[12:10:52.192] Build status: STARTED
[12:10:52.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:30:0) after 5m40s
[12:16:32.246] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:30:0)
[12:16:32.277] Build status: STARTED
[12:16:32.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:31:0) after 7m43s
[12:24:15.416] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:31:0)
[12:24:15.435] Build status: STARTED
[12:24:15.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:32:0) after 1m4s
[12:25:19.504] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:32:0)
[12:25:19.521] Build status: STARTED
[12:25:19.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:33:0) after 1m29s
[12:26:48.541] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:33:0)
[12:26:48.568] Build status: STARTED
[12:26:48.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:34:0) after 1m15s
[12:28:03.597] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:34:0)
[12:28:03.628] Build status: STARTED
[12:28:03.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:35:0) after 1m13s
[12:29:16.738] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:35:0)
[12:29:16.756] Build status: STARTED
[12:29:16.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:36:0) after 8m2s
[12:37:18.877] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:36:0)
[12:37:18.895] Build status: STARTED
[12:37:18.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:37:0) after 8m19s
[12:45:38.027] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:37:0)
[12:45:38.069] Build status: STARTED
[12:45:38.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:38:0) after 9m23s
[12:55:01.239] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:38:0)
[12:55:01.256] Build status: STARTED
[12:55:01.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:39:0) after 3m8s
[12:58:09.423] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:39:0)
[12:58:09.441] Build status: STARTED
[12:58:09.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:40:0) after 3m52s
[13:02:01.616] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:40:0)
[13:02:01.718] Build status: STARTED
[13:02:01.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:41:0) after 3m36s
[13:05:37.745] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:41:0)
[13:05:37.766] Build status: STARTED
[13:05:37.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:42:0) after 9m16s
[13:14:53.965] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:42:0)
[13:14:53.994] Build status: STARTED
[13:14:53.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:43:0) after 8m53s
[13:23:47.025] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:43:0)
[13:23:47.064] Build status: STARTED
[13:23:47.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:44:0) after 9m17s
[13:33:04.120] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:44:0)
[13:33:04.136] Build status: STARTED
[13:33:04.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:45:0) after 9m6s
[13:42:10.187] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:45:0)
[13:42:10.203] Build status: STARTED
[13:42:10.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:46:0) after 9m9s
[13:51:19.225] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:46:0)
[13:51:19.246] Build status: STARTED
[13:51:19.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:47:0) after 5m34s
[13:56:53.268] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:47:0)
[13:56:53.284] Build status: STARTED
[13:56:53.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:48:0) after 2m37s
[13:59:30.271] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:48:0)
[13:59:30.289] Build status: STARTED
[13:59:30.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:49:0) after 2m26s
[14:01:56.306] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:49:0)
[14:01:56.328] Build status: STARTED
[14:01:56.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:50:0) after 6m22s
[14:08:18.458] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:50:0)
[14:08:18.521] Build status: STARTED
[14:08:18.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:51:0) after 8m40s
[14:16:58.655] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:51:0)
[14:16:58.672] Build status: STARTED
[14:16:58.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:52:0) after 6m11s
[14:23:09.713] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:52:0)
[14:23:09.730] Build status: STARTED
[14:23:09.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:53:0) after 3m23s
[14:26:32.759] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:53:0)
[14:26:32.783] Build status: STARTED
[14:26:32.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:54:0) after 5m8s
[14:31:41.126] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:54:0)
[14:31:41.148] Build status: STARTED
[14:31:41.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:55:0) after 9m19s
[14:41:00.204] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:55:0)
[14:41:00.246] Build status: STARTED
[14:41:00.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:56:0) after 4m2s
[14:45:02.279] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:56:0)
[14:45:02.307] Build status: STARTED
[14:45:02.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:57:0) after 6m11s
[14:51:13.327] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:57:0)
[14:51:13.344] Build status: STARTED
[14:51:13.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:58:0) after 8m37s
[14:59:50.490] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:58:0)
[14:59:50.515] Build status: STARTED
[14:59:50.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:59:0) after 1m3s
[15:00:53.634] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:59:0)
[15:00:53.655] Build status: STARTED
[15:00:53.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:60:0) after 5m5s
[15:05:58.711] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:60:0)
[15:05:58.738] Build status: STARTED
[15:05:58.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:61:0) after 6m45s
[15:12:43.760] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:61:0)
[15:12:43.836] Build status: STARTED
[15:12:43.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:62:0) after 3m20s
[15:16:03.880] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:62:0)
[15:16:03.943] Build status: STARTED
[15:16:03.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:63:0) after 5m12s
[15:21:15.967] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:63:0)
[15:21:16.018] Build status: STARTED
[15:21:16.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:64:0) after 6m0s
[15:27:16.032] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:64:0)
[15:27:16.053] Build status: STARTED
[15:27:16.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:65:0) after 3m30s
[15:30:46.080] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:65:0)
[15:30:46.112] Build status: STARTED
[15:30:46.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:66:0) after 7m16s
[15:38:02.144] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:66:0)
[15:38:02.162] Build status: STARTED
[15:38:02.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:67:0) after 5m14s
[15:43:16.218] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:67:0)
[15:43:16.234] Build status: STARTED
[15:43:16.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:68:0) after 3m30s
[15:46:46.338] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:68:0)
[15:46:46.367] Build status: STARTED
[15:46:46.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8893380838730891648:69:0) after 2m54s
[15:47:37.187] Received PubSub notification, asking Buildbucket for the build status
[15:47:37.300] Build:
{
"id": "8727950776825869537",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 33951,
"createdBy": "project:chromium",
"createTime": "2024-12-21T09:48:51.491375402Z",
"startTime": "2024-12-21T09:48:55.157891821Z",
"endTime": "2024-12-21T15:47:36.723177826Z",
"updateTime": "2024-12-21T15:47:36.723177826Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f1509c79e15cd23ab9e8e72c22bee97120476ec4",
"ref": "refs/heads/main"
}
}
}
[15:47:37.300] Invocation finished in 5h58m47.009985918s with status FAILED