[17:52:34.907] New invocation is queued and will start shortly
[17:52:36.063] Starting the invocation (attempt 1)
[17:52:36.099] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a1faac32dd3f958137250dfe7d9865dc8eb9bba8"
[17:52:36.099] Popped gitiles commit info from properties and tags
[17:52:36.099] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[17:52:36.099] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[17:52:36.099] Buildbucket request:
{
"requestId": "8885921452982637136",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a1faac32dd3f958137250dfe7d9865dc8eb9bba8",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8885921452982637136"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[17:52:36.640] Scheduled build:
{
"id": "8720491390997521505",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 35006,
"createdBy": "project:chromium",
"createTime": "2025-03-13T17:52:36.171853751Z",
"updateTime": "2025-03-13T17:52:36.171853751Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a1faac32dd3f958137250dfe7d9865dc8eb9bba8",
"ref": "refs/heads/main"
}
}
}
[17:52:36.640] Task URL: https://cr-buildbucket.appspot.com/build/8720491390997521505
[17:52:36.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:2:0) after 4m0s
[17:52:37.660] Received PubSub notification, asking Buildbucket for the build status
[17:52:37.679] Build status: SCHEDULED
[17:52:40.050] Received PubSub notification, asking Buildbucket for the build status
[17:52:40.088] Build status: STARTED
[17:56:36.662] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:2:0)
[17:56:36.683] Build status: STARTED
[17:56:36.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:5:0) after 7m20s
[18:03:56.707] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:5:0)
[18:03:56.735] Build status: STARTED
[18:03:56.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:6:0) after 6m44s
[18:10:40.810] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:6:0)
[18:10:40.836] Build status: STARTED
[18:10:40.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:7:0) after 3m3s
[18:13:43.864] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:7:0)
[18:13:43.942] Build status: STARTED
[18:13:43.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:8:0) after 9m29s
[18:23:13.056] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:8:0)
[18:23:13.075] Build status: STARTED
[18:23:13.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:9:0) after 5m58s
[18:29:11.114] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:9:0)
[18:29:11.141] Build status: STARTED
[18:29:11.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:10:0) after 7m46s
[18:36:57.183] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:10:0)
[18:36:57.211] Build status: STARTED
[18:36:57.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:11:0) after 4m22s
[18:41:19.299] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:11:0)
[18:41:19.363] Build status: STARTED
[18:41:19.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:12:0) after 9m20s
[18:50:39.531] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:12:0)
[18:50:39.562] Build status: STARTED
[18:50:39.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:13:0) after 2m29s
[18:53:08.591] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:13:0)
[18:53:08.615] Build status: STARTED
[18:53:08.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:14:0) after 3m49s
[18:56:57.666] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:14:0)
[18:56:57.692] Build status: STARTED
[18:56:57.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:15:0) after 1m15s
[18:58:12.740] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:15:0)
[18:58:12.763] Build status: STARTED
[18:58:12.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:16:0) after 4m31s
[19:02:43.779] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:16:0)
[19:02:43.963] Build status: STARTED
[19:02:43.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:17:0) after 7m27s
[19:10:11.016] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:17:0)
[19:10:11.061] Build status: STARTED
[19:10:11.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:18:0) after 4m33s
[19:14:44.058] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:18:0)
[19:14:44.073] Build status: STARTED
[19:14:44.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:19:0) after 4m5s
[19:18:49.090] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:19:0)
[19:18:49.109] Build status: STARTED
[19:18:49.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:20:0) after 1m3s
[19:19:52.130] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:20:0)
[19:19:52.152] Build status: STARTED
[19:19:52.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:21:0) after 4m54s
[19:24:46.183] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:21:0)
[19:24:46.240] Build status: STARTED
[19:24:46.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:22:0) after 5m48s
[19:30:34.320] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:22:0)
[19:30:34.334] Build status: STARTED
[19:30:34.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:23:0) after 8m8s
[19:38:42.355] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:23:0)
[19:38:42.491] Build status: STARTED
[19:38:42.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:24:0) after 6m37s
[19:45:19.648] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:24:0)
[19:45:19.682] Build status: STARTED
[19:45:19.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:25:0) after 1m24s
[19:46:43.714] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:25:0)
[19:46:43.745] Build status: STARTED
[19:46:43.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:26:0) after 6m49s
[19:53:32.792] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:26:0)
[19:53:32.817] Build status: STARTED
[19:53:32.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:27:0) after 4m47s
[19:58:19.854] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:27:0)
[19:58:19.879] Build status: STARTED
[19:58:19.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:28:0) after 2m37s
[20:00:56.879] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:28:0)
[20:00:56.896] Build status: STARTED
[20:00:56.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:29:0) after 4m30s
[20:05:26.957] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:29:0)
[20:05:27.039] Build status: STARTED
[20:05:27.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:30:0) after 1m49s
[20:07:16.139] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:30:0)
[20:07:16.189] Build status: STARTED
[20:07:16.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:31:0) after 7m31s
[20:14:47.216] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:31:0)
[20:14:47.237] Build status: STARTED
[20:14:47.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:32:0) after 1m0s
[20:15:47.333] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:32:0)
[20:15:47.353] Build status: STARTED
[20:15:47.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:33:0) after 8m40s
[20:24:27.453] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:33:0)
[20:24:27.481] Build status: STARTED
[20:24:27.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:34:0) after 6m34s
[20:31:01.501] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:34:0)
[20:31:01.527] Build status: STARTED
[20:31:01.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:35:0) after 4m1s
[20:35:02.595] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:35:0)
[20:35:02.614] Build status: STARTED
[20:35:02.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:36:0) after 6m21s
[20:41:23.642] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:36:0)
[20:41:23.662] Build status: STARTED
[20:41:23.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:37:0) after 2m2s
[20:43:25.690] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:37:0)
[20:43:25.708] Build status: STARTED
[20:43:25.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:38:0) after 1m8s
[20:44:33.729] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:38:0)
[20:44:33.745] Build status: STARTED
[20:44:33.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:39:0) after 2m6s
[20:46:39.824] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:39:0)
[20:46:39.846] Build status: STARTED
[20:46:39.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:40:0) after 5m1s
[20:51:40.904] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:40:0)
[20:51:40.927] Build status: STARTED
[20:51:40.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:41:0) after 1m16s
[20:52:56.957] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:41:0)
[20:52:56.977] Build status: STARTED
[20:52:56.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:42:0) after 4m59s
[20:57:56.055] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:42:0)
[20:57:56.069] Build status: STARTED
[20:57:56.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:43:0) after 4m5s
[21:02:01.093] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:43:0)
[21:02:01.124] Build status: STARTED
[21:02:01.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:44:0) after 4m57s
[21:06:58.121] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:44:0)
[21:06:58.153] Build status: STARTED
[21:06:58.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:45:0) after 4m47s
[21:11:45.214] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:45:0)
[21:11:45.231] Build status: STARTED
[21:11:45.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:46:0) after 6m13s
[21:17:58.353] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:46:0)
[21:17:58.374] Build status: STARTED
[21:17:58.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:47:0) after 8m24s
[21:26:22.406] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:47:0)
[21:26:22.423] Build status: STARTED
[21:26:22.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:48:0) after 2m0s
[21:28:22.524] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:48:0)
[21:28:22.540] Build status: STARTED
[21:28:22.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:49:0) after 3m13s
[21:31:35.562] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:49:0)
[21:31:35.579] Build status: STARTED
[21:31:35.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:50:0) after 6m22s
[21:37:57.607] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:50:0)
[21:37:57.623] Build status: STARTED
[21:37:57.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:51:0) after 3m5s
[21:41:02.862] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:51:0)
[21:41:02.877] Build status: STARTED
[21:41:02.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:52:0) after 4m22s
[21:45:24.928] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:52:0)
[21:45:24.957] Build status: STARTED
[21:45:24.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:53:0) after 5m48s
[21:51:12.991] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:53:0)
[21:51:13.005] Build status: STARTED
[21:51:13.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:54:0) after 4m9s
[21:55:22.033] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:54:0)
[21:55:22.048] Build status: STARTED
[21:55:22.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:55:0) after 6m8s
[22:01:30.124] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:55:0)
[22:01:30.139] Build status: STARTED
[22:01:30.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:56:0) after 9m47s
[22:11:17.162] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:56:0)
[22:11:17.183] Build status: STARTED
[22:11:17.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:57:0) after 2m3s
[22:13:20.192] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:57:0)
[22:13:20.239] Build status: STARTED
[22:13:20.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:58:0) after 2m56s
[22:16:16.257] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:58:0)
[22:16:16.273] Build status: STARTED
[22:16:16.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:59:0) after 5m19s
[22:21:35.335] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:59:0)
[22:21:35.358] Build status: STARTED
[22:21:35.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:60:0) after 4m49s
[22:26:24.406] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:60:0)
[22:26:24.430] Build status: STARTED
[22:26:24.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:61:0) after 4m28s
[22:30:52.472] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:61:0)
[22:30:52.491] Build status: STARTED
[22:30:52.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:62:0) after 6m35s
[22:37:27.519] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:62:0)
[22:37:27.533] Build status: STARTED
[22:37:27.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:63:0) after 5m59s
[22:43:26.620] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:63:0)
[22:43:26.639] Build status: STARTED
[22:43:26.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:64:0) after 7m17s
[22:50:43.739] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:64:0)
[22:50:43.772] Build status: STARTED
[22:50:43.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:65:0) after 9m29s
[23:00:12.803] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:65:0)
[23:00:12.820] Build status: STARTED
[23:00:12.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:66:0) after 9m23s
[23:09:35.929] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:66:0)
[23:09:35.975] Build status: STARTED
[23:09:35.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:67:0) after 8m53s
[23:18:29.031] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:67:0)
[23:18:29.050] Build status: STARTED
[23:18:29.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:68:0) after 4m21s
[23:22:50.140] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:68:0)
[23:22:50.166] Build status: STARTED
[23:22:50.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:69:0) after 2m6s
[23:24:56.196] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:69:0)
[23:24:56.215] Build status: STARTED
[23:24:56.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:70:0) after 3m25s
[23:28:21.199] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:70:0)
[23:28:21.217] Build status: STARTED
[23:28:21.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885921452982637136:71:0) after 6m29s
[23:33:34.651] Received PubSub notification, asking Buildbucket for the build status
[23:33:34.671] Build:
{
"id": "8720491390997521505",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 35006,
"createdBy": "project:chromium",
"createTime": "2025-03-13T17:52:36.171853751Z",
"startTime": "2025-03-13T17:52:39.842541002Z",
"endTime": "2025-03-13T23:33:34.363471589Z",
"updateTime": "2025-03-13T23:33:34.363471589Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a1faac32dd3f958137250dfe7d9865dc8eb9bba8",
"ref": "refs/heads/main"
}
}
}
[23:33:34.671] Invocation finished in 5h40m59.775826598s with status FAILED