[12:36:46.230] New invocation is queued and will start shortly
[12:36:47.294] Starting the invocation (attempt 1)
[12:36:47.320] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/633e76fc0c773b52fd45306276f91696abed0ba5"
[12:36:47.320] Popped gitiles commit info from properties and tags
[12:36:47.320] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[12:36:47.320] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[12:36:47.320] Buildbucket request:
{
"requestId": "8884310576708734640",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "633e76fc0c773b52fd45306276f91696abed0ba5",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8884310576708734640"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[12:36:47.822] Scheduled build:
{
"id": "8718880514792765537",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 35335,
"createdBy": "project:chromium",
"createTime": "2025-03-31T12:36:47.435706425Z",
"updateTime": "2025-03-31T12:36:47.435706425Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "633e76fc0c773b52fd45306276f91696abed0ba5",
"ref": "refs/heads/main"
}
}
}
[12:36:47.822] Task URL: https://cr-buildbucket.appspot.com/build/8718880514792765537
[12:36:47.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:2:0) after 4m59s
[12:36:48.818] Received PubSub notification, asking Buildbucket for the build status
[12:36:48.847] Build status: SCHEDULED
[12:36:51.194] Received PubSub notification, asking Buildbucket for the build status
[12:36:51.215] Build status: STARTED
[12:41:46.853] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:2:0)
[12:41:46.895] Build status: STARTED
[12:41:46.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:5:0) after 3m38s
[12:45:24.912] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:5:0)
[12:45:24.927] Build status: STARTED
[12:45:24.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:6:0) after 7m26s
[12:52:50.951] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:6:0)
[12:52:50.971] Build status: STARTED
[12:52:50.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:7:0) after 2m4s
[12:54:55.116] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:7:0)
[12:54:55.137] Build status: STARTED
[12:54:55.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:8:0) after 3m46s
[12:58:41.246] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:8:0)
[12:58:41.269] Build status: STARTED
[12:58:41.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:9:0) after 2m46s
[13:01:27.338] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:9:0)
[13:01:27.357] Build status: STARTED
[13:01:27.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:10:0) after 1m42s
[13:03:09.352] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:10:0)
[13:03:09.369] Build status: STARTED
[13:03:09.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:11:0) after 2m24s
[13:05:33.363] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:11:0)
[13:05:33.388] Build status: STARTED
[13:05:33.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:12:0) after 6m40s
[13:12:13.410] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:12:0)
[13:12:13.437] Build status: STARTED
[13:12:13.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:13:0) after 4m5s
[13:16:18.464] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:13:0)
[13:16:18.545] Build status: STARTED
[13:16:18.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:14:0) after 4m28s
[13:20:46.574] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:14:0)
[13:20:46.653] Build status: STARTED
[13:20:46.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:15:0) after 1m42s
[13:22:28.712] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:15:0)
[13:22:28.776] Build status: STARTED
[13:22:28.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:16:0) after 9m59s
[13:32:27.804] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:16:0)
[13:32:27.845] Build status: STARTED
[13:32:27.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:17:0) after 4m47s
[13:37:14.922] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:17:0)
[13:37:14.946] Build status: STARTED
[13:37:14.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:18:0) after 4m14s
[13:41:29.014] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:18:0)
[13:41:29.034] Build status: STARTED
[13:41:29.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:19:0) after 2m17s
[13:43:46.143] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:19:0)
[13:43:46.164] Build status: STARTED
[13:43:46.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:20:0) after 6m21s
[13:50:07.282] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:20:0)
[13:50:07.299] Build status: STARTED
[13:50:07.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:21:0) after 6m3s
[13:56:10.631] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:21:0)
[13:56:10.649] Build status: STARTED
[13:56:10.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:22:0) after 2m34s
[13:58:45.329] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:22:0)
[13:58:45.377] Build status: STARTED
[13:58:45.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:23:0) after 9m15s
[14:08:00.462] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:23:0)
[14:08:00.502] Build status: STARTED
[14:08:00.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:24:0) after 9m28s
[14:17:28.526] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:24:0)
[14:17:28.546] Build status: STARTED
[14:17:28.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:25:0) after 6m13s
[14:23:41.567] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:25:0)
[14:23:41.581] Build status: STARTED
[14:23:41.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:26:0) after 5m3s
[14:28:44.598] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:26:0)
[14:28:44.614] Build status: STARTED
[14:28:44.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:27:0) after 3m4s
[14:31:48.641] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:27:0)
[14:31:48.663] Build status: STARTED
[14:31:48.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:28:0) after 4m15s
[14:36:03.764] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:28:0)
[14:36:03.782] Build status: STARTED
[14:36:03.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:29:0) after 5m16s
[14:41:19.900] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:29:0)
[14:41:19.929] Build status: STARTED
[14:41:19.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:30:0) after 4m33s
[14:45:52.950] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:30:0)
[14:45:52.965] Build status: STARTED
[14:45:52.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:31:0) after 4m46s
[14:50:38.957] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:31:0)
[14:50:38.971] Build status: STARTED
[14:50:38.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:32:0) after 3m16s
[14:53:55.021] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:32:0)
[14:53:55.036] Build status: STARTED
[14:53:55.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:33:0) after 1m57s
[14:55:52.113] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:33:0)
[14:55:52.134] Build status: STARTED
[14:55:52.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:34:0) after 5m25s
[15:01:17.207] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:34:0)
[15:01:17.265] Build status: STARTED
[15:01:17.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:35:0) after 6m53s
[15:08:10.330] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:35:0)
[15:08:10.357] Build status: STARTED
[15:08:10.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:36:0) after 4m13s
[15:12:23.344] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:36:0)
[15:12:23.362] Build status: STARTED
[15:12:23.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:37:0) after 8m5s
[15:20:28.478] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:37:0)
[15:20:28.494] Build status: STARTED
[15:20:28.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:38:0) after 6m45s
[15:27:13.547] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:38:0)
[15:27:13.571] Build status: STARTED
[15:27:13.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:39:0) after 3m59s
[15:31:12.600] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:39:0)
[15:31:12.620] Build status: STARTED
[15:31:12.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:40:0) after 6m54s
[15:38:06.646] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:40:0)
[15:38:06.666] Build status: STARTED
[15:38:06.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:41:0) after 7m13s
[15:45:19.683] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:41:0)
[15:45:19.696] Build status: STARTED
[15:45:19.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:42:0) after 2m54s
[15:48:13.772] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:42:0)
[15:48:13.854] Build status: STARTED
[15:48:13.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:43:0) after 7m37s
[15:55:50.882] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:43:0)
[15:55:50.908] Build status: STARTED
[15:55:50.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:44:0) after 7m57s
[16:03:47.960] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:44:0)
[16:03:47.983] Build status: STARTED
[16:03:47.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:45:0) after 6m55s
[16:10:43.027] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:45:0)
[16:10:43.046] Build status: STARTED
[16:10:43.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:46:0) after 3m10s
[16:13:53.217] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:46:0)
[16:13:53.232] Build status: STARTED
[16:13:53.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:47:0) after 9m49s
[16:23:42.409] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:47:0)
[16:23:42.426] Build status: STARTED
[16:23:42.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:48:0) after 3m29s
[16:27:11.530] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:48:0)
[16:27:11.575] Build status: STARTED
[16:27:11.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:49:0) after 4m36s
[16:31:47.602] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:49:0)
[16:31:47.621] Build status: STARTED
[16:31:47.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:50:0) after 2m1s
[16:33:48.696] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:50:0)
[16:33:48.719] Build status: STARTED
[16:33:48.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:51:0) after 8m51s
[16:42:39.744] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:51:0)
[16:42:39.794] Build status: STARTED
[16:42:39.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:52:0) after 4m13s
[16:46:52.823] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:52:0)
[16:46:52.848] Build status: STARTED
[16:46:52.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:53:0) after 9m7s
[16:55:59.906] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:53:0)
[16:55:59.941] Build status: STARTED
[16:55:59.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:54:0) after 3m54s
[16:59:53.968] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:54:0)
[16:59:53.991] Build status: STARTED
[16:59:53.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:55:0) after 5m38s
[17:05:32.018] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:55:0)
[17:05:32.035] Build status: STARTED
[17:05:32.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:56:0) after 1m59s
[17:07:31.053] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:56:0)
[17:07:31.069] Build status: STARTED
[17:07:31.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:57:0) after 7m28s
[17:14:59.110] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:57:0)
[17:14:59.127] Build status: STARTED
[17:14:59.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:58:0) after 6m31s
[17:21:30.150] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:58:0)
[17:21:30.168] Build status: STARTED
[17:21:30.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:59:0) after 2m28s
[17:23:58.201] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:59:0)
[17:23:58.231] Build status: STARTED
[17:23:58.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:60:0) after 5m35s
[17:29:33.262] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:60:0)
[17:29:33.284] Build status: STARTED
[17:29:33.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:61:0) after 2m40s
[17:32:13.302] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:61:0)
[17:32:13.320] Build status: STARTED
[17:32:13.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:62:0) after 7m35s
[17:39:48.418] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:62:0)
[17:39:48.433] Build status: STARTED
[17:39:48.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:63:0) after 3m25s
[17:43:13.523] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:63:0)
[17:43:13.708] Build status: STARTED
[17:43:13.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:64:0) after 3m2s
[17:46:15.732] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:64:0)
[17:46:15.752] Build status: STARTED
[17:46:15.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:65:0) after 9m13s
[17:55:28.744] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:65:0)
[17:55:28.771] Build status: STARTED
[17:55:28.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:66:0) after 8m42s
[18:04:10.795] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:66:0)
[18:04:10.817] Build status: STARTED
[18:04:10.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:67:0) after 1m22s
[18:05:32.844] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:67:0)
[18:05:32.868] Build status: STARTED
[18:05:32.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:68:0) after 6m26s
[18:11:58.902] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:68:0)
[18:11:58.918] Build status: STARTED
[18:11:58.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:69:0) after 2m39s
[18:14:37.904] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:69:0)
[18:14:37.921] Build status: STARTED
[18:14:37.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884310576708734640:70:0) after 5m35s
[18:20:09.163] Received PubSub notification, asking Buildbucket for the build status
[18:20:09.186] Build:
{
"id": "8718880514792765537",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 35335,
"createdBy": "project:chromium",
"createTime": "2025-03-31T12:36:47.435706425Z",
"startTime": "2025-03-31T12:36:50.965353198Z",
"endTime": "2025-03-31T18:20:08.804259975Z",
"updateTime": "2025-03-31T18:20:08.804259975Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "633e76fc0c773b52fd45306276f91696abed0ba5",
"ref": "refs/heads/main"
}
}
}
[18:20:09.186] Invocation finished in 5h43m22.961777871s with status FAILED