[03:17:32.137] New invocation is queued and will start shortly
[03:17:33.231] Starting the invocation (attempt 1)
[03:17:33.264] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9d297e7f9b66b61379b68e5b7fe47723287bc7ce"
[03:17:33.264] Popped gitiles commit info from properties and tags
[03:17:33.264] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:17:33.266] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:17:33.266] Buildbucket request:
{
"requestId": "8879544121503484032",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTFuchsia x64"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9d297e7f9b66b61379b68e5b7fe47723287bc7ce",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8879544121503484032"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTFuchsia x64"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:17:33.891] Scheduled build:
{
"id": "8714114059589272833",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTFuchsia x64"
},
"number": 25369,
"createdBy": "project:chromium",
"createTime": "2025-05-23T03:17:33.343086374Z",
"updateTime": "2025-05-23T03:17:33.343086374Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9d297e7f9b66b61379b68e5b7fe47723287bc7ce",
"ref": "refs/heads/main"
}
}
}
[03:17:33.892] Task URL: https://cr-buildbucket.appspot.com/build/8714114059589272833
[03:17:33.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:2:0) after 6m20s
[03:17:35.880] Received PubSub notification, asking Buildbucket for the build status
[03:17:35.905] Build status: SCHEDULED
[03:18:49.738] Received PubSub notification, asking Buildbucket for the build status
[03:18:49.760] Build status: STARTED
[03:23:53.884] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:2:0)
[03:23:53.910] Build status: STARTED
[03:23:53.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:5:0) after 2m17s
[03:26:10.935] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:5:0)
[03:26:10.959] Build status: STARTED
[03:26:10.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:6:0) after 7m29s
[03:33:40.085] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:6:0)
[03:33:40.119] Build status: STARTED
[03:33:40.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:7:0) after 5m16s
[03:38:56.173] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:7:0)
[03:38:56.198] Build status: STARTED
[03:38:56.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:8:0) after 5m58s
[03:44:54.223] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:8:0)
[03:44:54.253] Build status: STARTED
[03:44:54.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:9:0) after 5m10s
[03:50:04.293] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:9:0)
[03:50:04.320] Build status: STARTED
[03:50:04.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:10:0) after 2m49s
[03:52:53.349] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:10:0)
[03:52:53.370] Build status: STARTED
[03:52:53.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:11:0) after 9m52s
[04:02:45.496] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:11:0)
[04:02:45.513] Build status: STARTED
[04:02:45.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:12:0) after 1m42s
[04:04:27.584] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:12:0)
[04:04:27.604] Build status: STARTED
[04:04:27.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:13:0) after 7m15s
[04:11:42.776] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:13:0)
[04:11:42.806] Build status: STARTED
[04:11:42.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:14:0) after 7m11s
[04:18:53.831] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:14:0)
[04:18:53.895] Build status: STARTED
[04:18:53.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:15:0) after 8m42s
[04:27:35.923] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:15:0)
[04:27:35.948] Build status: STARTED
[04:27:35.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:16:0) after 3m55s
[04:31:31.028] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:16:0)
[04:31:31.053] Build status: STARTED
[04:31:31.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:17:0) after 5m18s
[04:36:49.167] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:17:0)
[04:36:49.193] Build status: STARTED
[04:36:49.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:18:0) after 7m9s
[04:43:58.363] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:18:0)
[04:43:58.382] Build status: STARTED
[04:43:58.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:19:0) after 4m10s
[04:48:08.434] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:19:0)
[04:48:08.451] Build status: STARTED
[04:48:08.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:20:0) after 1m14s
[04:49:22.477] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:20:0)
[04:49:22.501] Build status: STARTED
[04:49:22.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:21:0) after 6m35s
[04:55:57.526] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:21:0)
[04:55:57.541] Build status: STARTED
[04:55:57.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:22:0) after 6m20s
[05:02:17.563] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:22:0)
[05:02:17.594] Build status: STARTED
[05:02:17.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:23:0) after 5m49s
[05:08:06.759] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:23:0)
[05:08:06.821] Build status: STARTED
[05:08:06.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:24:0) after 1m49s
[05:09:55.978] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:24:0)
[05:09:55.999] Build status: STARTED
[05:09:55.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:25:0) after 3m17s
[05:13:13.045] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:25:0)
[05:13:13.203] Build status: STARTED
[05:13:13.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:26:0) after 6m12s
[05:19:25.240] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:26:0)
[05:19:25.265] Build status: STARTED
[05:19:25.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:27:0) after 7m33s
[05:26:58.310] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:27:0)
[05:26:58.326] Build status: STARTED
[05:26:58.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:28:0) after 5m36s
[05:32:34.357] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:28:0)
[05:32:34.375] Build status: STARTED
[05:32:34.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:29:0) after 9m36s
[05:42:10.404] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:29:0)
[05:42:10.493] Build status: STARTED
[05:42:10.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:30:0) after 5m10s
[05:47:20.526] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:30:0)
[05:47:20.571] Build status: STARTED
[05:47:20.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:31:0) after 8m52s
[05:56:12.607] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:31:0)
[05:56:12.633] Build status: STARTED
[05:56:12.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:32:0) after 9m25s
[06:05:37.698] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:32:0)
[06:05:37.718] Build status: STARTED
[06:05:37.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:33:0) after 7m1s
[06:12:38.743] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:33:0)
[06:12:38.758] Build status: STARTED
[06:12:38.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:34:0) after 9m7s
[06:21:45.840] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:34:0)
[06:21:45.872] Build status: STARTED
[06:21:45.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:35:0) after 9m9s
[06:30:54.908] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:35:0)
[06:30:54.929] Build status: STARTED
[06:30:54.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:36:0) after 4m6s
[06:35:00.955] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:36:0)
[06:35:00.973] Build status: STARTED
[06:35:00.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:37:0) after 1m13s
[06:36:13.994] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:37:0)
[06:36:14.009] Build status: STARTED
[06:36:14.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:38:0) after 6m45s
[06:42:59.039] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:38:0)
[06:42:59.070] Build status: STARTED
[06:42:59.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:39:0) after 8m28s
[06:51:27.100] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:39:0)
[06:51:27.117] Build status: STARTED
[06:51:27.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:40:0) after 8m8s
[06:59:35.135] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:40:0)
[06:59:35.151] Build status: STARTED
[06:59:35.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:41:0) after 4m0s
[07:03:35.178] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:41:0)
[07:03:35.258] Build status: STARTED
[07:03:35.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:42:0) after 4m53s
[07:08:28.310] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:42:0)
[07:08:28.328] Build status: STARTED
[07:08:28.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:43:0) after 2m3s
[07:10:31.423] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:43:0)
[07:10:31.439] Build status: STARTED
[07:10:31.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:44:0) after 2m1s
[07:12:32.467] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:44:0)
[07:12:32.488] Build status: STARTED
[07:12:32.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:45:0) after 2m45s
[07:15:17.510] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:45:0)
[07:15:17.535] Build status: STARTED
[07:15:17.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:46:0) after 3m24s
[07:18:41.600] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:46:0)
[07:18:41.632] Build status: STARTED
[07:18:41.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:47:0) after 4m52s
[07:23:33.689] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:47:0)
[07:23:33.758] Build status: STARTED
[07:23:33.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:48:0) after 2m45s
[07:26:18.738] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:48:0)
[07:26:18.752] Build status: STARTED
[07:26:18.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:49:0) after 1m9s
[07:27:27.850] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:49:0)
[07:27:27.871] Build status: STARTED
[07:27:27.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:50:0) after 9m41s
[07:37:08.947] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:50:0)
[07:37:08.972] Build status: STARTED
[07:37:08.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:51:0) after 9m24s
[07:46:32.997] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:51:0)
[07:46:33.024] Build status: STARTED
[07:46:33.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:52:0) after 5m13s
[07:51:46.042] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:52:0)
[07:51:46.061] Build status: STARTED
[07:51:46.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:53:0) after 2m26s
[07:54:12.107] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:53:0)
[07:54:12.125] Build status: STARTED
[07:54:12.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:54:0) after 7m22s
[08:01:34.200] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:54:0)
[08:01:34.215] Build status: STARTED
[08:01:34.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:55:0) after 9m54s
[08:11:28.240] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:55:0)
[08:11:28.258] Build status: STARTED
[08:11:28.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:56:0) after 3m6s
[08:14:34.258] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:56:0)
[08:14:34.278] Build status: STARTED
[08:14:34.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:57:0) after 5m9s
[08:19:43.349] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:57:0)
[08:19:43.369] Build status: STARTED
[08:19:43.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:58:0) after 7m57s
[08:27:40.394] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:58:0)
[08:27:40.417] Build status: STARTED
[08:27:40.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:59:0) after 6m39s
[08:34:19.491] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:59:0)
[08:34:19.514] Build status: STARTED
[08:34:19.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:60:0) after 8m17s
[08:42:36.551] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:60:0)
[08:42:36.576] Build status: STARTED
[08:42:36.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:61:0) after 6m42s
[08:49:18.650] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:61:0)
[08:49:18.869] Build status: STARTED
[08:49:18.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:62:0) after 9m10s
[08:58:28.925] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:62:0)
[08:58:28.946] Build status: STARTED
[08:58:28.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:63:0) after 6m24s
[09:04:53.010] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:63:0)
[09:04:53.030] Build status: STARTED
[09:04:53.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:64:0) after 9m6s
[09:13:59.066] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:64:0)
[09:13:59.085] Build status: STARTED
[09:13:59.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:65:0) after 5m13s
[09:19:12.119] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:65:0)
[09:19:12.141] Build status: STARTED
[09:19:12.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:66:0) after 6m16s
[09:25:28.130] Handling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:66:0)
[09:25:28.146] Build status: STARTED
[09:25:28.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTFuchsia x64:8879544121503484032:67:0) after 7m53s
[09:32:05.252] Received PubSub notification, asking Buildbucket for the build status
[09:32:05.317] Build:
{
"id": "8714114059589272833",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTFuchsia x64"
},
"number": 25369,
"createdBy": "project:chromium",
"createTime": "2025-05-23T03:17:33.343086374Z",
"startTime": "2025-05-23T03:18:49.532249679Z",
"endTime": "2025-05-23T09:31:03.692677809Z",
"updateTime": "2025-05-23T09:31:03.692677809Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9d297e7f9b66b61379b68e5b7fe47723287bc7ce",
"ref": "refs/heads/main"
}
}
}
[09:32:05.317] Invocation finished in 6h14m33.182364398s with status FAILED