[04:18:51.082] New invocation is queued and will start shortly
[04:18:52.277] Starting the invocation (attempt 1)
[04:18:52.311] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e20366489897a9d0d32bbe06fd1e6ab113e8d516"
[04:18:52.311] Popped gitiles commit info from properties and tags
[04:18:52.311] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:18:52.311] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:18:52.312] Buildbucket request:
{
"requestId": "8853085949661563568",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac (dbg)"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e20366489897a9d0d32bbe06fd1e6ab113e8d516",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8853085949661563568"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac (dbg)"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:18:52.963] Scheduled build:
{
"id": "8687655887661569553",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac (dbg)"
},
"number": 39605,
"createdBy": "project:chromium",
"createTime": "2026-03-11T04:18:52.369428977Z",
"updateTime": "2026-03-11T04:18:52.369428977Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e20366489897a9d0d32bbe06fd1e6ab113e8d516",
"ref": "refs/heads/main"
}
}
}
[04:18:52.963] Task URL: https://cr-buildbucket.appspot.com/build/8687655887661569553
[04:18:52.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:2:0) after 4m31s
[04:18:53.450] Received PubSub notification, asking Buildbucket for the build status
[04:18:53.507] Build status: SCHEDULED
[04:20:04.870] Received PubSub notification, asking Buildbucket for the build status
[04:20:04.886] Build status: STARTED
[04:23:24.213] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:2:0)
[04:23:24.238] Build status: STARTED
[04:23:24.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:5:0) after 5m2s
[04:28:26.305] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:5:0)
[04:28:26.325] Build status: STARTED
[04:28:26.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:6:0) after 6m38s
[04:35:04.351] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:6:0)
[04:35:04.407] Build status: STARTED
[04:35:04.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:7:0) after 4m21s
[04:39:25.443] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:7:0)
[04:39:25.458] Build status: STARTED
[04:39:25.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:8:0) after 7m11s
[04:46:36.479] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:8:0)
[04:46:36.496] Build status: STARTED
[04:46:36.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:9:0) after 4m19s
[04:50:55.487] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:9:0)
[04:50:55.528] Build status: STARTED
[04:50:55.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:10:0) after 5m4s
[04:55:59.625] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:10:0)
[04:55:59.641] Build status: STARTED
[04:55:59.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:11:0) after 3m21s
[04:59:20.649] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:11:0)
[04:59:20.678] Build status: STARTED
[04:59:20.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:12:0) after 1m51s
[05:01:11.753] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:12:0)
[05:01:11.789] Build status: STARTED
[05:01:11.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:13:0) after 8m27s
[05:09:38.778] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:13:0)
[05:09:38.804] Build status: STARTED
[05:09:38.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:14:0) after 2m4s
[05:11:42.914] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:14:0)
[05:11:42.931] Build status: STARTED
[05:11:42.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:15:0) after 4m0s
[05:15:42.947] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:15:0)
[05:15:43.019] Build status: STARTED
[05:15:43.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:16:0) after 3m27s
[05:19:10.055] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:16:0)
[05:19:10.070] Build status: STARTED
[05:19:10.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:17:0) after 4m59s
[05:24:09.104] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:17:0)
[05:24:09.129] Build status: STARTED
[05:24:09.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:18:0) after 2m23s
[05:26:32.228] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:18:0)
[05:26:32.245] Build status: STARTED
[05:26:32.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:19:0) after 3m49s
[05:30:21.294] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:19:0)
[05:30:21.386] Build status: STARTED
[05:30:21.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:20:0) after 9m22s
[05:39:43.438] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:20:0)
[05:39:43.550] Build status: STARTED
[05:39:43.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:21:0) after 8m41s
[05:48:24.568] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:21:0)
[05:48:24.582] Build status: STARTED
[05:48:24.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:22:0) after 1m27s
[05:49:51.602] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:22:0)
[05:49:51.618] Build status: STARTED
[05:49:51.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:23:0) after 8m56s
[05:58:47.674] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:23:0)
[05:58:47.715] Build status: STARTED
[05:58:47.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:24:0) after 4m39s
[06:03:26.732] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:24:0)
[06:03:26.751] Build status: STARTED
[06:03:26.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:25:0) after 3m25s
[06:06:51.773] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:25:0)
[06:06:51.796] Build status: STARTED
[06:06:51.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:26:0) after 5m30s
[06:12:22.045] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:26:0)
[06:12:22.062] Build status: STARTED
[06:12:22.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:27:0) after 6m27s
[06:18:49.082] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:27:0)
[06:18:49.099] Build status: STARTED
[06:18:49.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:28:0) after 7m11s
[06:26:00.121] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:28:0)
[06:26:00.166] Build status: STARTED
[06:26:00.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:29:0) after 5m6s
[06:31:06.254] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:29:0)
[06:31:06.277] Build status: STARTED
[06:31:06.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:30:0) after 4m19s
[06:35:25.247] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:30:0)
[06:35:25.259] Build status: STARTED
[06:35:25.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:31:0) after 9m9s
[06:44:34.280] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:31:0)
[06:44:34.298] Build status: STARTED
[06:44:34.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:32:0) after 2m48s
[06:47:22.365] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:32:0)
[06:47:22.413] Build status: STARTED
[06:47:22.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:33:0) after 4m48s
[06:52:10.540] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:33:0)
[06:52:10.613] Build status: STARTED
[06:52:10.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:34:0) after 3m4s
[06:55:14.676] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:34:0)
[06:55:14.696] Build status: STARTED
[06:55:14.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:35:0) after 9m6s
[07:04:20.764] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:35:0)
[07:04:20.807] Build status: STARTED
[07:04:20.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:36:0) after 8m26s
[07:12:46.897] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:36:0)
[07:12:46.915] Build status: STARTED
[07:12:46.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:37:0) after 6m29s
[07:19:15.931] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:37:0)
[07:19:16.535] Build status: STARTED
[07:19:16.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:38:0) after 4m13s
[07:23:29.613] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:38:0)
[07:23:29.638] Build status: STARTED
[07:23:29.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:39:0) after 7m29s
[07:30:58.675] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:39:0)
[07:30:58.715] Build status: STARTED
[07:30:58.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:40:0) after 6m4s
[07:37:02.736] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:40:0)
[07:37:02.753] Build status: STARTED
[07:37:02.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:41:0) after 3m0s
[07:40:02.847] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:41:0)
[07:40:02.884] Build status: STARTED
[07:40:02.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:42:0) after 7m46s
[07:47:48.975] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:42:0)
[07:47:48.996] Build status: STARTED
[07:47:48.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:43:0) after 6m54s
[07:54:43.067] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:43:0)
[07:54:43.084] Build status: STARTED
[07:54:43.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:44:0) after 3m54s
[07:58:37.185] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:44:0)
[07:58:37.207] Build status: STARTED
[07:58:37.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:45:0) after 7m54s
[08:06:31.227] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:45:0)
[08:06:31.299] Build status: STARTED
[08:06:31.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:46:0) after 6m18s
[08:12:49.310] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:46:0)
[08:12:49.389] Build status: STARTED
[08:12:49.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:47:0) after 3m39s
[08:16:28.462] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:47:0)
[08:16:28.557] Build status: STARTED
[08:16:28.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:48:0) after 6m41s
[08:23:09.581] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:48:0)
[08:23:09.649] Build status: STARTED
[08:23:09.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:49:0) after 5m55s
[08:29:04.680] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:49:0)
[08:29:04.710] Build status: STARTED
[08:29:04.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:50:0) after 6m45s
[08:35:49.732] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:50:0)
[08:35:49.751] Build status: STARTED
[08:35:49.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:51:0) after 5m11s
[08:41:00.829] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:51:0)
[08:41:04.150] Build status: STARTED
[08:41:04.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:52:0) after 8m36s
[08:49:40.210] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:52:0)
[08:49:40.223] Build status: STARTED
[08:49:40.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:53:0) after 4m53s
[08:54:33.241] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:53:0)
[08:54:33.264] Build status: STARTED
[08:54:33.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:54:0) after 3m18s
[08:57:51.336] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:54:0)
[08:57:51.371] Build status: STARTED
[08:57:51.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:55:0) after 5m56s
[09:03:47.406] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:55:0)
[09:03:47.423] Build status: STARTED
[09:03:47.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:56:0) after 1m6s
[09:04:53.443] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:56:0)
[09:04:53.462] Build status: STARTED
[09:04:53.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:57:0) after 8m24s
[09:13:17.480] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:57:0)
[09:13:17.499] Build status: STARTED
[09:13:17.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:58:0) after 9m51s
[09:23:08.509] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:58:0)
[09:23:08.524] Build status: STARTED
[09:23:08.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:59:0) after 3m33s
[09:26:41.526] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:59:0)
[09:26:41.595] Build status: STARTED
[09:26:41.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:60:0) after 7m3s
[09:33:44.621] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:60:0)
[09:33:44.640] Build status: STARTED
[09:33:44.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:61:0) after 8m20s
[09:42:04.664] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:61:0)
[09:42:04.688] Build status: STARTED
[09:42:04.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:62:0) after 7m56s
[09:50:00.718] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:62:0)
[09:50:00.788] Build status: STARTED
[09:50:00.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:63:0) after 7m34s
[09:57:34.807] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:63:0)
[09:57:34.881] Build status: STARTED
[09:57:34.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:64:0) after 9m57s
[10:07:31.937] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:64:0)
[10:07:31.970] Build status: STARTED
[10:07:31.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:65:0) after 9m22s
[10:16:53.987] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:65:0)
[10:16:54.023] Build status: STARTED
[10:16:54.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:66:0) after 6m11s
[10:23:05.189] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:66:0)
[10:23:05.270] Build status: STARTED
[10:23:05.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8853085949661563568:67:0) after 6m27s
[10:23:27.651] Received PubSub notification, asking Buildbucket for the build status
[10:23:27.666] Build:
{
"id": "8687655887661569553",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac (dbg)"
},
"number": 39605,
"createdBy": "project:chromium",
"createTime": "2026-03-11T04:18:52.369428977Z",
"startTime": "2026-03-11T04:20:04.680884865Z",
"endTime": "2026-03-11T10:23:27.372315149Z",
"updateTime": "2026-03-11T10:23:27.372315149Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e20366489897a9d0d32bbe06fd1e6ab113e8d516",
"ref": "refs/heads/main"
}
}
}
[10:23:27.666] Invocation finished in 6h4m36.588018824s with status FAILED