[04:02:22.491] New invocation is queued and will start shortly
[04:02:23.556] Starting the invocation (attempt 1)
[04:02:23.584] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/cd6de00184408047f949930aa635ee3389d2554c"
[04:02:23.584] Popped gitiles commit info from properties and tags
[04:02:23.584] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:02:23.585] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:02:23.585] Buildbucket request:
{
"requestId": "8858251013360198432",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cd6de00184408047f949930aa635ee3389d2554c",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8858251013360198432"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:02:24.237] Scheduled build:
{
"id": "8692820951499216785",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 39191,
"createdBy": "project:chromium",
"createTime": "2026-01-13T04:02:23.645623156Z",
"updateTime": "2026-01-13T04:02:23.645623156Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cd6de00184408047f949930aa635ee3389d2554c",
"ref": "refs/heads/main"
}
}
}
[04:02:24.237] Task URL: https://cr-buildbucket.appspot.com/build/8692820951499216785
[04:02:24.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:2:0) after 6m56s
[04:02:26.015] Received PubSub notification, asking Buildbucket for the build status
[04:02:26.040] Build status: SCHEDULED
[04:03:21.062] Received PubSub notification, asking Buildbucket for the build status
[04:03:21.078] Build status: STARTED
[04:09:20.321] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:2:0)
[04:09:20.338] Build status: STARTED
[04:09:20.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:5:0) after 3m34s
[04:12:54.356] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:5:0)
[04:12:54.369] Build status: STARTED
[04:12:54.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:6:0) after 6m27s
[04:19:21.474] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:6:0)
[04:19:21.488] Build status: STARTED
[04:19:21.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:7:0) after 7m23s
[04:26:44.553] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:7:0)
[04:26:44.575] Build status: STARTED
[04:26:44.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:8:0) after 4m12s
[04:30:56.559] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:8:0)
[04:30:56.578] Build status: STARTED
[04:30:56.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:9:0) after 2m7s
[04:33:03.600] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:9:0)
[04:33:03.626] Build status: STARTED
[04:33:03.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:10:0) after 1m24s
[04:34:27.720] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:10:0)
[04:34:27.738] Build status: STARTED
[04:34:27.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:11:0) after 5m41s
[04:40:08.759] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:11:0)
[04:40:08.799] Build status: STARTED
[04:40:08.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:12:0) after 9m11s
[04:49:19.843] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:12:0)
[04:49:19.858] Build status: STARTED
[04:49:19.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:13:0) after 4m58s
[04:54:17.878] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:13:0)
[04:54:17.896] Build status: STARTED
[04:54:17.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:14:0) after 1m35s
[04:55:52.914] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:14:0)
[04:55:52.929] Build status: STARTED
[04:55:52.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:15:0) after 3m50s
[04:59:42.968] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:15:0)
[04:59:42.987] Build status: STARTED
[04:59:42.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:16:0) after 4m47s
[05:04:30.061] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:16:0)
[05:04:30.076] Build status: STARTED
[05:04:30.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:17:0) after 4m0s
[05:08:30.162] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:17:0)
[05:08:30.186] Build status: STARTED
[05:08:30.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:18:0) after 3m31s
[05:12:01.207] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:18:0)
[05:12:01.227] Build status: STARTED
[05:12:01.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:19:0) after 2m27s
[05:14:28.299] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:19:0)
[05:14:28.315] Build status: STARTED
[05:14:28.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:20:0) after 3m32s
[05:18:00.383] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:20:0)
[05:18:00.433] Build status: STARTED
[05:18:00.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:21:0) after 3m48s
[05:21:48.452] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:21:0)
[05:21:48.465] Build status: STARTED
[05:21:48.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:22:0) after 7m37s
[05:29:25.506] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:22:0)
[05:29:25.524] Build status: STARTED
[05:29:25.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:23:0) after 8m27s
[05:37:52.543] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:23:0)
[05:37:52.562] Build status: STARTED
[05:37:52.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:24:0) after 1m48s
[05:39:40.631] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:24:0)
[05:39:40.655] Build status: STARTED
[05:39:40.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:25:0) after 5m45s
[05:45:25.723] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:25:0)
[05:45:25.741] Build status: STARTED
[05:45:25.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:26:0) after 5m53s
[05:51:18.760] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:26:0)
[05:51:18.778] Build status: STARTED
[05:51:18.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:27:0) after 5m36s
[05:56:54.803] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:27:0)
[05:56:54.816] Build status: STARTED
[05:56:54.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:28:0) after 2m40s
[05:59:34.911] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:28:0)
[05:59:34.925] Build status: STARTED
[05:59:34.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:29:0) after 5m44s
[06:05:18.942] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:29:0)
[06:05:19.013] Build status: STARTED
[06:05:19.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:30:0) after 5m55s
[06:11:14.057] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:30:0)
[06:11:14.121] Build status: STARTED
[06:11:14.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:31:0) after 6m43s
[06:17:57.139] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:31:0)
[06:17:57.155] Build status: STARTED
[06:17:57.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:32:0) after 6m45s
[06:24:42.195] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:32:0)
[06:24:42.214] Build status: STARTED
[06:24:42.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:33:0) after 1m40s
[06:26:22.304] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:33:0)
[06:26:22.323] Build status: STARTED
[06:26:22.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:34:0) after 8m40s
[06:35:02.345] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:34:0)
[06:35:02.371] Build status: STARTED
[06:35:02.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:35:0) after 6m50s
[06:41:52.390] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:35:0)
[06:41:52.487] Build status: STARTED
[06:41:52.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:36:0) after 2m42s
[06:44:34.479] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:36:0)
[06:44:34.495] Build status: STARTED
[06:44:34.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:37:0) after 6m48s
[06:51:22.584] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:37:0)
[06:51:22.618] Build status: STARTED
[06:51:22.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:38:0) after 6m39s
[06:58:01.656] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:38:0)
[06:58:01.674] Build status: STARTED
[06:58:01.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:39:0) after 9m50s
[07:07:51.743] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:39:0)
[07:07:51.760] Build status: STARTED
[07:07:51.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:40:0) after 8m3s
[07:15:54.775] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:40:0)
[07:15:54.787] Build status: STARTED
[07:15:54.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:41:0) after 2m40s
[07:18:34.919] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:41:0)
[07:18:34.935] Build status: STARTED
[07:18:34.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:42:0) after 3m38s
[07:22:12.955] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:42:0)
[07:22:12.973] Build status: STARTED
[07:22:12.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:43:0) after 2m45s
[07:24:58.151] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:43:0)
[07:24:58.167] Build status: STARTED
[07:24:58.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:44:0) after 3m7s
[07:28:05.235] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:44:0)
[07:28:05.272] Build status: STARTED
[07:28:05.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:45:0) after 5m52s
[07:33:57.289] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:45:0)
[07:33:57.305] Build status: STARTED
[07:33:57.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:46:0) after 3m17s
[07:37:14.404] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:46:0)
[07:37:14.417] Build status: STARTED
[07:37:14.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:47:0) after 6m23s
[07:43:37.736] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:47:0)
[07:43:37.755] Build status: STARTED
[07:43:37.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:48:0) after 7m42s
[07:51:20.183] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:48:0)
[07:51:20.199] Build status: STARTED
[07:51:20.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:49:0) after 1m1s
[07:52:21.217] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:49:0)
[07:52:21.263] Build status: STARTED
[07:52:21.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:50:0) after 3m21s
[07:55:42.285] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:50:0)
[07:55:42.301] Build status: STARTED
[07:55:42.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:51:0) after 5m44s
[08:01:26.324] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:51:0)
[08:01:26.396] Build status: STARTED
[08:01:26.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:52:0) after 9m59s
[08:11:25.439] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:52:0)
[08:11:25.465] Build status: STARTED
[08:11:25.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:53:0) after 5m34s
[08:16:59.513] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:53:0)
[08:16:59.528] Build status: STARTED
[08:16:59.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:54:0) after 3m51s
[08:20:50.636] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:54:0)
[08:20:50.704] Build status: STARTED
[08:20:50.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:55:0) after 4m34s
[08:25:24.803] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:55:0)
[08:25:24.856] Build status: STARTED
[08:25:24.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:56:0) after 1m31s
[08:26:56.161] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:56:0)
[08:26:56.279] Build status: STARTED
[08:26:56.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:57:0) after 4m7s
[08:31:03.298] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:57:0)
[08:31:03.314] Build status: STARTED
[08:31:03.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8858251013360198432:58:0) after 7m20s
[08:32:48.736] Received PubSub notification, asking Buildbucket for the build status
[08:32:48.819] Build:
{
"id": "8692820951499216785",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 39191,
"createdBy": "project:chromium",
"createTime": "2026-01-13T04:02:23.645623156Z",
"startTime": "2026-01-13T04:03:20.487566890Z",
"endTime": "2026-01-13T08:32:43.793131964Z",
"updateTime": "2026-01-13T08:32:43.793131964Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cd6de00184408047f949930aa635ee3389d2554c",
"ref": "refs/heads/main"
}
}
}
[08:32:48.819] Invocation finished in 4h30m26.33349764s with status FAILED