[22:41:37.223] New invocation is queued and will start shortly
[22:41:38.342] Starting the invocation (attempt 1)
[22:41:38.379] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/0ad18cee13f7edce4b5ef5484ef843bc4a46d795"
[22:41:38.379] Popped gitiles commit info from properties and tags
[22:41:38.379] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:41:38.380] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:41:38.381] Buildbucket request:
{
"requestId": "8876934168571274624",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0ad18cee13f7edce4b5ef5484ef843bc4a46d795",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8876934168571274624"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:41:39.043] Scheduled build:
{
"id": "8711504106585275169",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 36904,
"createdBy": "project:chromium",
"createTime": "2025-06-20T22:41:38.490018091Z",
"updateTime": "2025-06-20T22:41:38.490018091Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0ad18cee13f7edce4b5ef5484ef843bc4a46d795",
"ref": "refs/heads/main"
}
},
"canary": true
}
[22:41:39.043] Task URL: https://cr-buildbucket.appspot.com/build/8711504106585275169
[22:41:39.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:2:0) after 2m9s
[22:41:45.950] Received PubSub notification, asking Buildbucket for the build status
[22:41:45.999] Build status: STARTED
[22:41:51.193] Received PubSub notification, asking Buildbucket for the build status
[22:41:51.217] Build status: STARTED
[22:43:48.068] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:2:0)
[22:43:48.168] Build status: STARTED
[22:43:48.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:5:0) after 6m43s
[22:50:31.191] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:5:0)
[22:50:31.212] Build status: STARTED
[22:50:31.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:6:0) after 5m50s
[22:56:21.288] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:6:0)
[22:56:21.310] Build status: STARTED
[22:56:21.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:7:0) after 1m20s
[22:57:41.345] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:7:0)
[22:57:41.387] Build status: STARTED
[22:57:41.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:8:0) after 6m24s
[23:04:05.465] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:8:0)
[23:04:05.482] Build status: STARTED
[23:04:05.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:9:0) after 9m44s
[23:13:49.514] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:9:0)
[23:13:49.567] Build status: STARTED
[23:13:49.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:10:0) after 6m25s
[23:20:14.650] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:10:0)
[23:20:14.670] Build status: STARTED
[23:20:14.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:11:0) after 8m29s
[23:28:43.871] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:11:0)
[23:28:43.895] Build status: STARTED
[23:28:43.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:12:0) after 6m57s
[23:35:40.913] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:12:0)
[23:35:40.936] Build status: STARTED
[23:35:40.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:13:0) after 7m36s
[23:43:16.972] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:13:0)
[23:43:17.050] Build status: STARTED
[23:43:17.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:14:0) after 3m5s
[23:46:22.155] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:14:0)
[23:46:22.270] Build status: STARTED
[23:46:22.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:15:0) after 9m3s
[23:55:25.293] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:15:0)
[23:55:25.324] Build status: STARTED
[23:55:25.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:16:0) after 3m19s
[23:58:44.349] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:16:0)
[23:58:44.366] Build status: STARTED
[23:58:44.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:17:0) after 3m37s
[00:02:21.408] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:17:0)
[00:02:21.445] Build status: STARTED
[00:02:21.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:18:0) after 6m26s
[00:08:47.478] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:18:0)
[00:08:47.494] Build status: STARTED
[00:08:47.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:19:0) after 9m43s
[00:18:30.557] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:19:0)
[00:18:30.665] Build status: STARTED
[00:18:30.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:20:0) after 6m38s
[00:25:08.687] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:20:0)
[00:25:08.703] Build status: STARTED
[00:25:08.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:21:0) after 5m17s
[00:30:25.735] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:21:0)
[00:30:25.762] Build status: STARTED
[00:30:25.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:22:0) after 5m59s
[00:36:24.821] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:22:0)
[00:36:24.837] Build status: STARTED
[00:36:24.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:23:0) after 2m46s
[00:39:10.865] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:23:0)
[00:39:10.878] Build status: STARTED
[00:39:10.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:24:0) after 3m49s
[00:42:59.950] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:24:0)
[00:42:59.975] Build status: STARTED
[00:42:59.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:25:0) after 2m18s
[00:45:17.998] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:25:0)
[00:45:18.018] Build status: STARTED
[00:45:18.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:26:0) after 2m51s
[00:48:09.050] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:26:0)
[00:48:09.068] Build status: STARTED
[00:48:09.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:27:0) after 2m22s
[00:50:31.088] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:27:0)
[00:50:31.116] Build status: STARTED
[00:50:31.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:28:0) after 7m38s
[00:58:09.244] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:28:0)
[00:58:09.323] Build status: STARTED
[00:58:09.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:29:0) after 6m13s
[01:04:22.355] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:29:0)
[01:04:22.383] Build status: STARTED
[01:04:22.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:30:0) after 8m46s
[01:13:08.445] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:30:0)
[01:13:08.462] Build status: STARTED
[01:13:08.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:31:0) after 3m54s
[01:17:02.552] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:31:0)
[01:17:02.581] Build status: STARTED
[01:17:02.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:32:0) after 8m56s
[01:25:58.691] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:32:0)
[01:25:58.811] Build status: STARTED
[01:25:58.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:33:0) after 1m30s
[01:27:28.835] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:33:0)
[01:27:28.864] Build status: STARTED
[01:27:28.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:34:0) after 7m12s
[01:34:40.881] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:34:0)
[01:34:40.905] Build status: STARTED
[01:34:40.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:35:0) after 4m1s
[01:38:42.021] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:35:0)
[01:38:42.074] Build status: STARTED
[01:38:42.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:36:0) after 4m33s
[01:43:15.150] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:36:0)
[01:43:15.176] Build status: STARTED
[01:43:15.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:37:0) after 4m17s
[01:47:32.215] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:37:0)
[01:47:32.243] Build status: STARTED
[01:47:32.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:38:0) after 9m59s
[01:57:31.419] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:38:0)
[01:57:31.435] Build status: STARTED
[01:57:31.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:39:0) after 5m48s
[02:03:19.687] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:39:0)
[02:03:19.727] Build status: STARTED
[02:03:19.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:40:0) after 7m39s
[02:10:58.748] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:40:0)
[02:10:58.771] Build status: STARTED
[02:10:58.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:41:0) after 9m18s
[02:20:16.797] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:41:0)
[02:20:16.848] Build status: STARTED
[02:20:16.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:42:0) after 4m34s
[02:24:50.881] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:42:0)
[02:24:50.898] Build status: STARTED
[02:24:50.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:43:0) after 7m11s
[02:32:01.932] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:43:0)
[02:32:01.963] Build status: STARTED
[02:32:01.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:44:0) after 8m45s
[02:40:47.024] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:44:0)
[02:40:47.046] Build status: STARTED
[02:40:47.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:45:0) after 6m49s
[02:47:36.238] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:45:0)
[02:47:36.251] Build status: STARTED
[02:47:36.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:46:0) after 6m6s
[02:53:43.152] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:46:0)
[02:53:43.174] Build status: STARTED
[02:53:43.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:47:0) after 4m41s
[02:58:24.194] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:47:0)
[02:58:24.212] Build status: STARTED
[02:58:24.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:48:0) after 7m36s
[03:06:00.266] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:48:0)
[03:06:00.337] Build status: STARTED
[03:06:00.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:49:0) after 6m24s
[03:12:24.424] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:49:0)
[03:12:24.447] Build status: STARTED
[03:12:24.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:50:0) after 8m20s
[03:20:44.799] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:50:0)
[03:20:44.821] Build status: STARTED
[03:20:44.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:51:0) after 7m3s
[03:27:47.850] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:51:0)
[03:27:47.880] Build status: STARTED
[03:27:47.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:52:0) after 5m19s
[03:33:07.031] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:52:0)
[03:33:07.060] Build status: STARTED
[03:33:07.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:53:0) after 1m42s
[03:34:49.591] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:53:0)
[03:34:49.607] Build status: STARTED
[03:34:49.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:54:0) after 6m34s
[03:41:23.636] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:54:0)
[03:41:23.657] Build status: STARTED
[03:41:23.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:55:0) after 2m3s
[03:43:26.681] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:55:0)
[03:43:26.701] Build status: STARTED
[03:43:26.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:56:0) after 4m27s
[03:47:53.867] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:56:0)
[03:47:53.883] Build status: STARTED
[03:47:53.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:57:0) after 5m11s
[03:53:05.174] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:57:0)
[03:53:05.191] Build status: STARTED
[03:53:05.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:58:0) after 7m27s
[04:00:32.209] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:58:0)
[04:00:32.242] Build status: STARTED
[04:00:32.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:59:0) after 9m6s
[04:09:38.368] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:59:0)
[04:09:38.383] Build status: STARTED
[04:09:38.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:60:0) after 3m11s
[04:12:49.606] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:60:0)
[04:12:49.622] Build status: STARTED
[04:12:49.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:61:0) after 1m11s
[04:14:00.689] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:61:0)
[04:14:00.711] Build status: STARTED
[04:14:00.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:62:0) after 5m44s
[04:19:44.770] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:62:0)
[04:19:44.816] Build status: STARTED
[04:19:44.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:63:0) after 9m34s
[04:29:18.823] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:63:0)
[04:29:18.840] Build status: STARTED
[04:29:18.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:64:0) after 2m56s
[04:32:15.279] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:64:0)
[04:32:15.302] Build status: STARTED
[04:32:15.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876934168571274624:65:0) after 7m34s
[04:33:34.098] Received PubSub notification, asking Buildbucket for the build status
[04:33:34.125] Build:
{
"id": "8711504106585275169",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 36904,
"createdBy": "project:chromium",
"createTime": "2025-06-20T22:41:38.490018091Z",
"startTime": "2025-06-20T22:41:42.850685469Z",
"endTime": "2025-06-21T04:33:16.151224582Z",
"updateTime": "2025-06-21T04:33:16.151224582Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0ad18cee13f7edce4b5ef5484ef843bc4a46d795",
"ref": "refs/heads/main"
}
},
"canary": true
}
[04:33:34.125] Invocation finished in 5h51m56.912399082s with status FAILED