[03:58:20.216] New invocation is queued and will start shortly
[03:58:24.300] Starting the invocation (attempt 1)
[03:58:24.323] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/5994fe35ecf6a1725e4e6ce23c6107c823acd23c"
[03:58:24.323] Popped gitiles commit info from properties and tags
[03:58:24.323] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:58:24.324] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:58:24.324] Buildbucket request:
{
"requestId": "8844118140644911120",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5994fe35ecf6a1725e4e6ce23c6107c823acd23c",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8844118140644911120"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWin"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:58:24.998] Scheduled build:
{
"id": "8678688075595418161",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin"
},
"number": 13448,
"createdBy": "project:chromium",
"createTime": "2026-06-18T03:58:24.411845310Z",
"updateTime": "2026-06-18T03:58:24.411845310Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5994fe35ecf6a1725e4e6ce23c6107c823acd23c",
"ref": "refs/heads/main"
}
}
}
[03:58:24.998] Task URL: https://cr-buildbucket.appspot.com/build/8678688075595418161
[03:58:24.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:2:0) after 2m24s
[03:58:25.962] Received PubSub notification, asking Buildbucket for the build status
[03:58:25.998] Build status: SCHEDULED
[04:00:01.738] Received PubSub notification, asking Buildbucket for the build status
[04:00:01.756] Build status: STARTED
[04:00:49.093] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:2:0)
[04:00:49.137] Build status: STARTED
[04:00:49.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:5:0) after 7m39s
[04:08:28.159] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:5:0)
[04:08:28.272] Build status: STARTED
[04:08:28.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:6:0) after 6m42s
[04:15:10.293] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:6:0)
[04:15:10.315] Build status: STARTED
[04:15:10.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:7:0) after 9m48s
[04:24:58.430] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:7:0)
[04:24:58.457] Build status: STARTED
[04:24:58.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:8:0) after 4m12s
[04:29:10.445] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:8:0)
[04:29:10.464] Build status: STARTED
[04:29:10.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:9:0) after 7m40s
[04:36:50.534] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:9:0)
[04:36:50.604] Build status: STARTED
[04:36:50.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:10:0) after 1m37s
[04:38:27.597] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:10:0)
[04:38:27.612] Build status: STARTED
[04:38:27.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:11:0) after 3m7s
[04:41:34.628] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:11:0)
[04:41:34.650] Build status: STARTED
[04:41:34.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:12:0) after 8m47s
[04:50:21.669] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:12:0)
[04:50:21.706] Build status: STARTED
[04:50:21.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:13:0) after 5m11s
[04:55:32.785] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:13:0)
[04:55:32.806] Build status: STARTED
[04:55:32.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:14:0) after 1m9s
[04:56:41.788] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:14:0)
[04:56:41.807] Build status: STARTED
[04:56:41.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:15:0) after 1m47s
[04:58:28.879] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:15:0)
[04:58:29.096] Build status: STARTED
[04:58:29.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:16:0) after 9m7s
[05:07:36.168] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:16:0)
[05:07:36.190] Build status: STARTED
[05:07:36.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:17:0) after 2m54s
[05:10:30.217] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:17:0)
[05:10:30.237] Build status: STARTED
[05:10:30.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:18:0) after 1m47s
[05:12:17.222] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:18:0)
[05:12:17.242] Build status: STARTED
[05:12:17.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:19:0) after 2m13s
[05:14:30.263] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:19:0)
[05:14:30.282] Build status: STARTED
[05:14:30.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:20:0) after 9m3s
[05:23:33.349] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:20:0)
[05:23:33.369] Build status: STARTED
[05:23:33.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:21:0) after 2m1s
[05:25:34.398] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:21:0)
[05:25:34.455] Build status: STARTED
[05:25:34.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:22:0) after 5m16s
[05:30:50.430] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:22:0)
[05:30:50.447] Build status: STARTED
[05:30:50.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:23:0) after 7m44s
[05:38:34.495] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:23:0)
[05:38:34.517] Build status: STARTED
[05:38:34.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:24:0) after 5m48s
[05:44:22.529] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:24:0)
[05:44:22.545] Build status: STARTED
[05:44:22.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:25:0) after 1m2s
[05:45:24.606] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:25:0)
[05:45:24.625] Build status: STARTED
[05:45:24.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:26:0) after 3m28s
[05:48:52.800] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:26:0)
[05:48:52.818] Build status: STARTED
[05:48:52.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:27:0) after 1m50s
[05:50:42.832] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:27:0)
[05:50:42.852] Build status: STARTED
[05:50:42.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:28:0) after 2m8s
[05:52:50.877] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:28:0)
[05:52:50.943] Build status: STARTED
[05:52:50.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:29:0) after 6m56s
[05:59:46.978] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:29:0)
[05:59:46.995] Build status: STARTED
[05:59:46.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:30:0) after 9m58s
[06:09:45.011] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:30:0)
[06:09:45.027] Build status: STARTED
[06:09:45.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:31:0) after 9m51s
[06:19:36.097] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:31:0)
[06:19:36.115] Build status: STARTED
[06:19:36.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:32:0) after 3m50s
[06:23:26.188] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:32:0)
[06:23:26.209] Build status: STARTED
[06:23:26.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:33:0) after 5m58s
[06:29:24.251] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:33:0)
[06:29:24.268] Build status: STARTED
[06:29:24.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:34:0) after 1m59s
[06:31:23.312] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:34:0)
[06:31:23.333] Build status: STARTED
[06:31:23.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:35:0) after 6m54s
[06:38:17.347] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:35:0)
[06:38:17.365] Build status: STARTED
[06:38:17.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:36:0) after 9m12s
[06:47:29.383] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:36:0)
[06:47:29.401] Build status: STARTED
[06:47:29.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:37:0) after 7m47s
[06:55:16.421] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:37:0)
[06:55:16.461] Build status: STARTED
[06:55:16.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:38:0) after 3m0s
[06:58:16.550] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:38:0)
[06:58:16.569] Build status: STARTED
[06:58:16.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:39:0) after 9m37s
[07:07:53.633] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:39:0)
[07:07:53.658] Build status: STARTED
[07:07:53.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:40:0) after 7m38s
[07:15:31.683] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:40:0)
[07:15:31.727] Build status: STARTED
[07:15:31.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:41:0) after 9m43s
[07:25:14.836] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:41:0)
[07:25:14.855] Build status: STARTED
[07:25:14.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:42:0) after 1m28s
[07:26:42.875] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:42:0)
[07:26:42.896] Build status: STARTED
[07:26:42.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:43:0) after 4m29s
[07:31:11.918] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:43:0)
[07:31:11.937] Build status: STARTED
[07:31:11.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:44:0) after 7m50s
[07:39:01.991] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:44:0)
[07:39:02.024] Build status: STARTED
[07:39:02.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:45:0) after 6m35s
[07:45:37.143] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:45:0)
[07:45:37.173] Build status: STARTED
[07:45:37.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:46:0) after 7m16s
[07:52:53.216] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:46:0)
[07:52:53.234] Build status: STARTED
[07:52:53.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:47:0) after 1m10s
[07:54:03.258] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:47:0)
[07:54:03.278] Build status: STARTED
[07:54:03.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:48:0) after 7m44s
[08:01:47.483] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:48:0)
[08:01:47.535] Build status: STARTED
[08:01:47.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:49:0) after 5m58s
[08:07:45.598] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:49:0)
[08:07:45.616] Build status: STARTED
[08:07:45.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:50:0) after 1m28s
[08:09:13.639] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:50:0)
[08:09:13.679] Build status: STARTED
[08:09:13.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:51:0) after 7m42s
[08:16:55.698] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:51:0)
[08:16:55.730] Build status: STARTED
[08:16:55.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:52:0) after 7m6s
[08:24:01.749] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:52:0)
[08:24:01.769] Build status: STARTED
[08:24:01.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:53:0) after 8m43s
[08:32:44.806] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:53:0)
[08:32:44.826] Build status: STARTED
[08:32:44.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:54:0) after 1m20s
[08:34:04.854] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:54:0)
[08:34:04.871] Build status: STARTED
[08:34:04.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:55:0) after 8m39s
[08:42:43.898] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:55:0)
[08:42:43.918] Build status: STARTED
[08:42:43.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:56:0) after 5m8s
[08:47:51.943] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:56:0)
[08:47:52.007] Build status: STARTED
[08:47:52.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:57:0) after 9m34s
[08:57:26.027] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:57:0)
[08:57:26.049] Build status: STARTED
[08:57:26.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:58:0) after 5m26s
[09:02:52.069] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:58:0)
[09:02:52.117] Build status: STARTED
[09:02:52.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:59:0) after 7m55s
[09:10:47.165] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:59:0)
[09:10:47.210] Build status: STARTED
[09:10:47.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:60:0) after 5m44s
[09:16:31.326] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:60:0)
[09:16:31.342] Build status: STARTED
[09:16:31.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:61:0) after 3m23s
[09:19:54.356] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:61:0)
[09:19:54.373] Build status: STARTED
[09:19:54.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:62:0) after 4m3s
[09:23:57.394] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:62:0)
[09:23:57.427] Build status: STARTED
[09:23:57.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:63:0) after 5m48s
[09:29:45.838] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:63:0)
[09:29:45.857] Build status: STARTED
[09:29:45.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:64:0) after 7m39s
[09:37:25.036] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:64:0)
[09:37:25.056] Build status: STARTED
[09:37:25.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:65:0) after 6m59s
[09:44:24.078] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:65:0)
[09:44:24.121] Build status: STARTED
[09:44:24.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:66:0) after 6m57s
[09:51:21.142] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:66:0)
[09:51:21.168] Build status: STARTED
[09:51:21.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:67:0) after 6m48s
[09:58:09.217] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:67:0)
[09:58:09.298] Build status: STARTED
[09:58:09.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:68:0) after 6m21s
[10:04:30.340] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:68:0)
[10:04:30.367] Build status: STARTED
[10:04:30.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8844118140644911120:69:0) after 2m4s
[10:06:05.094] Received PubSub notification, asking Buildbucket for the build status
[10:06:05.177] Build:
{
"id": "8678688075595418161",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin"
},
"number": 13448,
"createdBy": "project:chromium",
"createTime": "2026-06-18T03:58:24.411845310Z",
"startTime": "2026-06-18T04:00:01.537866437Z",
"endTime": "2026-06-18T10:06:04.839082816Z",
"updateTime": "2026-06-18T10:06:04.839082816Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5994fe35ecf6a1725e4e6ce23c6107c823acd23c",
"ref": "refs/heads/main"
}
}
}
[10:06:05.177] Invocation finished in 6h7m44.965646697s with status FAILED