[00:30:08.359] New invocation is queued and will start shortly
[00:30:11.145] Starting the invocation (attempt 1)
[00:30:11.173] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f7b61e8af68e6da3331852aafe67729354683273"
[00:30:11.173] Popped gitiles commit info from properties and tags
[00:30:11.174] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:30:11.174] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:30:11.174] Buildbucket request:
{
"requestId": "8851741384484645296",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac (dbg)"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f7b61e8af68e6da3331852aafe67729354683273",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851741384484645296"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac (dbg)"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[00:30:11.662] Scheduled build:
{
"id": "8686311320830618081",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac (dbg)"
},
"number": 39811,
"createdBy": "project:chromium",
"createTime": "2026-03-26T00:30:11.222144178Z",
"updateTime": "2026-03-26T00:30:11.222144178Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f7b61e8af68e6da3331852aafe67729354683273",
"ref": "refs/heads/main"
}
}
}
[00:30:11.662] Task URL: https://cr-buildbucket.appspot.com/build/8686311320830618081
[00:30:11.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:2:0) after 6m8s
[00:30:11.975] Received PubSub notification, asking Buildbucket for the build status
[00:30:12.006] Build status: SCHEDULED
[00:30:56.034] Received PubSub notification, asking Buildbucket for the build status
[00:30:56.090] Build status: STARTED
[00:36:19.680] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:2:0)
[00:36:19.705] Build status: STARTED
[00:36:19.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:5:0) after 7m37s
[00:43:56.784] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:5:0)
[00:43:56.804] Build status: STARTED
[00:43:56.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:6:0) after 6m32s
[00:50:28.886] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:6:0)
[00:50:28.902] Build status: STARTED
[00:50:28.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:7:0) after 5m42s
[00:56:11.016] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:7:0)
[00:56:11.044] Build status: STARTED
[00:56:11.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:8:0) after 7m47s
[01:03:58.077] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:8:0)
[01:03:58.096] Build status: STARTED
[01:03:58.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:9:0) after 3m57s
[01:07:55.172] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:9:0)
[01:07:55.192] Build status: STARTED
[01:07:55.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:10:0) after 7m29s
[01:15:24.217] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:10:0)
[01:15:24.273] Build status: STARTED
[01:15:24.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:11:0) after 7m1s
[01:22:25.292] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:11:0)
[01:22:25.322] Build status: STARTED
[01:22:25.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:12:0) after 5m47s
[01:28:12.345] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:12:0)
[01:28:12.387] Build status: STARTED
[01:28:12.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:13:0) after 1m37s
[01:29:49.424] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:13:0)
[01:29:49.462] Build status: STARTED
[01:29:49.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:14:0) after 2m24s
[01:32:13.576] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:14:0)
[01:32:13.594] Build status: STARTED
[01:32:13.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:15:0) after 7m35s
[01:39:48.669] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:15:0)
[01:39:48.686] Build status: STARTED
[01:39:48.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:16:0) after 9m28s
[01:49:16.731] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:16:0)
[01:49:16.748] Build status: STARTED
[01:49:16.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:17:0) after 4m26s
[01:53:42.862] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:17:0)
[01:53:42.919] Build status: STARTED
[01:53:42.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:18:0) after 8m16s
[02:01:58.944] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:18:0)
[02:01:58.961] Build status: STARTED
[02:01:58.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:19:0) after 6m51s
[02:08:49.992] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:19:0)
[02:08:50.008] Build status: STARTED
[02:08:50.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:20:0) after 2m45s
[02:11:35.037] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:20:0)
[02:11:35.055] Build status: STARTED
[02:11:35.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:21:0) after 4m11s
[02:15:46.088] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:21:0)
[02:15:46.162] Build status: STARTED
[02:15:46.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:22:0) after 4m49s
[02:20:35.183] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:22:0)
[02:20:35.577] Build status: STARTED
[02:20:35.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:23:0) after 5m4s
[02:25:39.596] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:23:0)
[02:25:39.617] Build status: STARTED
[02:25:39.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:24:0) after 7m30s
[02:33:09.680] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:24:0)
[02:33:09.734] Build status: STARTED
[02:33:09.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:25:0) after 8m29s
[02:41:38.762] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:25:0)
[02:41:38.778] Build status: STARTED
[02:41:38.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:26:0) after 3m36s
[02:45:14.797] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:26:0)
[02:45:14.821] Build status: STARTED
[02:45:14.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:27:0) after 8m23s
[02:53:37.804] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:27:0)
[02:53:37.822] Build status: STARTED
[02:53:37.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:28:0) after 4m22s
[02:57:59.986] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:28:0)
[02:58:00.003] Build status: STARTED
[02:58:00.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:29:0) after 2m41s
[03:00:41.020] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:29:0)
[03:00:41.068] Build status: STARTED
[03:00:41.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:30:0) after 2m59s
[03:03:40.093] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:30:0)
[03:03:40.111] Build status: STARTED
[03:03:40.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:31:0) after 7m31s
[03:11:11.134] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:31:0)
[03:11:11.150] Build status: STARTED
[03:11:11.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:32:0) after 1m45s
[03:12:56.188] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:32:0)
[03:12:56.202] Build status: STARTED
[03:12:56.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:33:0) after 5m36s
[03:18:32.227] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:33:0)
[03:18:32.313] Build status: STARTED
[03:18:32.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:34:0) after 1m47s
[03:20:19.334] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:34:0)
[03:20:19.350] Build status: STARTED
[03:20:19.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:35:0) after 9m44s
[03:30:03.371] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:35:0)
[03:30:03.392] Build status: STARTED
[03:30:03.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:36:0) after 4m7s
[03:34:10.459] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:36:0)
[03:34:10.483] Build status: STARTED
[03:34:10.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:37:0) after 8m8s
[03:42:18.598] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:37:0)
[03:42:18.617] Build status: STARTED
[03:42:18.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:38:0) after 5m14s
[03:47:32.645] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:38:0)
[03:47:32.663] Build status: STARTED
[03:47:32.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:39:0) after 4m2s
[03:51:34.691] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:39:0)
[03:51:34.708] Build status: STARTED
[03:51:34.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:40:0) after 7m56s
[03:59:30.792] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:40:0)
[03:59:30.811] Build status: STARTED
[03:59:30.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:41:0) after 5m16s
[04:04:46.918] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:41:0)
[04:04:46.945] Build status: STARTED
[04:04:46.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:42:0) after 8m48s
[04:13:35.025] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:42:0)
[04:13:35.109] Build status: STARTED
[04:13:35.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:43:0) after 6m59s
[04:20:34.167] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:43:0)
[04:20:34.185] Build status: STARTED
[04:20:34.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:44:0) after 1m31s
[04:22:05.208] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:44:0)
[04:22:05.227] Build status: STARTED
[04:22:05.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:45:0) after 1m48s
[04:23:53.284] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:45:0)
[04:23:53.362] Build status: STARTED
[04:23:53.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:46:0) after 4m47s
[04:28:40.489] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:46:0)
[04:28:40.508] Build status: STARTED
[04:28:40.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:47:0) after 8m19s
[04:36:59.698] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:47:0)
[04:36:59.717] Build status: STARTED
[04:36:59.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:48:0) after 7m29s
[04:44:28.947] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:48:0)
[04:44:28.964] Build status: STARTED
[04:44:28.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:49:0) after 1m24s
[04:45:53.092] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:49:0)
[04:45:53.110] Build status: STARTED
[04:45:53.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:50:0) after 4m7s
[04:50:00.141] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:50:0)
[04:50:00.161] Build status: STARTED
[04:50:00.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:51:0) after 9m20s
[04:59:20.245] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:51:0)
[04:59:20.332] Build status: STARTED
[04:59:20.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:52:0) after 6m46s
[05:06:06.395] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:52:0)
[05:06:06.408] Build status: STARTED
[05:06:06.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:53:0) after 5m51s
[05:11:57.434] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:53:0)
[05:11:57.460] Build status: STARTED
[05:11:57.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:54:0) after 9m42s
[05:21:39.518] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:54:0)
[05:21:39.539] Build status: STARTED
[05:21:39.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:55:0) after 2m1s
[05:23:40.556] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:55:0)
[05:23:40.573] Build status: STARTED
[05:23:40.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:56:0) after 1m28s
[05:25:08.614] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:56:0)
[05:25:08.660] Build status: STARTED
[05:25:08.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:57:0) after 9m25s
[05:34:33.675] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:57:0)
[05:34:33.691] Build status: STARTED
[05:34:33.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:58:0) after 7m39s
[05:42:12.742] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:58:0)
[05:42:12.762] Build status: STARTED
[05:42:12.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:59:0) after 7m27s
[05:49:39.834] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:59:0)
[05:49:39.909] Build status: STARTED
[05:49:39.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:60:0) after 4m59s
[05:54:38.986] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:60:0)
[05:54:39.006] Build status: STARTED
[05:54:39.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:61:0) after 8m54s
[06:03:33.245] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:61:0)
[06:03:33.264] Build status: STARTED
[06:03:33.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:62:0) after 8m0s
[06:11:33.316] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:62:0)
[06:11:33.332] Build status: STARTED
[06:11:33.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:63:0) after 8m10s
[06:19:43.457] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:63:0)
[06:19:43.477] Build status: STARTED
[06:19:43.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:64:0) after 7m15s
[06:26:58.553] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:64:0)
[06:26:58.627] Build status: STARTED
[06:26:58.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:65:0) after 5m28s
[06:32:26.650] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:65:0)
[06:32:26.672] Build status: STARTED
[06:32:26.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8851741384484645296:66:0) after 2m10s
[06:33:52.374] Received PubSub notification, asking Buildbucket for the build status
[06:33:52.397] Build:
{
"id": "8686311320830618081",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac (dbg)"
},
"number": 39811,
"createdBy": "project:chromium",
"createTime": "2026-03-26T00:30:11.222144178Z",
"startTime": "2026-03-26T00:30:55.789333009Z",
"endTime": "2026-03-26T06:33:52.115113339Z",
"updateTime": "2026-03-26T06:33:52.115113339Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f7b61e8af68e6da3331852aafe67729354683273",
"ref": "refs/heads/main"
}
}
}
[06:33:52.397] Invocation finished in 6h3m44.042778806s with status FAILED