[01:46:28.946] New invocation is queued and will start shortly
[01:46:30.005] Starting the invocation (attempt 1)
[01:46:30.031] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/937f57572d95300d83e338e063b9f7f82ecb9707"
[01:46:30.031] Popped gitiles commit info from properties and tags
[01:46:30.032] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:46:30.032] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:46:30.032] Buildbucket request:
{
"requestId": "8848475090599988336",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "937f57572d95300d83e338e063b9f7f82ecb9707",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8848475090599988336"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:46:30.545] Scheduled build:
{
"id": "8683045028737643201",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 40553,
"createdBy": "project:chromium",
"createTime": "2026-05-01T01:46:30.101044265Z",
"updateTime": "2026-05-01T01:46:30.101044265Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "937f57572d95300d83e338e063b9f7f82ecb9707",
"ref": "refs/heads/main"
}
}
}
[01:46:30.545] Task URL: https://cr-buildbucket.appspot.com/build/8683045028737643201
[01:46:30.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:2:0) after 6m15s
[01:46:32.051] Received PubSub notification, asking Buildbucket for the build status
[01:46:32.083] Build status: SCHEDULED
[01:47:15.529] Received PubSub notification, asking Buildbucket for the build status
[01:47:15.641] Build status: STARTED
[01:52:45.567] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:2:0)
[01:52:45.595] Build status: STARTED
[01:52:45.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:5:0) after 4m49s
[01:57:34.626] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:5:0)
[01:57:34.681] Build status: STARTED
[01:57:34.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:6:0) after 1m56s
[01:59:30.795] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:6:0)
[01:59:30.856] Build status: STARTED
[01:59:30.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:7:0) after 5m57s
[02:05:27.977] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:7:0)
[02:05:28.060] Build status: STARTED
[02:05:28.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:8:0) after 8m59s
[02:14:27.082] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:8:0)
[02:14:27.100] Build status: STARTED
[02:14:27.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:9:0) after 3m35s
[02:18:02.177] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:9:0)
[02:18:02.206] Build status: STARTED
[02:18:02.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:10:0) after 1m37s
[02:19:39.252] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:10:0)
[02:19:39.279] Build status: STARTED
[02:19:39.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:11:0) after 2m11s
[02:21:50.350] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:11:0)
[02:21:50.367] Build status: STARTED
[02:21:50.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:12:0) after 9m7s
[02:30:57.501] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:12:0)
[02:30:57.522] Build status: STARTED
[02:30:57.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:13:0) after 2m31s
[02:33:28.547] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:13:0)
[02:33:28.562] Build status: STARTED
[02:33:28.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:14:0) after 7m17s
[02:40:45.585] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:14:0)
[02:40:45.600] Build status: STARTED
[02:40:45.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:15:0) after 3m34s
[02:44:19.707] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:15:0)
[02:44:19.726] Build status: STARTED
[02:44:19.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:16:0) after 2m26s
[02:46:45.727] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:16:0)
[02:46:45.743] Build status: STARTED
[02:46:45.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:17:0) after 7m45s
[02:54:30.897] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:17:0)
[02:54:30.936] Build status: STARTED
[02:54:30.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:18:0) after 9m58s
[03:04:28.961] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:18:0)
[03:04:28.979] Build status: STARTED
[03:04:28.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:19:0) after 5m22s
[03:09:51.073] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:19:0)
[03:09:51.092] Build status: STARTED
[03:09:51.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:20:0) after 8m45s
[03:18:36.123] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:20:0)
[03:18:36.154] Build status: STARTED
[03:18:36.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:21:0) after 9m0s
[03:27:36.244] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:21:0)
[03:27:36.304] Build status: STARTED
[03:27:36.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:22:0) after 9m53s
[03:37:29.387] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:22:0)
[03:37:29.405] Build status: STARTED
[03:37:29.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:23:0) after 3m4s
[03:40:33.440] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:23:0)
[03:40:33.467] Build status: STARTED
[03:40:33.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:24:0) after 3m23s
[03:43:56.489] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:24:0)
[03:43:56.523] Build status: STARTED
[03:43:56.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:25:0) after 6m2s
[03:49:58.546] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:25:0)
[03:49:58.560] Build status: STARTED
[03:49:58.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:26:0) after 4m52s
[03:54:50.631] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:26:0)
[03:54:50.651] Build status: STARTED
[03:54:50.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:27:0) after 8m38s
[04:03:28.655] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:27:0)
[04:03:28.680] Build status: STARTED
[04:03:28.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:28:0) after 8m5s
[04:11:33.808] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:28:0)
[04:11:33.828] Build status: STARTED
[04:11:33.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:29:0) after 9m32s
[04:21:05.902] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:29:0)
[04:21:05.919] Build status: STARTED
[04:21:05.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:30:0) after 2m44s
[04:23:49.940] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:30:0)
[04:23:49.967] Build status: STARTED
[04:23:49.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:31:0) after 5m31s
[04:29:21.024] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:31:0)
[04:29:21.055] Build status: STARTED
[04:29:21.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:32:0) after 5m29s
[04:34:50.126] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:32:0)
[04:34:50.146] Build status: STARTED
[04:34:50.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:33:0) after 3m6s
[04:37:56.282] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:33:0)
[04:37:56.296] Build status: STARTED
[04:37:56.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:34:0) after 2m25s
[04:40:21.312] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:34:0)
[04:40:21.332] Build status: STARTED
[04:40:21.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:35:0) after 5m20s
[04:45:41.332] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:35:0)
[04:45:41.358] Build status: STARTED
[04:45:41.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:36:0) after 8m31s
[04:54:12.491] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:36:0)
[04:54:12.509] Build status: STARTED
[04:54:12.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:37:0) after 3m42s
[04:57:54.527] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:37:0)
[04:57:54.546] Build status: STARTED
[04:57:54.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:38:0) after 3m13s
[05:01:07.633] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:38:0)
[05:01:07.654] Build status: STARTED
[05:01:07.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:39:0) after 4m3s
[05:05:10.679] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:39:0)
[05:05:10.699] Build status: STARTED
[05:05:10.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:40:0) after 3m37s
[05:08:47.762] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:40:0)
[05:08:48.164] Build status: STARTED
[05:08:48.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:41:0) after 3m57s
[05:12:45.178] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:41:0)
[05:12:45.198] Build status: STARTED
[05:12:45.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:42:0) after 8m19s
[05:21:04.222] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:42:0)
[05:21:04.241] Build status: STARTED
[05:21:04.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:43:0) after 9m18s
[05:30:22.277] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:43:0)
[05:30:22.296] Build status: STARTED
[05:30:22.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:44:0) after 7m23s
[05:37:45.401] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:44:0)
[05:37:45.416] Build status: STARTED
[05:37:45.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:45:0) after 9m56s
[05:47:41.463] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:45:0)
[05:47:41.482] Build status: STARTED
[05:47:41.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:46:0) after 8m46s
[05:56:27.530] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:46:0)
[05:56:27.545] Build status: STARTED
[05:56:27.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:47:0) after 7m20s
[06:03:47.567] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:47:0)
[06:03:47.596] Build status: STARTED
[06:03:47.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:48:0) after 6m3s
[06:09:50.683] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:48:0)
[06:09:50.725] Build status: STARTED
[06:09:50.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:49:0) after 7m1s
[06:16:51.764] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:49:0)
[06:16:51.787] Build status: STARTED
[06:16:51.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:50:0) after 1m55s
[06:18:46.809] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:50:0)
[06:18:46.825] Build status: STARTED
[06:18:46.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:51:0) after 3m9s
[06:21:55.946] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:51:0)
[06:21:55.964] Build status: STARTED
[06:21:55.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:52:0) after 4m52s
[06:26:47.985] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:52:0)
[06:26:48.005] Build status: STARTED
[06:26:48.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:53:0) after 8m45s
[06:35:33.000] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:53:0)
[06:35:33.061] Build status: STARTED
[06:35:33.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:54:0) after 6m55s
[06:42:28.154] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:54:0)
[06:42:28.173] Build status: STARTED
[06:42:28.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:55:0) after 8m54s
[06:51:22.381] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:55:0)
[06:51:22.397] Build status: STARTED
[06:51:22.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:56:0) after 7m9s
[06:58:31.495] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:56:0)
[06:58:31.512] Build status: STARTED
[06:58:31.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:57:0) after 7m10s
[07:05:41.537] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:57:0)
[07:05:41.552] Build status: STARTED
[07:05:41.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:58:0) after 3m57s
[07:09:38.624] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:58:0)
[07:09:38.644] Build status: STARTED
[07:09:38.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:59:0) after 3m29s
[07:13:07.665] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:59:0)
[07:13:07.684] Build status: STARTED
[07:13:07.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:60:0) after 5m26s
[07:18:33.768] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:60:0)
[07:18:33.786] Build status: STARTED
[07:18:33.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8848475090599988336:61:0) after 9m23s
[07:24:00.655] Received PubSub notification, asking Buildbucket for the build status
[07:24:00.673] Build:
{
"id": "8683045028737643201",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 40553,
"createdBy": "project:chromium",
"createTime": "2026-05-01T01:46:30.101044265Z",
"startTime": "2026-05-01T01:47:10.283613655Z",
"endTime": "2026-05-01T07:24:00.265924430Z",
"updateTime": "2026-05-01T07:24:00.265924430Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "937f57572d95300d83e338e063b9f7f82ecb9707",
"ref": "refs/heads/main"
}
}
}
[07:24:00.673] Invocation finished in 5h37m31.73097096s with status FAILED