[01:02:12.628] New invocation is queued and will start shortly
[01:02:13.994] Starting the invocation (attempt 1)
[01:02:14.021] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9ec5e3a99c5ab5e66cf6f6412b57fda0aafa1f93"
[01:02:14.021] Popped gitiles commit info from properties and tags
[01:02:14.021] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:02:14.021] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:02:14.022] Buildbucket request:
{
"requestId": "8881183380831568160",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9ec5e3a99c5ab5e66cf6f6412b57fda0aafa1f93",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8881183380831568160"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:02:14.534] Scheduled build:
{
"id": "8715753318651487553",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 35998,
"createdBy": "project:chromium",
"createTime": "2025-05-05T01:02:14.077520714Z",
"updateTime": "2025-05-05T01:02:14.077520714Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9ec5e3a99c5ab5e66cf6f6412b57fda0aafa1f93",
"ref": "refs/heads/main"
}
}
}
[01:02:14.534] Task URL: https://cr-buildbucket.appspot.com/build/8715753318651487553
[01:02:14.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:2:0) after 7m39s
[01:02:15.548] Received PubSub notification, asking Buildbucket for the build status
[01:02:15.563] Build status: SCHEDULED
[01:02:17.871] Received PubSub notification, asking Buildbucket for the build status
[01:02:17.910] Build status: STARTED
[01:09:53.991] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:2:0)
[01:09:54.065] Build status: STARTED
[01:09:54.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:5:0) after 1m53s
[01:11:47.057] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:5:0)
[01:11:47.080] Build status: STARTED
[01:11:47.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:6:0) after 5m57s
[01:17:45.268] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:6:0)
[01:17:45.286] Build status: STARTED
[01:17:45.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:7:0) after 8m33s
[01:26:18.312] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:7:0)
[01:26:18.347] Build status: STARTED
[01:26:18.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:8:0) after 8m3s
[01:34:21.505] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:8:0)
[01:34:21.523] Build status: STARTED
[01:34:21.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:9:0) after 9m33s
[01:43:54.818] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:9:0)
[01:43:54.843] Build status: STARTED
[01:43:54.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:10:0) after 2m31s
[01:46:25.894] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:10:0)
[01:46:25.911] Build status: STARTED
[01:46:25.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:11:0) after 9m12s
[01:55:37.917] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:11:0)
[01:55:37.944] Build status: STARTED
[01:55:37.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:12:0) after 5m27s
[02:01:04.970] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:12:0)
[02:01:05.067] Build status: STARTED
[02:01:05.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:13:0) after 8m37s
[02:09:42.166] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:13:0)
[02:09:42.357] Build status: STARTED
[02:09:42.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:14:0) after 7m31s
[02:17:13.392] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:14:0)
[02:17:13.413] Build status: STARTED
[02:17:13.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:15:0) after 6m19s
[02:23:32.438] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:15:0)
[02:23:32.489] Build status: STARTED
[02:23:32.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:16:0) after 9m41s
[02:33:13.705] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:16:0)
[02:33:13.736] Build status: STARTED
[02:33:13.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:17:0) after 4m31s
[02:37:44.797] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:17:0)
[02:37:44.819] Build status: STARTED
[02:37:44.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:18:0) after 2m48s
[02:40:32.843] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:18:0)
[02:40:32.864] Build status: STARTED
[02:40:32.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:19:0) after 7m7s
[02:47:40.060] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:19:0)
[02:47:40.082] Build status: STARTED
[02:47:40.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:20:0) after 8m20s
[02:56:00.108] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:20:0)
[02:56:00.191] Build status: STARTED
[02:56:00.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:21:0) after 8m36s
[03:04:36.300] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:21:0)
[03:04:36.330] Build status: STARTED
[03:04:36.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:22:0) after 2m46s
[03:07:22.480] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:22:0)
[03:07:22.503] Build status: STARTED
[03:07:22.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:23:0) after 9m4s
[03:16:26.839] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:23:0)
[03:16:26.906] Build status: STARTED
[03:16:26.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:24:0) after 9m2s
[03:25:29.018] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:24:0)
[03:25:29.070] Build status: STARTED
[03:25:29.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:25:0) after 4m2s
[03:29:31.155] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:25:0)
[03:29:31.233] Build status: STARTED
[03:29:31.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:26:0) after 9m52s
[03:39:23.350] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:26:0)
[03:39:23.382] Build status: STARTED
[03:39:23.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:27:0) after 6m52s
[03:46:15.419] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:27:0)
[03:46:15.443] Build status: STARTED
[03:46:15.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:28:0) after 5m39s
[03:51:54.533] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:28:0)
[03:51:54.561] Build status: STARTED
[03:51:54.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:29:0) after 4m2s
[03:55:56.671] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:29:0)
[03:55:56.689] Build status: STARTED
[03:55:56.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:30:0) after 2m4s
[03:58:00.715] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:30:0)
[03:58:00.731] Build status: STARTED
[03:58:00.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:31:0) after 3m22s
[04:01:22.863] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:31:0)
[04:01:22.894] Build status: STARTED
[04:01:22.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:32:0) after 3m9s
[04:04:31.913] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:32:0)
[04:04:31.939] Build status: STARTED
[04:04:31.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:33:0) after 4m47s
[04:09:18.948] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:33:0)
[04:09:18.963] Build status: STARTED
[04:09:18.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:34:0) after 4m2s
[04:13:21.080] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:34:0)
[04:13:21.156] Build status: STARTED
[04:13:21.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:35:0) after 7m46s
[04:21:07.335] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:35:0)
[04:21:07.361] Build status: STARTED
[04:21:07.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:36:0) after 4m51s
[04:25:58.502] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:36:0)
[04:25:58.527] Build status: STARTED
[04:25:58.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:37:0) after 8m59s
[04:34:57.566] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:37:0)
[04:34:57.585] Build status: STARTED
[04:34:57.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:38:0) after 4m20s
[04:39:17.727] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:38:0)
[04:39:17.747] Build status: STARTED
[04:39:17.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:39:0) after 7m36s
[04:46:53.721] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:39:0)
[04:46:53.743] Build status: STARTED
[04:46:53.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:40:0) after 8m8s
[04:55:01.790] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:40:0)
[04:55:01.808] Build status: STARTED
[04:55:01.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:41:0) after 6m19s
[05:01:20.833] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:41:0)
[05:01:20.849] Build status: STARTED
[05:01:20.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:42:0) after 4m43s
[05:06:03.861] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:42:0)
[05:06:03.881] Build status: STARTED
[05:06:03.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:43:0) after 6m44s
[05:12:47.903] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:43:0)
[05:12:47.921] Build status: STARTED
[05:12:47.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:44:0) after 4m6s
[05:16:53.953] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:44:0)
[05:16:53.975] Build status: STARTED
[05:16:53.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:45:0) after 5m59s
[05:22:52.998] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:45:0)
[05:22:53.025] Build status: STARTED
[05:22:53.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:46:0) after 6m59s
[05:29:52.062] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:46:0)
[05:29:52.123] Build status: STARTED
[05:29:52.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:47:0) after 6m46s
[05:36:38.148] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:47:0)
[05:36:38.188] Build status: STARTED
[05:36:38.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:48:0) after 2m36s
[05:39:31.308] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:48:0)
[05:39:31.355] Build status: STARTED
[05:39:31.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:49:0) after 2m18s
[05:41:49.499] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:49:0)
[05:41:49.575] Build status: STARTED
[05:41:49.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:50:0) after 1m20s
[05:43:09.603] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:50:0)
[05:43:09.624] Build status: STARTED
[05:43:09.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:51:0) after 2m31s
[05:45:40.649] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:51:0)
[05:45:40.670] Build status: STARTED
[05:45:40.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:52:0) after 9m9s
[05:54:49.686] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:52:0)
[05:54:49.754] Build status: STARTED
[05:54:49.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:53:0) after 5m29s
[06:00:18.775] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:53:0)
[06:00:18.789] Build status: STARTED
[06:00:18.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:54:0) after 6m15s
[06:06:33.810] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:54:0)
[06:06:33.826] Build status: STARTED
[06:06:33.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:55:0) after 7m37s
[06:14:10.939] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:55:0)
[06:14:10.955] Build status: STARTED
[06:14:10.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:56:0) after 6m0s
[06:20:11.095] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:56:0)
[06:20:11.110] Build status: STARTED
[06:20:11.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:57:0) after 1m5s
[06:21:16.222] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:57:0)
[06:21:16.278] Build status: STARTED
[06:21:16.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:58:0) after 7m28s
[06:28:44.343] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:58:0)
[06:28:44.360] Build status: STARTED
[06:28:44.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:59:0) after 2m9s
[06:30:53.446] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:59:0)
[06:30:53.463] Build status: STARTED
[06:30:53.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:60:0) after 1m48s
[06:32:41.602] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:60:0)
[06:32:41.790] Build status: STARTED
[06:32:41.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:61:0) after 5m23s
[06:38:04.973] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:61:0)
[06:38:05.003] Build status: STARTED
[06:38:05.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:62:0) after 4m4s
[06:42:09.132] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:62:0)
[06:42:09.150] Build status: STARTED
[06:42:09.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881183380831568160:63:0) after 5m6s
[06:47:04.737] Received PubSub notification, asking Buildbucket for the build status
[06:47:04.758] Build:
{
"id": "8715753318651487553",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 35998,
"createdBy": "project:chromium",
"createTime": "2025-05-05T01:02:14.077520714Z",
"startTime": "2025-05-05T01:02:17.659007893Z",
"endTime": "2025-05-05T06:47:04.369920993Z",
"updateTime": "2025-05-05T06:47:04.369920993Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9ec5e3a99c5ab5e66cf6f6412b57fda0aafa1f93",
"ref": "refs/heads/main"
}
}
}
[06:47:04.758] Invocation finished in 5h44m52.144129011s with status FAILED