[01:14:08.401] New invocation is queued and will start shortly
[01:14:09.466] Starting the invocation (attempt 1)
[01:14:09.493] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9d756fed75a82523a0788eb8b3e57173cf9f4cb0"
[01:14:09.493] Popped gitiles commit info from properties and tags
[01:14:09.493] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:14:09.493] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:14:09.494] Buildbucket request:
{
"requestId": "8877830542533538656",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9d756fed75a82523a0788eb8b3e57173cf9f4cb0",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8877830542533538656"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:14:10.091] Scheduled build:
{
"id": "8712400480610949793",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 35624,
"createdBy": "project:chromium",
"createTime": "2025-06-11T01:14:09.603612814Z",
"updateTime": "2025-06-11T01:14:09.603612814Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9d756fed75a82523a0788eb8b3e57173cf9f4cb0",
"ref": "refs/heads/main"
}
},
"canary": true
}
[01:14:10.091] Task URL: https://cr-buildbucket.appspot.com/build/8712400480610949793
[01:14:10.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:2:0) after 8m41s
[01:14:12.839] Received PubSub notification, asking Buildbucket for the build status
[01:14:12.865] Build status: SCHEDULED
[01:14:18.303] Received PubSub notification, asking Buildbucket for the build status
[01:14:18.327] Build status: STARTED
[01:22:51.069] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:2:0)
[01:22:51.094] Build status: STARTED
[01:22:51.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:5:0) after 1m2s
[01:23:53.173] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:5:0)
[01:23:53.228] Build status: STARTED
[01:23:53.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:6:0) after 1m9s
[01:25:02.256] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:6:0)
[01:25:02.282] Build status: STARTED
[01:25:02.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:7:0) after 7m16s
[01:32:18.643] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:7:0)
[01:32:18.725] Build status: STARTED
[01:32:18.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:8:0) after 7m40s
[01:39:58.843] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:8:0)
[01:39:58.867] Build status: STARTED
[01:39:58.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:9:0) after 2m20s
[01:42:18.894] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:9:0)
[01:42:18.934] Build status: STARTED
[01:42:18.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:10:0) after 6m23s
[01:48:42.223] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:10:0)
[01:48:42.245] Build status: STARTED
[01:48:42.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:11:0) after 8m30s
[01:57:12.386] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:11:0)
[01:57:12.422] Build status: STARTED
[01:57:12.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:12:0) after 1m53s
[01:59:05.591] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:12:0)
[01:59:05.620] Build status: STARTED
[01:59:05.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:13:0) after 7m47s
[02:06:52.798] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:13:0)
[02:06:52.826] Build status: STARTED
[02:06:52.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:14:0) after 4m3s
[02:10:55.886] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:14:0)
[02:10:55.947] Build status: STARTED
[02:10:55.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:15:0) after 9m15s
[02:20:11.147] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:15:0)
[02:20:11.175] Build status: STARTED
[02:20:11.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:16:0) after 9m59s
[02:30:10.913] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:16:0)
[02:30:10.935] Build status: STARTED
[02:30:10.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:17:0) after 5m50s
[02:36:01.034] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:17:0)
[02:36:01.056] Build status: STARTED
[02:36:01.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:18:0) after 4m51s
[02:40:52.077] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:18:0)
[02:40:52.131] Build status: STARTED
[02:40:52.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:19:0) after 4m19s
[02:45:11.118] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:19:0)
[02:45:11.144] Build status: STARTED
[02:45:11.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:20:0) after 4m32s
[02:49:43.622] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:20:0)
[02:49:43.643] Build status: STARTED
[02:49:43.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:21:0) after 5m22s
[02:55:05.687] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:21:0)
[02:55:05.718] Build status: STARTED
[02:55:05.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:22:0) after 3m35s
[02:58:40.741] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:22:0)
[02:58:40.757] Build status: STARTED
[02:58:40.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:23:0) after 8m55s
[03:07:36.048] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:23:0)
[03:07:36.069] Build status: STARTED
[03:07:36.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:24:0) after 8m12s
[03:15:48.053] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:24:0)
[03:15:48.084] Build status: STARTED
[03:15:48.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:25:0) after 9m5s
[03:24:53.215] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:25:0)
[03:24:53.230] Build status: STARTED
[03:24:53.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:26:0) after 6m22s
[03:31:15.301] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:26:0)
[03:31:15.318] Build status: STARTED
[03:31:15.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:27:0) after 5m7s
[03:36:22.350] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:27:0)
[03:36:22.369] Build status: STARTED
[03:36:22.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:28:0) after 5m12s
[03:41:34.695] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:28:0)
[03:41:34.716] Build status: STARTED
[03:41:34.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:29:0) after 9m39s
[03:51:13.790] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:29:0)
[03:51:13.808] Build status: STARTED
[03:51:13.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:30:0) after 1m53s
[03:53:06.829] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:30:0)
[03:53:06.917] Build status: STARTED
[03:53:06.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:31:0) after 9m17s
[04:02:23.907] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:31:0)
[04:02:23.946] Build status: STARTED
[04:02:23.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:32:0) after 7m13s
[04:09:37.125] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:32:0)
[04:09:37.141] Build status: STARTED
[04:09:37.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:33:0) after 4m56s
[04:14:33.609] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:33:0)
[04:14:33.656] Build status: STARTED
[04:14:33.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:34:0) after 6m54s
[04:21:27.743] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:34:0)
[04:21:27.791] Build status: STARTED
[04:21:27.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:35:0) after 3m51s
[04:25:18.815] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:35:0)
[04:25:18.846] Build status: STARTED
[04:25:18.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:36:0) after 5m47s
[04:31:06.004] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:36:0)
[04:31:06.021] Build status: STARTED
[04:31:06.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:37:0) after 7m35s
[04:38:41.057] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:37:0)
[04:38:41.075] Build status: STARTED
[04:38:41.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:38:0) after 7m16s
[04:45:57.226] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:38:0)
[04:45:57.242] Build status: STARTED
[04:45:57.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:39:0) after 6m53s
[04:52:50.283] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:39:0)
[04:52:50.298] Build status: STARTED
[04:52:50.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:40:0) after 2m56s
[04:55:46.321] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:40:0)
[04:55:46.337] Build status: STARTED
[04:55:46.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:41:0) after 2m27s
[04:58:13.359] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:41:0)
[04:58:13.629] Build status: STARTED
[04:58:13.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:42:0) after 1m43s
[04:59:56.650] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:42:0)
[04:59:56.675] Build status: STARTED
[04:59:56.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:43:0) after 4m16s
[05:04:13.184] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:43:0)
[05:04:13.207] Build status: STARTED
[05:04:13.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:44:0) after 3m19s
[05:07:32.242] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:44:0)
[05:07:32.262] Build status: STARTED
[05:07:32.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:45:0) after 1m36s
[05:09:08.286] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:45:0)
[05:09:08.306] Build status: STARTED
[05:09:08.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8877830542533538656:46:0) after 8m21s
[05:15:53.705] Received PubSub notification, asking Buildbucket for the build status
[05:15:53.722] Build:
{
"id": "8712400480610949793",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 35624,
"createdBy": "project:chromium",
"createTime": "2025-06-11T01:14:09.603612814Z",
"startTime": "2025-06-11T01:14:17.180092672Z",
"endTime": "2025-06-11T05:15:53.332412824Z",
"updateTime": "2025-06-11T05:15:53.332412824Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9d756fed75a82523a0788eb8b3e57173cf9f4cb0",
"ref": "refs/heads/main"
}
},
"canary": true
}
[05:15:53.722] Invocation finished in 4h1m45.335328245s with status FAILED