[06:23:48.515] New invocation is queued and will start shortly
[06:23:49.635] Starting the invocation (attempt 1)
[06:23:49.658] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/69d978c551fb33cb98010ac584d459071788df30"
[06:23:49.658] Popped gitiles commit info from properties and tags
[06:23:49.658] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[06:23:49.658] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[06:23:49.658] Buildbucket request:
{
"requestId": "8856520772760727808",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "69d978c551fb33cb98010ac584d459071788df30",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8856520772760727808"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[06:23:50.583] Scheduled build:
{
"id": "8691090710853569281",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 38624,
"createdBy": "project:chromium",
"createTime": "2026-02-01T06:23:49.710652836Z",
"updateTime": "2026-02-01T06:23:49.710652836Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "69d978c551fb33cb98010ac584d459071788df30",
"ref": "refs/heads/main"
}
}
}
[06:23:50.583] Task URL: https://cr-buildbucket.appspot.com/build/8691090710853569281
[06:23:50.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:2:0) after 8m18s
[06:23:51.482] Received PubSub notification, asking Buildbucket for the build status
[06:23:51.496] Build status: SCHEDULED
[06:23:53.494] Received PubSub notification, asking Buildbucket for the build status
[06:23:53.507] Build status: STARTED
[06:32:08.597] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:2:0)
[06:32:08.609] Build status: STARTED
[06:32:08.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:5:0) after 5m18s
[06:37:26.641] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:5:0)
[06:37:26.659] Build status: STARTED
[06:37:26.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:6:0) after 9m37s
[06:47:03.674] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:6:0)
[06:47:03.703] Build status: STARTED
[06:47:03.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:7:0) after 6m1s
[06:53:04.719] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:7:0)
[06:53:04.776] Build status: STARTED
[06:53:04.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:8:0) after 4m36s
[06:57:40.802] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:8:0)
[06:57:40.820] Build status: STARTED
[06:57:40.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:9:0) after 4m18s
[07:01:58.832] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:9:0)
[07:01:58.850] Build status: STARTED
[07:01:58.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:10:0) after 9m45s
[07:11:43.883] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:10:0)
[07:11:43.930] Build status: STARTED
[07:11:43.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:11:0) after 1m6s
[07:12:50.012] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:11:0)
[07:12:50.041] Build status: STARTED
[07:12:50.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:12:0) after 1m51s
[07:14:41.375] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:12:0)
[07:14:41.391] Build status: STARTED
[07:14:41.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:13:0) after 1m45s
[07:16:26.404] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:13:0)
[07:16:26.419] Build status: STARTED
[07:16:26.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:14:0) after 5m13s
[07:21:39.789] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:14:0)
[07:21:39.814] Build status: STARTED
[07:21:39.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:15:0) after 4m54s
[07:26:34.136] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:15:0)
[07:26:34.152] Build status: STARTED
[07:26:34.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:16:0) after 4m53s
[07:31:27.166] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:16:0)
[07:31:27.199] Build status: STARTED
[07:31:27.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:17:0) after 2m9s
[07:33:36.353] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:17:0)
[07:33:36.404] Build status: STARTED
[07:33:36.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:18:0) after 9m47s
[07:43:23.731] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:18:0)
[07:43:23.755] Build status: STARTED
[07:43:23.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:19:0) after 1m54s
[07:45:17.864] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:19:0)
[07:45:17.891] Build status: STARTED
[07:45:17.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:20:0) after 8m27s
[07:53:44.926] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:20:0)
[07:53:44.942] Build status: STARTED
[07:53:44.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:21:0) after 7m50s
[08:01:34.993] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:21:0)
[08:01:35.055] Build status: STARTED
[08:01:35.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:22:0) after 3m14s
[08:05:18.553] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:22:0)
[08:05:18.616] Build status: STARTED
[08:05:18.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:23:0) after 6m20s
[08:11:38.634] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:23:0)
[08:11:38.652] Build status: STARTED
[08:11:38.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:24:0) after 3m25s
[08:15:03.832] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:24:0)
[08:15:03.854] Build status: STARTED
[08:15:03.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:25:0) after 7m33s
[08:22:36.861] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:25:0)
[08:22:36.878] Build status: STARTED
[08:22:36.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:26:0) after 4m56s
[08:27:32.892] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:26:0)
[08:27:32.950] Build status: STARTED
[08:27:32.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:27:0) after 5m49s
[08:33:21.989] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:27:0)
[08:33:22.017] Build status: STARTED
[08:33:22.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:28:0) after 4m45s
[08:38:07.033] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:28:0)
[08:38:07.057] Build status: STARTED
[08:38:07.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:29:0) after 8m11s
[08:46:18.693] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:29:0)
[08:46:18.710] Build status: STARTED
[08:46:18.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:30:0) after 5m14s
[08:51:32.901] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:30:0)
[08:51:32.930] Build status: STARTED
[08:51:32.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:31:0) after 5m8s
[08:56:40.943] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:31:0)
[08:56:40.961] Build status: STARTED
[08:56:40.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:32:0) after 6m49s
[09:03:29.979] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:32:0)
[09:03:30.003] Build status: STARTED
[09:03:30.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:33:0) after 2m50s
[09:06:19.990] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:33:0)
[09:06:20.007] Build status: STARTED
[09:06:20.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:34:0) after 9m42s
[09:16:02.053] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:34:0)
[09:16:02.068] Build status: STARTED
[09:16:02.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:35:0) after 5m37s
[09:21:39.082] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:35:0)
[09:21:39.099] Build status: STARTED
[09:21:39.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:36:0) after 4m1s
[09:25:40.112] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:36:0)
[09:25:40.143] Build status: STARTED
[09:25:40.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:37:0) after 3m12s
[09:28:52.210] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:37:0)
[09:28:52.226] Build status: STARTED
[09:28:52.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:38:0) after 2m3s
[09:30:55.268] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:38:0)
[09:30:55.295] Build status: STARTED
[09:30:55.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:39:0) after 8m31s
[09:39:26.386] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:39:0)
[09:39:26.402] Build status: STARTED
[09:39:26.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:40:0) after 1m57s
[09:41:23.663] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:40:0)
[09:41:23.680] Build status: STARTED
[09:41:23.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:41:0) after 1m8s
[09:42:31.695] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:41:0)
[09:42:31.713] Build status: STARTED
[09:42:31.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:42:0) after 5m37s
[09:48:08.940] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:42:0)
[09:48:09.444] Build status: STARTED
[09:48:09.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:43:0) after 4m14s
[09:52:23.486] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:43:0)
[09:52:23.504] Build status: STARTED
[09:52:23.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:44:0) after 8m41s
[10:01:04.628] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:44:0)
[10:01:04.664] Build status: STARTED
[10:01:04.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:45:0) after 4m9s
[10:05:13.774] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:45:0)
[10:05:13.802] Build status: STARTED
[10:05:13.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:46:0) after 2m19s
[10:07:33.125] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:46:0)
[10:07:33.162] Build status: STARTED
[10:07:33.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:47:0) after 2m6s
[10:09:39.256] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:47:0)
[10:09:39.275] Build status: STARTED
[10:09:39.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8856520772760727808:48:0) after 3m9s
[10:11:02.195] Received PubSub notification, asking Buildbucket for the build status
[10:11:02.210] Build:
{
"id": "8691090710853569281",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 38624,
"createdBy": "project:chromium",
"createTime": "2026-02-01T06:23:49.710652836Z",
"startTime": "2026-02-01T06:23:53.315391476Z",
"endTime": "2026-02-01T10:11:01.582150923Z",
"updateTime": "2026-02-01T10:11:01.582150923Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "69d978c551fb33cb98010ac584d459071788df30",
"ref": "refs/heads/main"
}
}
}
[10:11:02.210] Invocation finished in 3h47m13.703388453s with status FAILED