[03:56:42.117] New invocation is queued and will start shortly
[03:56:43.175] Starting the invocation (attempt 1)
[03:56:43.206] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/6e89ebdd1a8c396dc7bcbffcc30285950e275c32"
[03:56:43.206] Popped gitiles commit info from properties and tags
[03:56:43.206] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:56:43.206] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:56:43.206] Buildbucket request:
{
"requestId": "8857526594541035808",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6e89ebdd1a8c396dc7bcbffcc30285950e275c32",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8857526594541035808"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:56:43.687] Scheduled build:
{
"id": "8692096532671085329",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 38492,
"createdBy": "project:chromium",
"createTime": "2026-01-21T03:56:43.275391325Z",
"updateTime": "2026-01-21T03:56:43.275391325Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6e89ebdd1a8c396dc7bcbffcc30285950e275c32",
"ref": "refs/heads/main"
}
},
"canary": true
}
[03:56:43.687] Task URL: https://cr-buildbucket.appspot.com/build/8692096532671085329
[03:56:43.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:2:0) after 7m4s
[03:56:44.655] Received PubSub notification, asking Buildbucket for the build status
[03:56:44.668] Build status: SCHEDULED
[03:57:42.491] Received PubSub notification, asking Buildbucket for the build status
[03:57:42.507] Build status: STARTED
[04:03:47.703] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:2:0)
[04:03:47.718] Build status: STARTED
[04:03:47.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:5:0) after 3m3s
[04:06:50.783] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:5:0)
[04:06:50.808] Build status: STARTED
[04:06:50.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:6:0) after 3m28s
[04:10:18.826] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:6:0)
[04:10:18.849] Build status: STARTED
[04:10:18.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:7:0) after 9m3s
[04:19:22.105] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:7:0)
[04:19:22.185] Build status: STARTED
[04:19:22.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:8:0) after 9m10s
[04:28:32.211] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:8:0)
[04:28:32.226] Build status: STARTED
[04:28:32.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:9:0) after 7m39s
[04:36:11.251] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:9:0)
[04:36:11.273] Build status: STARTED
[04:36:11.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:10:0) after 5m22s
[04:41:33.321] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:10:0)
[04:41:33.345] Build status: STARTED
[04:41:33.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:11:0) after 2m32s
[04:44:06.274] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:11:0)
[04:44:06.361] Build status: STARTED
[04:44:06.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:12:0) after 2m18s
[04:46:24.425] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:12:0)
[04:46:24.454] Build status: STARTED
[04:46:24.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:13:0) after 3m58s
[04:50:22.506] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:13:0)
[04:50:22.519] Build status: STARTED
[04:50:22.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:14:0) after 6m13s
[04:56:35.546] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:14:0)
[04:56:35.563] Build status: STARTED
[04:56:35.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:15:0) after 4m34s
[05:01:09.546] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:15:0)
[05:01:09.565] Build status: STARTED
[05:01:09.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:16:0) after 8m5s
[05:09:14.643] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:16:0)
[05:09:14.658] Build status: STARTED
[05:09:14.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:17:0) after 7m54s
[05:17:08.696] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:17:0)
[05:17:08.713] Build status: STARTED
[05:17:08.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:18:0) after 7m38s
[05:24:46.764] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:18:0)
[05:24:46.777] Build status: STARTED
[05:24:46.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:19:0) after 2m15s
[05:27:01.784] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:19:0)
[05:27:01.799] Build status: STARTED
[05:27:01.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:20:0) after 1m34s
[05:28:35.974] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:20:0)
[05:28:35.992] Build status: STARTED
[05:28:35.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:21:0) after 5m37s
[05:34:12.966] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:21:0)
[05:34:12.982] Build status: STARTED
[05:34:12.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:22:0) after 6m41s
[05:40:54.000] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:22:0)
[05:40:54.014] Build status: STARTED
[05:40:54.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:23:0) after 1m52s
[05:42:46.028] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:23:0)
[05:42:46.086] Build status: STARTED
[05:42:46.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:24:0) after 7m16s
[05:50:02.106] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:24:0)
[05:50:02.118] Build status: STARTED
[05:50:02.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:25:0) after 2m49s
[05:52:51.218] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:25:0)
[05:52:51.231] Build status: STARTED
[05:52:51.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:26:0) after 7m33s
[06:00:24.250] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:26:0)
[06:00:24.266] Build status: STARTED
[06:00:24.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:27:0) after 5m19s
[06:05:43.284] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:27:0)
[06:05:43.300] Build status: STARTED
[06:05:43.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:28:0) after 9m43s
[06:15:26.395] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:28:0)
[06:15:26.411] Build status: STARTED
[06:15:26.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:29:0) after 1m8s
[06:16:34.403] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:29:0)
[06:16:34.416] Build status: STARTED
[06:16:34.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:30:0) after 5m22s
[06:21:56.438] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:30:0)
[06:21:56.458] Build status: STARTED
[06:21:56.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:31:0) after 4m33s
[06:26:29.487] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:31:0)
[06:26:29.502] Build status: STARTED
[06:26:29.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:32:0) after 4m34s
[06:31:03.668] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:32:0)
[06:31:03.686] Build status: STARTED
[06:31:03.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:33:0) after 3m30s
[06:34:33.700] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:33:0)
[06:34:33.714] Build status: STARTED
[06:34:33.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:34:0) after 2m1s
[06:36:34.780] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:34:0)
[06:36:34.794] Build status: STARTED
[06:36:34.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:35:0) after 7m25s
[06:43:59.915] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:35:0)
[06:43:59.936] Build status: STARTED
[06:43:59.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:36:0) after 5m50s
[06:49:49.987] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:36:0)
[06:49:50.004] Build status: STARTED
[06:49:50.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:37:0) after 3m52s
[06:53:42.045] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:37:0)
[06:53:42.057] Build status: STARTED
[06:53:42.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:38:0) after 2m56s
[06:56:38.090] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:38:0)
[06:56:38.105] Build status: STARTED
[06:56:38.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:39:0) after 5m16s
[07:01:54.184] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:39:0)
[07:01:54.203] Build status: STARTED
[07:01:54.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:40:0) after 1m32s
[07:03:26.269] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:40:0)
[07:03:26.319] Build status: STARTED
[07:03:26.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:41:0) after 5m23s
[07:08:49.393] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:41:0)
[07:08:49.409] Build status: STARTED
[07:08:49.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:42:0) after 5m28s
[07:14:17.434] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:42:0)
[07:14:17.459] Build status: STARTED
[07:14:17.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:43:0) after 4m43s
[07:19:00.609] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:43:0)
[07:19:00.626] Build status: STARTED
[07:19:00.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:44:0) after 6m7s
[07:25:07.743] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:44:0)
[07:25:07.756] Build status: STARTED
[07:25:07.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:45:0) after 3m18s
[07:28:25.772] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:45:0)
[07:28:25.792] Build status: STARTED
[07:28:25.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:46:0) after 7m12s
[07:35:37.814] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:46:0)
[07:35:37.842] Build status: STARTED
[07:35:37.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8857526594541035808:47:0) after 6m13s
[07:40:58.993] Received PubSub notification, asking Buildbucket for the build status
[07:40:59.019] Build:
{
"id": "8692096532671085329",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 38492,
"createdBy": "project:chromium",
"createTime": "2026-01-21T03:56:43.275391325Z",
"startTime": "2026-01-21T03:57:42.326533733Z",
"endTime": "2026-01-21T07:40:58.785698020Z",
"updateTime": "2026-01-21T07:40:58.785698020Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6e89ebdd1a8c396dc7bcbffcc30285950e275c32",
"ref": "refs/heads/main"
}
},
"canary": true
}
[07:40:59.019] Invocation finished in 3h44m16.91126283s with status FAILED