[05:17:24.369] New invocation is queued and will start shortly
[05:17:25.471] Starting the invocation (attempt 1)
[05:17:25.511] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f161dc14b8d83c41e23199300ec89c140fa4af98"
[05:17:25.511] Popped gitiles commit info from properties and tags
[05:17:25.511] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:17:25.511] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:17:25.512] Buildbucket request:
{
"requestId": "8867396586415204672",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f161dc14b8d83c41e23199300ec89c140fa4af98",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8867396586415204672"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[05:17:25.950] Scheduled build:
{
"id": "8701966524505746769",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 37170,
"createdBy": "project:chromium",
"createTime": "2025-10-04T05:17:25.559282254Z",
"updateTime": "2025-10-04T05:17:25.559282254Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f161dc14b8d83c41e23199300ec89c140fa4af98",
"ref": "refs/heads/main"
}
}
}
[05:17:25.950] Task URL: https://cr-buildbucket.appspot.com/build/8701966524505746769
[05:17:25.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:2:0) after 9m18s
[05:17:26.438] Received PubSub notification, asking Buildbucket for the build status
[05:17:26.487] Build status: SCHEDULED
[05:18:22.112] Received PubSub notification, asking Buildbucket for the build status
[05:18:22.165] Build status: STARTED
[05:26:44.047] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:2:0)
[05:26:44.062] Build status: STARTED
[05:26:44.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:5:0) after 1m56s
[05:28:40.077] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:5:0)
[05:28:40.160] Build status: STARTED
[05:28:40.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:6:0) after 9m57s
[05:38:37.662] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:6:0)
[05:38:37.676] Build status: STARTED
[05:38:37.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:7:0) after 3m6s
[05:41:43.687] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:7:0)
[05:41:43.710] Build status: STARTED
[05:41:43.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:8:0) after 4m54s
[05:46:37.734] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:8:0)
[05:46:37.754] Build status: STARTED
[05:46:37.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:9:0) after 5m53s
[05:52:30.957] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:9:0)
[05:52:30.975] Build status: STARTED
[05:52:30.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:10:0) after 7m4s
[05:59:35.140] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:10:0)
[05:59:35.157] Build status: STARTED
[05:59:35.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:11:0) after 8m37s
[06:08:12.315] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:11:0)
[06:08:12.340] Build status: STARTED
[06:08:12.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:12:0) after 7m16s
[06:15:28.555] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:12:0)
[06:15:28.636] Build status: STARTED
[06:15:28.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:13:0) after 8m44s
[06:24:12.732] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:13:0)
[06:24:12.745] Build status: STARTED
[06:24:12.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:14:0) after 4m58s
[06:29:10.814] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:14:0)
[06:29:10.832] Build status: STARTED
[06:29:10.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:15:0) after 1m3s
[06:30:13.854] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:15:0)
[06:30:13.869] Build status: STARTED
[06:30:13.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:16:0) after 9m12s
[06:39:25.915] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:16:0)
[06:39:25.929] Build status: STARTED
[06:39:25.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:17:0) after 1m41s
[06:41:07.043] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:17:0)
[06:41:07.055] Build status: STARTED
[06:41:07.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:18:0) after 1m58s
[06:43:05.159] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:18:0)
[06:43:05.178] Build status: STARTED
[06:43:05.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:19:0) after 6m14s
[06:49:19.316] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:19:0)
[06:49:19.335] Build status: STARTED
[06:49:19.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:20:0) after 7m9s
[06:56:28.299] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:20:0)
[06:56:28.321] Build status: STARTED
[06:56:28.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:21:0) after 8m0s
[07:04:28.402] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:21:0)
[07:04:28.419] Build status: STARTED
[07:04:28.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:22:0) after 8m9s
[07:12:37.494] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:22:0)
[07:12:37.517] Build status: STARTED
[07:12:37.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:23:0) after 3m59s
[07:16:36.532] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:23:0)
[07:16:36.712] Build status: STARTED
[07:16:36.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:24:0) after 4m22s
[07:20:58.713] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:24:0)
[07:20:58.728] Build status: STARTED
[07:20:58.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:25:0) after 3m8s
[07:24:06.754] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:25:0)
[07:24:06.870] Build status: STARTED
[07:24:06.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:26:0) after 7m57s
[07:32:03.887] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:26:0)
[07:32:03.906] Build status: STARTED
[07:32:03.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:27:0) after 9m43s
[07:41:46.953] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:27:0)
[07:41:46.970] Build status: STARTED
[07:41:46.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:28:0) after 3m15s
[07:45:02.317] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:28:0)
[07:45:02.337] Build status: STARTED
[07:45:02.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:29:0) after 8m46s
[07:53:48.556] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:29:0)
[07:53:48.573] Build status: STARTED
[07:53:48.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:30:0) after 2m8s
[07:55:56.590] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:30:0)
[07:55:56.609] Build status: STARTED
[07:55:56.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:31:0) after 3m15s
[07:59:11.718] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:31:0)
[07:59:11.734] Build status: STARTED
[07:59:11.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:32:0) after 4m2s
[08:03:13.747] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:32:0)
[08:03:13.861] Build status: STARTED
[08:03:13.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:33:0) after 5m42s
[08:08:56.238] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:33:0)
[08:08:56.256] Build status: STARTED
[08:08:56.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:34:0) after 1m8s
[08:10:04.225] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:34:0)
[08:10:04.304] Build status: STARTED
[08:10:04.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:35:0) after 8m18s
[08:18:22.325] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:35:0)
[08:18:22.351] Build status: STARTED
[08:18:22.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:36:0) after 4m53s
[08:23:15.367] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:36:0)
[08:23:15.386] Build status: STARTED
[08:23:15.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:37:0) after 5m17s
[08:28:32.513] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:37:0)
[08:28:32.528] Build status: STARTED
[08:28:32.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:38:0) after 5m14s
[08:33:46.604] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:38:0)
[08:33:46.658] Build status: STARTED
[08:33:46.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:39:0) after 9m37s
[08:43:23.665] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:39:0)
[08:43:23.679] Build status: STARTED
[08:43:23.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:40:0) after 2m52s
[08:46:15.730] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:40:0)
[08:46:15.745] Build status: STARTED
[08:46:15.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:41:0) after 4m29s
[08:50:45.144] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:41:0)
[08:50:45.165] Build status: STARTED
[08:50:45.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:42:0) after 5m25s
[08:56:10.461] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:42:0)
[08:56:10.485] Build status: STARTED
[08:56:10.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:43:0) after 3m58s
[09:00:08.514] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:43:0)
[09:00:08.542] Build status: STARTED
[09:00:08.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:44:0) after 1m54s
[09:02:02.732] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:44:0)
[09:02:02.774] Build status: STARTED
[09:02:02.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:45:0) after 3m47s
[09:05:49.790] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:45:0)
[09:05:49.808] Build status: STARTED
[09:05:49.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:46:0) after 3m37s
[09:09:26.831] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:46:0)
[09:09:26.909] Build status: STARTED
[09:09:26.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:47:0) after 7m39s
[09:17:06.283] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:47:0)
[09:17:06.303] Build status: STARTED
[09:17:06.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:48:0) after 4m19s
[09:21:25.544] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:48:0)
[09:21:25.560] Build status: STARTED
[09:21:25.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8867396586415204672:49:0) after 9m8s
[09:26:04.407] Received PubSub notification, asking Buildbucket for the build status
[09:26:04.426] Build:
{
"id": "8701966524505746769",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 37170,
"createdBy": "project:chromium",
"createTime": "2025-10-04T05:17:25.559282254Z",
"startTime": "2025-10-04T05:18:21.937662564Z",
"endTime": "2025-10-04T09:26:04.155363785Z",
"updateTime": "2025-10-04T09:26:04.155363785Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f161dc14b8d83c41e23199300ec89c140fa4af98",
"ref": "refs/heads/main"
}
}
}
[09:26:04.426] Invocation finished in 4h8m40.071000728s with status FAILED