[01:42:28.415] New invocation is queued and will start shortly
[01:42:29.849] Starting the invocation (attempt 1)
[01:42:29.874] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/82107a8416e6c812fa767d15df581e5ed671ca42"
[01:42:29.875] Popped gitiles commit info from properties and tags
[01:42:29.875] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:42:29.875] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:42:29.875] Buildbucket request:
{
"requestId": "8884714129374945424",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "82107a8416e6c812fa767d15df581e5ed671ca42",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8884714129374945424"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:42:30.373] Scheduled build:
{
"id": "8719284067116565185",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 35290,
"createdBy": "project:chromium",
"createTime": "2025-03-27T01:42:29.948625795Z",
"updateTime": "2025-03-27T01:42:29.948625795Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "82107a8416e6c812fa767d15df581e5ed671ca42",
"ref": "refs/heads/main"
}
}
}
[01:42:30.373] Task URL: https://cr-buildbucket.appspot.com/build/8719284067116565185
[01:42:30.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:2:0) after 4m56s
[01:43:06.564] Received PubSub notification, asking Buildbucket for the build status
[01:43:06.585] Build status: STARTED
[01:43:09.525] Received PubSub notification, asking Buildbucket for the build status
[01:43:09.575] Build status: STARTED
[01:47:26.423] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:2:0)
[01:47:26.539] Build status: STARTED
[01:47:26.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:5:0) after 7m14s
[01:54:40.563] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:5:0)
[01:54:40.751] Build status: STARTED
[01:54:40.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:6:0) after 8m14s
[02:02:54.798] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:6:0)
[02:02:54.882] Build status: STARTED
[02:02:54.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:7:0) after 9m58s
[02:12:52.912] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:7:0)
[02:12:52.935] Build status: STARTED
[02:12:52.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:8:0) after 2m30s
[02:15:22.957] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:8:0)
[02:15:22.974] Build status: STARTED
[02:15:22.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:9:0) after 9m52s
[02:25:14.980] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:9:0)
[02:25:15.052] Build status: STARTED
[02:25:15.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:10:0) after 7m35s
[02:32:50.093] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:10:0)
[02:32:50.116] Build status: STARTED
[02:32:50.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:11:0) after 3m13s
[02:36:03.147] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:11:0)
[02:36:03.187] Build status: STARTED
[02:36:03.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:12:0) after 3m44s
[02:39:47.259] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:12:0)
[02:39:47.283] Build status: STARTED
[02:39:47.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:13:0) after 9m34s
[02:49:21.265] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:13:0)
[02:49:21.279] Build status: STARTED
[02:49:21.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:14:0) after 6m25s
[02:55:46.304] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:14:0)
[02:55:46.323] Build status: STARTED
[02:55:46.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:15:0) after 1m9s
[02:56:55.366] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:15:0)
[02:56:55.435] Build status: STARTED
[02:56:55.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:16:0) after 9m18s
[03:06:13.516] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:16:0)
[03:06:13.631] Build status: STARTED
[03:06:13.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:17:0) after 5m22s
[03:11:35.688] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:17:0)
[03:11:35.708] Build status: STARTED
[03:11:35.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:18:0) after 5m59s
[03:17:34.735] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:18:0)
[03:17:34.753] Build status: STARTED
[03:17:34.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:19:0) after 7m38s
[03:25:12.896] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:19:0)
[03:25:12.914] Build status: STARTED
[03:25:12.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:20:0) after 1m34s
[03:26:46.960] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:20:0)
[03:26:46.976] Build status: STARTED
[03:26:46.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:21:0) after 2m44s
[03:29:30.996] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:21:0)
[03:29:31.046] Build status: STARTED
[03:29:31.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:22:0) after 5m55s
[03:35:26.034] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:22:0)
[03:35:26.086] Build status: STARTED
[03:35:26.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:23:0) after 1m52s
[03:37:18.162] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:23:0)
[03:37:18.178] Build status: STARTED
[03:37:18.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:24:0) after 7m1s
[03:44:19.201] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:24:0)
[03:44:19.224] Build status: STARTED
[03:44:19.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:25:0) after 5m16s
[03:49:35.241] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:25:0)
[03:49:35.377] Build status: STARTED
[03:49:35.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:26:0) after 4m11s
[03:53:46.472] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:26:0)
[03:53:46.491] Build status: STARTED
[03:53:46.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:27:0) after 4m41s
[03:58:27.516] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:27:0)
[03:58:27.533] Build status: STARTED
[03:58:27.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:28:0) after 2m54s
[04:01:21.562] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:28:0)
[04:01:21.582] Build status: STARTED
[04:01:21.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:29:0) after 2m4s
[04:03:25.597] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:29:0)
[04:03:25.615] Build status: STARTED
[04:03:25.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:30:0) after 9m52s
[04:13:17.646] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:30:0)
[04:13:17.665] Build status: STARTED
[04:13:17.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:31:0) after 4m23s
[04:17:40.694] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:31:0)
[04:17:40.926] Build status: STARTED
[04:17:40.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:32:0) after 5m15s
[04:22:56.019] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:32:0)
[04:22:56.037] Build status: STARTED
[04:22:56.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:33:0) after 1m47s
[04:24:43.060] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:33:0)
[04:24:43.074] Build status: STARTED
[04:24:43.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:34:0) after 4m26s
[04:29:09.098] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:34:0)
[04:29:09.114] Build status: STARTED
[04:29:09.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:35:0) after 7m21s
[04:36:30.142] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:35:0)
[04:36:30.157] Build status: STARTED
[04:36:30.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:36:0) after 6m32s
[04:43:02.186] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:36:0)
[04:43:02.204] Build status: STARTED
[04:43:02.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:37:0) after 6m6s
[04:49:08.230] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:37:0)
[04:49:08.246] Build status: STARTED
[04:49:08.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:38:0) after 1m52s
[04:51:00.276] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:38:0)
[04:51:00.291] Build status: STARTED
[04:51:00.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:39:0) after 4m56s
[04:55:56.323] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:39:0)
[04:55:56.347] Build status: STARTED
[04:55:56.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:40:0) after 4m37s
[05:00:34.052] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:40:0)
[05:00:34.075] Build status: STARTED
[05:00:34.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:41:0) after 9m46s
[05:10:20.153] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:41:0)
[05:10:20.181] Build status: STARTED
[05:10:20.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:42:0) after 5m28s
[05:15:48.215] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:42:0)
[05:15:48.231] Build status: STARTED
[05:15:48.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:43:0) after 1m17s
[05:17:05.282] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:43:0)
[05:17:05.527] Build status: STARTED
[05:17:05.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:44:0) after 1m16s
[05:18:21.819] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:44:0)
[05:18:21.836] Build status: STARTED
[05:18:21.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:45:0) after 7m0s
[05:25:21.850] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:45:0)
[05:25:21.866] Build status: STARTED
[05:25:21.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:46:0) after 6m35s
[05:31:57.010] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:46:0)
[05:31:57.028] Build status: STARTED
[05:31:57.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:47:0) after 3m50s
[05:35:47.591] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:47:0)
[05:35:47.641] Build status: STARTED
[05:35:47.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:48:0) after 5m33s
[05:41:20.667] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:48:0)
[05:41:20.690] Build status: STARTED
[05:41:20.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:49:0) after 8m28s
[05:49:48.865] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:49:0)
[05:49:48.886] Build status: STARTED
[05:49:48.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:50:0) after 6m27s
[05:56:16.094] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:50:0)
[05:56:16.108] Build status: STARTED
[05:56:16.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:51:0) after 8m51s
[06:05:07.251] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:51:0)
[06:05:07.273] Build status: STARTED
[06:05:07.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:52:0) after 7m23s
[06:12:30.405] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:52:0)
[06:12:30.421] Build status: STARTED
[06:12:30.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:53:0) after 9m43s
[06:22:13.469] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:53:0)
[06:22:13.494] Build status: STARTED
[06:22:13.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:54:0) after 4m40s
[06:26:53.654] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:54:0)
[06:26:53.669] Build status: STARTED
[06:26:53.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:55:0) after 6m10s
[06:33:03.831] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:55:0)
[06:33:03.852] Build status: STARTED
[06:33:03.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:56:0) after 4m27s
[06:37:31.267] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:56:0)
[06:37:31.292] Build status: STARTED
[06:37:31.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:57:0) after 2m17s
[06:39:48.409] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:57:0)
[06:39:48.425] Build status: STARTED
[06:39:48.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:58:0) after 1m30s
[06:41:18.450] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:58:0)
[06:41:18.469] Build status: STARTED
[06:41:18.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:59:0) after 9m56s
[06:51:15.341] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:59:0)
[06:51:15.360] Build status: STARTED
[06:51:15.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:60:0) after 3m1s
[06:54:16.488] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:60:0)
[06:54:16.506] Build status: STARTED
[06:54:16.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:61:0) after 6m47s
[07:01:03.618] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:61:0)
[07:01:03.648] Build status: STARTED
[07:01:03.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:62:0) after 1m26s
[07:02:29.717] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:62:0)
[07:02:29.734] Build status: STARTED
[07:02:29.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:63:0) after 1m49s
[07:04:18.791] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:63:0)
[07:04:18.812] Build status: STARTED
[07:04:18.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:64:0) after 4m34s
[07:08:52.833] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:64:0)
[07:08:52.936] Build status: STARTED
[07:08:52.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:65:0) after 1m56s
[07:10:48.959] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:65:0)
[07:10:48.998] Build status: STARTED
[07:10:48.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:66:0) after 3m20s
[07:14:09.053] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:66:0)
[07:14:09.071] Build status: STARTED
[07:14:09.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:67:0) after 6m38s
[07:20:47.081] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:67:0)
[07:20:47.098] Build status: STARTED
[07:20:47.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:68:0) after 4m32s
[07:25:19.172] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:68:0)
[07:25:19.188] Build status: STARTED
[07:25:19.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884714129374945424:69:0) after 3m52s
[07:27:43.103] Received PubSub notification, asking Buildbucket for the build status
[07:27:43.123] Build:
{
"id": "8719284067116565185",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 35290,
"createdBy": "project:chromium",
"createTime": "2025-03-27T01:42:29.948625795Z",
"startTime": "2025-03-27T01:42:33.699951487Z",
"endTime": "2025-03-27T07:27:42.672754232Z",
"updateTime": "2025-03-27T07:27:42.672754232Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "82107a8416e6c812fa767d15df581e5ed671ca42",
"ref": "refs/heads/main"
}
}
}
[07:27:43.123] Invocation finished in 5h45m14.712605817s with status FAILED