[05:05:43.582] New invocation is queued and will start shortly
[05:05:44.662] Starting the invocation (attempt 1)
[05:05:44.690] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/8b4e75b569be2868bee4cbb4f198430afc4f3d07"
[05:05:44.690] Popped gitiles commit info from properties and tags
[05:05:44.690] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:05:44.690] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:05:44.690] Buildbucket request:
{
"requestId": "8848190764360288352",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxCoverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8b4e75b569be2868bee4cbb4f198430afc4f3d07",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8848190764360288352"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxCoverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[05:05:45.260] Scheduled build:
{
"id": "8682760702482090913",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxCoverage"
},
"number": 107110,
"createdBy": "project:chromium",
"createTime": "2026-05-04T05:05:44.749401406Z",
"updateTime": "2026-05-04T05:05:44.749401406Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8b4e75b569be2868bee4cbb4f198430afc4f3d07",
"ref": "refs/heads/main"
}
}
}
[05:05:45.260] Task URL: https://cr-buildbucket.appspot.com/build/8682760702482090913
[05:05:45.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:2:0) after 9m42s
[05:05:46.289] Received PubSub notification, asking Buildbucket for the build status
[05:05:46.339] Build status: SCHEDULED
[05:06:37.420] Received PubSub notification, asking Buildbucket for the build status
[05:06:37.440] Build status: STARTED
[05:15:27.263] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:2:0)
[05:15:27.287] Build status: STARTED
[05:15:27.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:5:0) after 9m27s
[05:24:54.303] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:5:0)
[05:24:54.318] Build status: STARTED
[05:24:54.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:6:0) after 9m41s
[05:34:35.354] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:6:0)
[05:34:35.379] Build status: STARTED
[05:34:35.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:7:0) after 4m34s
[05:39:09.395] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:7:0)
[05:39:09.414] Build status: STARTED
[05:39:09.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:8:0) after 6m43s
[05:45:52.770] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:8:0)
[05:45:52.797] Build status: STARTED
[05:45:52.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:9:0) after 6m12s
[05:52:05.159] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:9:0)
[05:52:05.178] Build status: STARTED
[05:52:05.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:10:0) after 2m30s
[05:54:35.292] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:10:0)
[05:54:35.371] Build status: STARTED
[05:54:35.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:11:0) after 8m28s
[06:03:03.419] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:11:0)
[06:03:03.436] Build status: STARTED
[06:03:03.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:12:0) after 4m16s
[06:07:19.649] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:12:0)
[06:07:19.664] Build status: STARTED
[06:07:19.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:13:0) after 5m10s
[06:12:29.799] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:13:0)
[06:12:29.814] Build status: STARTED
[06:12:29.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:14:0) after 3m10s
[06:15:39.880] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:14:0)
[06:15:39.901] Build status: STARTED
[06:15:39.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:15:0) after 5m45s
[06:21:24.935] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:15:0)
[06:21:24.955] Build status: STARTED
[06:21:24.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:16:0) after 2m47s
[06:24:12.056] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:16:0)
[06:24:12.081] Build status: STARTED
[06:24:12.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:17:0) after 8m48s
[06:33:00.099] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:17:0)
[06:33:00.121] Build status: STARTED
[06:33:00.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:18:0) after 5m20s
[06:38:20.139] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:18:0)
[06:38:20.164] Build status: STARTED
[06:38:20.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:19:0) after 2m39s
[06:40:59.184] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:19:0)
[06:40:59.202] Build status: STARTED
[06:40:59.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:20:0) after 9m15s
[06:50:14.264] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:20:0)
[06:50:14.382] Build status: STARTED
[06:50:14.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:21:0) after 7m29s
[06:57:43.450] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:21:0)
[06:57:43.469] Build status: STARTED
[06:57:43.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:22:0) after 3m24s
[07:01:07.609] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:22:0)
[07:01:07.630] Build status: STARTED
[07:01:07.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:23:0) after 8m42s
[07:09:49.647] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:23:0)
[07:09:49.665] Build status: STARTED
[07:09:49.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:24:0) after 9m24s
[07:19:13.894] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:24:0)
[07:19:14.013] Build status: STARTED
[07:19:14.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:25:0) after 2m27s
[07:21:41.025] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:25:0)
[07:21:41.059] Build status: STARTED
[07:21:41.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:26:0) after 4m56s
[07:26:37.102] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:26:0)
[07:26:37.125] Build status: STARTED
[07:26:37.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:27:0) after 4m48s
[07:31:25.205] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:27:0)
[07:31:25.220] Build status: STARTED
[07:31:25.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:28:0) after 2m9s
[07:33:34.232] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:28:0)
[07:33:34.256] Build status: STARTED
[07:33:34.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:29:0) after 8m20s
[07:41:54.370] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:29:0)
[07:41:54.398] Build status: STARTED
[07:41:54.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:30:0) after 1m48s
[07:43:42.416] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:30:0)
[07:43:42.578] Build status: STARTED
[07:43:42.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:31:0) after 1m41s
[07:45:23.595] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:31:0)
[07:45:23.612] Build status: STARTED
[07:45:23.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:32:0) after 6m11s
[07:51:34.627] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:32:0)
[07:51:34.644] Build status: STARTED
[07:51:34.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:33:0) after 9m55s
[08:01:29.708] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:33:0)
[08:01:29.871] Build status: STARTED
[08:01:29.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:34:0) after 1m39s
[08:03:08.897] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:34:0)
[08:03:08.937] Build status: STARTED
[08:03:08.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:35:0) after 8m53s
[08:12:02.006] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:35:0)
[08:12:02.024] Build status: STARTED
[08:12:02.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:36:0) after 4m48s
[08:16:50.064] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:36:0)
[08:16:50.079] Build status: STARTED
[08:16:50.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:37:0) after 2m43s
[08:19:33.094] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:37:0)
[08:19:33.138] Build status: STARTED
[08:19:33.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:38:0) after 3m28s
[08:23:01.212] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:38:0)
[08:23:01.274] Build status: STARTED
[08:23:01.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:39:0) after 9m15s
[08:32:16.289] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:39:0)
[08:32:16.311] Build status: STARTED
[08:32:16.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:40:0) after 6m57s
[08:39:13.331] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:40:0)
[08:39:13.355] Build status: STARTED
[08:39:13.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:41:0) after 7m10s
[08:46:23.370] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:41:0)
[08:46:23.416] Build status: STARTED
[08:46:23.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:42:0) after 3m36s
[08:49:59.559] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:42:0)
[08:49:59.578] Build status: STARTED
[08:49:59.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:43:0) after 5m12s
[08:55:11.595] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:43:0)
[08:55:11.608] Build status: STARTED
[08:55:11.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:44:0) after 5m10s
[09:00:21.685] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:44:0)
[09:00:21.700] Build status: STARTED
[09:00:21.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:45:0) after 7m32s
[09:07:53.762] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:45:0)
[09:07:53.779] Build status: STARTED
[09:07:53.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:46:0) after 5m45s
[09:13:38.861] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:46:0)
[09:13:38.880] Build status: STARTED
[09:13:38.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:47:0) after 5m21s
[09:18:59.918] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:47:0)
[09:18:59.933] Build status: STARTED
[09:18:59.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:48:0) after 3m30s
[09:22:29.951] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:48:0)
[09:22:29.973] Build status: STARTED
[09:22:29.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:49:0) after 4m53s
[09:27:23.075] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:49:0)
[09:27:23.092] Build status: STARTED
[09:27:23.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:50:0) after 9m41s
[09:37:04.060] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:50:0)
[09:37:04.089] Build status: STARTED
[09:37:04.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:51:0) after 8m26s
[09:45:30.107] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:51:0)
[09:45:30.127] Build status: STARTED
[09:45:30.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:52:0) after 4m9s
[09:49:39.145] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:52:0)
[09:49:39.280] Build status: STARTED
[09:49:39.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:53:0) after 3m3s
[09:52:42.347] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:53:0)
[09:52:42.365] Build status: STARTED
[09:52:42.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:54:0) after 8m30s
[10:01:12.613] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:54:0)
[10:01:12.674] Build status: STARTED
[10:01:12.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:55:0) after 3m16s
[10:04:28.817] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:55:0)
[10:04:28.842] Build status: STARTED
[10:04:28.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:56:0) after 9m49s
[10:14:17.935] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:56:0)
[10:14:17.949] Build status: STARTED
[10:14:17.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:57:0) after 1m39s
[10:15:57.085] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:57:0)
[10:15:57.103] Build status: STARTED
[10:15:57.103] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:58:0) after 1m1s
[10:16:58.117] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:58:0)
[10:16:58.162] Build status: STARTED
[10:16:58.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:59:0) after 3m11s
[10:20:09.227] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:59:0)
[10:20:09.262] Build status: STARTED
[10:20:09.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:60:0) after 5m21s
[10:25:30.240] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:60:0)
[10:25:30.258] Build status: STARTED
[10:25:30.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:61:0) after 5m35s
[10:31:05.442] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:61:0)
[10:31:05.457] Build status: STARTED
[10:31:05.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:62:0) after 2m29s
[10:33:34.479] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:62:0)
[10:33:34.498] Build status: STARTED
[10:33:34.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:63:0) after 4m38s
[10:38:12.554] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:63:0)
[10:38:12.571] Build status: STARTED
[10:38:12.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:64:0) after 7m29s
[10:45:41.712] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:64:0)
[10:45:41.751] Build status: STARTED
[10:45:41.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848190764360288352:65:0) after 9m38s
[10:47:10.544] Received PubSub notification, asking Buildbucket for the build status
[10:47:10.567] Build:
{
"id": "8682760702482090913",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxCoverage"
},
"number": 107110,
"createdBy": "project:chromium",
"createTime": "2026-05-04T05:05:44.749401406Z",
"startTime": "2026-05-04T05:06:37.240961180Z",
"endTime": "2026-05-04T10:47:10.285394634Z",
"updateTime": "2026-05-04T10:47:10.285394634Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8b4e75b569be2868bee4cbb4f198430afc4f3d07",
"ref": "refs/heads/main"
}
}
}
[10:47:10.567] Invocation finished in 5h41m26.993330226s with status FAILED