[10:47:12.301] New invocation is queued and will start shortly
[10:47:13.429] Starting the invocation (attempt 1)
[10:47:13.455] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/5332613e97b99ec0663b41e0beff662a5e297e6d"
[10:47:13.455] Popped gitiles commit info from properties and tags
[10:47:13.455] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:47:13.455] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:47:13.455] Buildbucket request:
{
"requestId": "8848169280378841088",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxCoverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5332613e97b99ec0663b41e0beff662a5e297e6d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8848169280378841088"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxCoverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:47:13.922] Scheduled build:
{
"id": "8682739218458724593",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxCoverage"
},
"number": 107111,
"createdBy": "project:chromium",
"createTime": "2026-05-04T10:47:13.510708284Z",
"updateTime": "2026-05-04T10:47:13.510708284Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5332613e97b99ec0663b41e0beff662a5e297e6d",
"ref": "refs/heads/main"
}
},
"canary": true
}
[10:47:13.922] Task URL: https://cr-buildbucket.appspot.com/build/8682739218458724593
[10:47:13.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:2:0) after 8m30s
[10:47:14.924] Received PubSub notification, asking Buildbucket for the build status
[10:47:14.943] Build status: SCHEDULED
[10:48:03.657] Received PubSub notification, asking Buildbucket for the build status
[10:48:03.675] Build status: STARTED
[10:55:44.000] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:2:0)
[10:55:44.025] Build status: STARTED
[10:55:44.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:5:0) after 3m24s
[10:59:08.084] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:5:0)
[10:59:08.130] Build status: STARTED
[10:59:08.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:6:0) after 1m56s
[11:01:04.199] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:6:0)
[11:01:04.290] Build status: STARTED
[11:01:04.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:7:0) after 4m37s
[11:05:41.342] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:7:0)
[11:05:41.405] Build status: STARTED
[11:05:41.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:8:0) after 9m43s
[11:15:24.523] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:8:0)
[11:15:24.545] Build status: STARTED
[11:15:24.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:9:0) after 3m8s
[11:18:32.604] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:9:0)
[11:18:32.681] Build status: STARTED
[11:18:32.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:10:0) after 4m56s
[11:23:28.696] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:10:0)
[11:23:28.712] Build status: STARTED
[11:23:28.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:11:0) after 4m55s
[11:28:23.779] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:11:0)
[11:28:23.799] Build status: STARTED
[11:28:23.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:12:0) after 8m30s
[11:36:53.800] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:12:0)
[11:36:53.819] Build status: STARTED
[11:36:53.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:13:0) after 7m1s
[11:43:54.838] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:13:0)
[11:43:54.864] Build status: STARTED
[11:43:54.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:14:0) after 8m51s
[11:52:45.984] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:14:0)
[11:52:45.998] Build status: STARTED
[11:52:45.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:15:0) after 3m39s
[11:56:25.020] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:15:0)
[11:56:25.064] Build status: STARTED
[11:56:25.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:16:0) after 1m44s
[11:58:09.123] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:16:0)
[11:58:09.142] Build status: STARTED
[11:58:09.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:17:0) after 5m53s
[12:04:02.156] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:17:0)
[12:04:02.214] Build status: STARTED
[12:04:02.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:18:0) after 3m22s
[12:07:24.230] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:18:0)
[12:07:24.246] Build status: STARTED
[12:07:24.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:19:0) after 2m10s
[12:09:34.274] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:19:0)
[12:09:34.319] Build status: STARTED
[12:09:34.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:20:0) after 6m13s
[12:15:47.504] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:20:0)
[12:15:47.579] Build status: STARTED
[12:15:47.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:21:0) after 9m46s
[12:25:33.643] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:21:0)
[12:25:33.789] Build status: STARTED
[12:25:33.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:22:0) after 6m53s
[12:32:26.809] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:22:0)
[12:32:26.880] Build status: STARTED
[12:32:26.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:23:0) after 3m31s
[12:35:57.942] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:23:0)
[12:35:57.962] Build status: STARTED
[12:35:57.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:24:0) after 1m41s
[12:37:38.993] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:24:0)
[12:37:39.041] Build status: STARTED
[12:37:39.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:25:0) after 2m30s
[12:40:09.057] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:25:0)
[12:40:09.074] Build status: STARTED
[12:40:09.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:26:0) after 1m5s
[12:41:14.134] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:26:0)
[12:41:14.148] Build status: STARTED
[12:41:14.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:27:0) after 6m0s
[12:47:14.168] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:27:0)
[12:47:14.193] Build status: STARTED
[12:47:14.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:28:0) after 4m25s
[12:51:39.419] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:28:0)
[12:51:39.445] Build status: STARTED
[12:51:39.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:29:0) after 6m40s
[12:58:19.451] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:29:0)
[12:58:19.471] Build status: STARTED
[12:58:19.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:30:0) after 5m46s
[13:04:05.486] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:30:0)
[13:04:05.500] Build status: STARTED
[13:04:05.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:31:0) after 9m34s
[13:13:39.517] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:31:0)
[13:13:39.532] Build status: STARTED
[13:13:39.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:32:0) after 4m43s
[13:18:22.596] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:32:0)
[13:18:22.616] Build status: STARTED
[13:18:22.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:33:0) after 3m39s
[13:22:01.594] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:33:0)
[13:22:01.614] Build status: STARTED
[13:22:01.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:34:0) after 7m49s
[13:29:50.637] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:34:0)
[13:29:50.655] Build status: STARTED
[13:29:50.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:35:0) after 8m57s
[13:38:47.680] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:35:0)
[13:38:47.819] Build status: STARTED
[13:38:47.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:36:0) after 5m27s
[13:44:14.836] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:36:0)
[13:44:14.867] Build status: STARTED
[13:44:14.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:37:0) after 8m8s
[13:52:23.000] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:37:0)
[13:52:23.024] Build status: STARTED
[13:52:23.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:38:0) after 4m38s
[13:57:01.044] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:38:0)
[13:57:01.075] Build status: STARTED
[13:57:01.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:39:0) after 4m38s
[14:01:39.175] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:39:0)
[14:01:39.196] Build status: STARTED
[14:01:39.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:40:0) after 9m10s
[14:10:49.216] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:40:0)
[14:10:49.239] Build status: STARTED
[14:10:49.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:41:0) after 8m46s
[14:19:35.253] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:41:0)
[14:19:35.277] Build status: STARTED
[14:19:35.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:42:0) after 7m25s
[14:27:00.307] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:42:0)
[14:27:00.324] Build status: STARTED
[14:27:00.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:43:0) after 8m23s
[14:35:23.302] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:43:0)
[14:35:23.318] Build status: STARTED
[14:35:23.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:44:0) after 7m30s
[14:42:53.338] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:44:0)
[14:42:53.364] Build status: STARTED
[14:42:53.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:45:0) after 8m29s
[14:51:22.386] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:45:0)
[14:51:22.409] Build status: STARTED
[14:51:22.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:46:0) after 9m59s
[15:01:21.481] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:46:0)
[15:01:21.513] Build status: STARTED
[15:01:21.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:47:0) after 8m44s
[15:10:05.536] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:47:0)
[15:10:05.559] Build status: STARTED
[15:10:05.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:48:0) after 1m6s
[15:11:11.543] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:48:0)
[15:11:11.564] Build status: STARTED
[15:11:11.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:49:0) after 8m21s
[15:19:32.679] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:49:0)
[15:19:32.750] Build status: STARTED
[15:19:32.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:50:0) after 4m31s
[15:24:03.754] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:50:0)
[15:24:03.773] Build status: STARTED
[15:24:03.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:51:0) after 1m10s
[15:25:13.883] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:51:0)
[15:25:13.906] Build status: STARTED
[15:25:13.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:52:0) after 3m44s
[15:28:57.933] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:52:0)
[15:28:57.998] Build status: STARTED
[15:28:57.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:53:0) after 1m32s
[15:30:30.037] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:53:0)
[15:30:30.063] Build status: STARTED
[15:30:30.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:54:0) after 4m5s
[15:34:35.128] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:54:0)
[15:34:35.143] Build status: STARTED
[15:34:35.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:55:0) after 8m23s
[15:42:58.180] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:55:0)
[15:42:58.206] Build status: STARTED
[15:42:58.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:56:0) after 8m50s
[15:51:48.242] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:56:0)
[15:51:48.304] Build status: STARTED
[15:51:48.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:57:0) after 7m31s
[15:59:19.350] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:57:0)
[15:59:19.465] Build status: STARTED
[15:59:19.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:58:0) after 3m19s
[16:02:38.484] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:58:0)
[16:02:38.503] Build status: STARTED
[16:02:38.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:59:0) after 8m27s
[16:11:05.850] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:59:0)
[16:11:05.866] Build status: STARTED
[16:11:05.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:60:0) after 6m0s
[16:17:06.029] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:60:0)
[16:17:06.061] Build status: STARTED
[16:17:06.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:61:0) after 3m23s
[16:20:29.150] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:61:0)
[16:20:29.200] Build status: STARTED
[16:20:29.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:62:0) after 3m44s
[16:24:13.256] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:62:0)
[16:24:13.322] Build status: STARTED
[16:24:13.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:63:0) after 6m43s
[16:30:56.398] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:63:0)
[16:30:56.429] Build status: STARTED
[16:30:56.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:64:0) after 6m45s
[16:37:41.710] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:64:0)
[16:37:41.729] Build status: STARTED
[16:37:41.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8848169280378841088:65:0) after 3m13s
[16:38:44.546] Received PubSub notification, asking Buildbucket for the build status
[16:38:44.561] Build:
{
"id": "8682739218458724593",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxCoverage"
},
"number": 107111,
"createdBy": "project:chromium",
"createTime": "2026-05-04T10:47:13.510708284Z",
"startTime": "2026-05-04T10:48:03.494809667Z",
"endTime": "2026-05-04T16:38:44.283423149Z",
"updateTime": "2026-05-04T16:38:44.283423149Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5332613e97b99ec0663b41e0beff662a5e297e6d",
"ref": "refs/heads/main"
}
},
"canary": true
}
[16:38:44.561] Invocation finished in 5h51m32.266385622s with status FAILED