[03:01:14.296] New invocation is queued and will start shortly
[03:01:15.422] Starting the invocation (attempt 1)
[03:01:15.451] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c314eaafeedb55000f607e2a33b8f74818eb8da8"
[03:01:15.451] Popped gitiles commit info from properties and tags
[03:01:15.451] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:01:15.451] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:01:15.451] Buildbucket request:
{
"requestId": "8916780500037461024",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c314eaafeedb55000f607e2a33b8f74818eb8da8",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8916780500037461024"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:01:16.086] Scheduled build:
{
"id": "8751350438098732577",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 20344,
"createdBy": "project:chromium",
"createTime": "2024-04-07T03:01:15.522096595Z",
"updateTime": "2024-04-07T03:01:15.522096595Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c314eaafeedb55000f607e2a33b8f74818eb8da8",
"ref": "refs/heads/main"
}
}
}
[03:01:16.086] Task URL: https://cr-buildbucket.appspot.com/build/8751350438098732577
[03:01:16.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:2:0) after 5m35s
[03:01:17.614] Received PubSub notification, asking Buildbucket for the build status
[03:01:17.710] Build status: SCHEDULED
[03:02:16.263] Received PubSub notification, asking Buildbucket for the build status
[03:02:16.325] Build status: STARTED
[03:06:51.080] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:2:0)
[03:06:51.103] Build status: STARTED
[03:06:51.103] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:5:0) after 9m3s
[03:15:54.170] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:5:0)
[03:15:54.198] Build status: STARTED
[03:15:54.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:6:0) after 5m41s
[03:21:37.190] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:6:0)
[03:21:37.214] Build status: STARTED
[03:21:37.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:7:0) after 3m59s
[03:25:36.231] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:7:0)
[03:25:36.251] Build status: STARTED
[03:25:36.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:8:0) after 8m59s
[03:34:35.375] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:8:0)
[03:34:35.395] Build status: STARTED
[03:34:35.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:9:0) after 2m56s
[03:37:31.522] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:9:0)
[03:37:31.615] Build status: STARTED
[03:37:31.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:10:0) after 2m6s
[03:39:37.718] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:10:0)
[03:39:37.927] Build status: STARTED
[03:39:37.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:11:0) after 8m13s
[03:47:50.951] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:11:0)
[03:47:50.976] Build status: STARTED
[03:47:50.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:12:0) after 7m18s
[03:55:09.004] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:12:0)
[03:55:09.024] Build status: STARTED
[03:55:09.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:13:0) after 8m58s
[04:04:07.351] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:13:0)
[04:04:07.390] Build status: STARTED
[04:04:07.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:14:0) after 1m18s
[04:05:25.409] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:14:0)
[04:05:25.438] Build status: STARTED
[04:05:25.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:15:0) after 2m7s
[04:07:32.535] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:15:0)
[04:07:32.561] Build status: STARTED
[04:07:32.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:16:0) after 5m17s
[04:12:49.643] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:16:0)
[04:12:49.757] Build status: STARTED
[04:12:49.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:17:0) after 7m4s
[04:19:53.912] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:17:0)
[04:19:53.998] Build status: STARTED
[04:19:53.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:18:0) after 4m31s
[04:24:25.297] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:18:0)
[04:24:25.318] Build status: STARTED
[04:24:25.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:19:0) after 4m35s
[04:29:00.670] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:19:0)
[04:29:00.695] Build status: STARTED
[04:29:00.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:20:0) after 2m55s
[04:31:55.711] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:20:0)
[04:31:55.731] Build status: STARTED
[04:31:55.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:21:0) after 8m51s
[04:40:46.749] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:21:0)
[04:40:46.777] Build status: STARTED
[04:40:46.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:22:0) after 3m25s
[04:44:11.795] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:22:0)
[04:44:11.831] Build status: STARTED
[04:44:11.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:23:0) after 3m13s
[04:47:24.845] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:23:0)
[04:47:24.862] Build status: STARTED
[04:47:24.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:24:0) after 3m33s
[04:50:57.945] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:24:0)
[04:50:57.973] Build status: STARTED
[04:50:57.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:25:0) after 3m15s
[04:54:13.057] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:25:0)
[04:54:13.097] Build status: STARTED
[04:54:13.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:26:0) after 4m55s
[04:59:08.125] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:26:0)
[04:59:08.151] Build status: STARTED
[04:59:08.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:27:0) after 5m15s
[05:04:23.175] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:27:0)
[05:04:23.197] Build status: STARTED
[05:04:23.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:28:0) after 1m9s
[05:05:32.344] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:28:0)
[05:05:32.378] Build status: STARTED
[05:05:32.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:29:0) after 4m49s
[05:10:21.679] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:29:0)
[05:10:21.701] Build status: STARTED
[05:10:21.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:30:0) after 2m23s
[05:12:44.890] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:30:0)
[05:12:44.907] Build status: STARTED
[05:12:44.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:31:0) after 3m32s
[05:16:16.935] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:31:0)
[05:16:16.962] Build status: STARTED
[05:16:16.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:32:0) after 7m56s
[05:24:13.113] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:32:0)
[05:24:13.153] Build status: STARTED
[05:24:13.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:33:0) after 5m52s
[05:30:05.169] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:33:0)
[05:30:05.192] Build status: STARTED
[05:30:05.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:34:0) after 9m43s
[05:39:48.236] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:34:0)
[05:39:48.257] Build status: STARTED
[05:39:48.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:35:0) after 7m17s
[05:47:05.443] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:35:0)
[05:47:05.618] Build status: STARTED
[05:47:05.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:36:0) after 2m6s
[05:49:11.643] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:36:0)
[05:49:11.684] Build status: STARTED
[05:49:11.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:37:0) after 8m14s
[05:57:25.700] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:37:0)
[05:57:25.721] Build status: STARTED
[05:57:25.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:38:0) after 7m11s
[06:04:36.736] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:38:0)
[06:04:36.941] Build status: STARTED
[06:04:36.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:39:0) after 3m10s
[06:07:47.369] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:39:0)
[06:07:47.401] Build status: STARTED
[06:07:47.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:40:0) after 9m42s
[06:17:29.424] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:40:0)
[06:17:29.455] Build status: STARTED
[06:17:29.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:41:0) after 8m52s
[06:26:21.616] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:41:0)
[06:26:21.636] Build status: STARTED
[06:26:21.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:42:0) after 9m14s
[06:35:35.650] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916780500037461024:42:0)
[06:35:35.667] Build:
{
"id": "8751350438098732577",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 20344,
"createdBy": "project:chromium",
"createTime": "2024-04-07T03:01:15.522096595Z",
"startTime": "2024-04-07T03:02:15.791172114Z",
"endTime": "2024-04-07T06:35:14.611861620Z",
"updateTime": "2024-04-07T06:35:14.611861620Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c314eaafeedb55000f607e2a33b8f74818eb8da8",
"ref": "refs/heads/main"
}
}
}
[06:35:35.667] Invocation finished in 3h34m21.377585133s with status FAILED