[00:11:34.855] New invocation is queued and will start shortly
[00:11:36.890] Starting the invocation (attempt 1)
[00:11:36.923] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/246d83588dbf18c166d1fca5b999d15a2e0e06de"
[00:11:36.923] Popped gitiles commit info from properties and tags
[00:11:36.923] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:11:36.923] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:11:36.923] Buildbucket request:
{
"requestId": "8916700576997956928",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "246d83588dbf18c166d1fca5b999d15a2e0e06de",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8916700576997956928"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[00:11:37.664] Scheduled build:
{
"id": "8751270514098427777",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 20348,
"createdBy": "project:chromium",
"createTime": "2024-04-08T00:11:36.989137231Z",
"updateTime": "2024-04-08T00:11:36.989137231Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "246d83588dbf18c166d1fca5b999d15a2e0e06de",
"ref": "refs/heads/main"
}
}
}
[00:11:37.664] Task URL: https://cr-buildbucket.appspot.com/build/8751270514098427777
[00:11:37.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:2:0) after 7m25s
[00:11:37.798] Received PubSub notification, asking Buildbucket for the build status
[00:11:37.830] Build status: SCHEDULED
[00:12:17.975] Received PubSub notification, asking Buildbucket for the build status
[00:12:18.099] Build status: STARTED
[00:19:03.084] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:2:0)
[00:19:03.113] Build status: STARTED
[00:19:03.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:5:0) after 9m21s
[00:28:24.138] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:5:0)
[00:28:24.195] Build status: STARTED
[00:28:24.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:6:0) after 7m58s
[00:36:22.260] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:6:0)
[00:36:22.321] Build status: STARTED
[00:36:22.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:7:0) after 4m18s
[00:40:40.352] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:7:0)
[00:40:40.371] Build status: STARTED
[00:40:40.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:8:0) after 2m50s
[00:43:30.774] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:8:0)
[00:43:30.800] Build status: STARTED
[00:43:30.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:9:0) after 6m53s
[00:50:23.971] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:9:0)
[00:50:24.039] Build status: STARTED
[00:50:24.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:10:0) after 9m26s
[00:59:50.217] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:10:0)
[00:59:50.238] Build status: STARTED
[00:59:50.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:11:0) after 2m54s
[01:02:44.372] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:11:0)
[01:02:44.526] Build status: STARTED
[01:02:44.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:12:0) after 2m14s
[01:04:58.543] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:12:0)
[01:04:58.613] Build status: STARTED
[01:04:58.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:13:0) after 8m1s
[01:12:59.694] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:13:0)
[01:12:59.713] Build status: STARTED
[01:12:59.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:14:0) after 8m3s
[01:21:02.934] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:14:0)
[01:21:02.954] Build status: STARTED
[01:21:02.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:15:0) after 9m19s
[01:30:22.045] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:15:0)
[01:30:22.066] Build status: STARTED
[01:30:22.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:16:0) after 8m16s
[01:38:38.387] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:16:0)
[01:38:38.413] Build status: STARTED
[01:38:38.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:17:0) after 3m47s
[01:42:25.684] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:17:0)
[01:42:25.708] Build status: STARTED
[01:42:25.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:18:0) after 1m12s
[01:43:37.725] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:18:0)
[01:43:37.747] Build status: STARTED
[01:43:37.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:19:0) after 5m26s
[01:49:03.966] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:19:0)
[01:49:04.073] Build status: STARTED
[01:49:04.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:20:0) after 3m43s
[01:52:47.044] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:20:0)
[01:52:47.482] Build status: STARTED
[01:52:47.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:21:0) after 3m23s
[01:56:10.502] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:21:0)
[01:56:10.546] Build status: STARTED
[01:56:10.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:22:0) after 4m31s
[02:00:41.564] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:22:0)
[02:00:41.585] Build status: STARTED
[02:00:41.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:23:0) after 7m54s
[02:08:35.610] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:23:0)
[02:08:35.659] Build status: STARTED
[02:08:35.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:24:0) after 2m56s
[02:11:31.674] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:24:0)
[02:11:31.701] Build status: STARTED
[02:11:31.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:25:0) after 2m25s
[02:13:56.723] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:25:0)
[02:13:56.750] Build status: STARTED
[02:13:56.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:26:0) after 5m25s
[02:19:22.014] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:26:0)
[02:19:22.269] Build status: STARTED
[02:19:22.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:27:0) after 5m52s
[02:25:14.284] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:27:0)
[02:25:14.316] Build status: STARTED
[02:25:14.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:28:0) after 4m6s
[02:29:20.633] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:28:0)
[02:29:20.648] Build status: STARTED
[02:29:20.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:29:0) after 7m29s
[02:36:49.662] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:29:0)
[02:36:49.679] Build status: STARTED
[02:36:49.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:30:0) after 9m5s
[02:45:54.796] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:30:0)
[02:45:54.820] Build status: STARTED
[02:45:54.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:31:0) after 4m32s
[02:50:26.838] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:31:0)
[02:50:26.873] Build status: STARTED
[02:50:26.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:32:0) after 8m44s
[02:59:11.032] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:32:0)
[02:59:11.055] Build status: STARTED
[02:59:11.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:33:0) after 7m22s
[03:06:33.156] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:33:0)
[03:06:33.179] Build status: STARTED
[03:06:33.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:34:0) after 5m48s
[03:12:21.231] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:34:0)
[03:12:21.409] Build status: STARTED
[03:12:21.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:35:0) after 7m8s
[03:19:29.441] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:35:0)
[03:19:29.462] Build status: STARTED
[03:19:29.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:36:0) after 5m8s
[03:24:37.475] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:36:0)
[03:24:37.523] Build status: STARTED
[03:24:37.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:37:0) after 6m27s
[03:31:04.539] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:37:0)
[03:31:04.567] Build status: STARTED
[03:31:04.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916700576997956928:38:0) after 6m47s
[03:35:36.286] Received PubSub notification, asking Buildbucket for the build status
[03:35:36.308] Build:
{
"id": "8751270514098427777",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 20348,
"createdBy": "project:chromium",
"createTime": "2024-04-08T00:11:36.989137231Z",
"startTime": "2024-04-08T00:12:17.551981168Z",
"endTime": "2024-04-08T03:35:36.082975900Z",
"updateTime": "2024-04-08T03:35:36.082975900Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "246d83588dbf18c166d1fca5b999d15a2e0e06de",
"ref": "refs/heads/main"
}
}
}
[03:35:36.308] Invocation finished in 3h24m1.468169644s with status FAILED