[19:21:21.284] New invocation is queued and will start shortly
[19:21:22.669] Starting the invocation (attempt 1)
[19:21:22.721] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/51d954d981101d6cc43894a4b372872c0b726e8f"
[19:21:22.721] Popped gitiles commit info from properties and tags
[19:21:22.721] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:21:22.721] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:21:22.721] Buildbucket request:
{
"requestId": "8908836900366828416",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "51d954d981101d6cc43894a4b372872c0b726e8f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8908836900366828416"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:21:23.390] Scheduled build:
{
"id": "8743406838060017649",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 21730,
"createdBy": "project:chromium",
"createTime": "2024-07-03T19:21:22.859542790Z",
"updateTime": "2024-07-03T19:21:22.859542790Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "51d954d981101d6cc43894a4b372872c0b726e8f",
"ref": "refs/heads/main"
}
}
}
[19:21:23.390] Task URL: https://cr-buildbucket.appspot.com/build/8743406838060017649
[19:21:23.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:2:0) after 4m15s
[19:21:24.432] Received PubSub notification, asking Buildbucket for the build status
[19:21:24.498] Build status: SCHEDULED
[19:23:08.161] Received PubSub notification, asking Buildbucket for the build status
[19:23:09.074] Build status: STARTED
[19:25:38.428] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:2:0)
[19:25:38.468] Build status: STARTED
[19:25:38.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:5:0) after 9m24s
[19:35:02.540] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:5:0)
[19:35:02.594] Build status: STARTED
[19:35:02.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:6:0) after 6m40s
[19:41:42.620] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:6:0)
[19:41:42.644] Build status: STARTED
[19:41:42.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:7:0) after 4m31s
[19:46:13.714] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:7:0)
[19:46:13.743] Build status: STARTED
[19:46:13.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:8:0) after 2m48s
[19:49:01.814] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:8:0)
[19:49:01.833] Build status: STARTED
[19:49:01.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:9:0) after 8m19s
[19:57:20.862] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:9:0)
[19:57:20.884] Build status: STARTED
[19:57:20.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:10:0) after 4m30s
[20:01:50.871] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:10:0)
[20:01:50.890] Build status: STARTED
[20:01:50.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:11:0) after 6m50s
[20:08:40.934] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:11:0)
[20:08:40.990] Build status: STARTED
[20:08:40.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:12:0) after 6m42s
[20:15:23.017] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:12:0)
[20:15:23.035] Build status: STARTED
[20:15:23.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:13:0) after 3m8s
[20:18:31.058] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:13:0)
[20:18:31.127] Build status: STARTED
[20:18:31.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:14:0) after 5m20s
[20:23:51.150] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:14:0)
[20:23:51.171] Build status: STARTED
[20:23:51.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:15:0) after 6m30s
[20:30:21.342] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:15:0)
[20:30:21.359] Build status: STARTED
[20:30:21.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:16:0) after 1m44s
[20:32:05.381] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:16:0)
[20:32:05.403] Build status: STARTED
[20:32:05.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:17:0) after 5m16s
[20:37:21.442] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:17:0)
[20:37:21.466] Build status: STARTED
[20:37:21.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:18:0) after 9m36s
[20:46:57.529] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:18:0)
[20:46:57.602] Build status: STARTED
[20:46:57.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:19:0) after 7m24s
[20:54:21.630] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:19:0)
[20:54:21.649] Build status: STARTED
[20:54:21.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:20:0) after 1m4s
[20:55:25.682] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:20:0)
[20:55:25.701] Build status: STARTED
[20:55:25.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:21:0) after 2m0s
[20:57:25.799] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:21:0)
[20:57:25.817] Build status: STARTED
[20:57:25.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:22:0) after 7m28s
[21:04:53.851] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:22:0)
[21:04:53.869] Build status: STARTED
[21:04:53.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:23:0) after 1m29s
[21:06:22.931] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:23:0)
[21:06:22.962] Build status: STARTED
[21:06:22.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:24:0) after 6m19s
[21:12:41.988] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:24:0)
[21:12:42.011] Build status: STARTED
[21:12:42.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:25:0) after 2m13s
[21:14:55.093] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:25:0)
[21:14:55.112] Build status: STARTED
[21:14:55.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:26:0) after 8m30s
[21:23:25.096] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:26:0)
[21:23:25.119] Build status: STARTED
[21:23:25.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:27:0) after 9m41s
[21:33:06.189] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:27:0)
[21:33:06.224] Build status: STARTED
[21:33:06.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:28:0) after 5m48s
[21:38:54.209] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:28:0)
[21:38:54.236] Build status: STARTED
[21:38:54.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:29:0) after 7m5s
[21:45:59.309] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:29:0)
[21:45:59.374] Build status: STARTED
[21:45:59.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:30:0) after 3m55s
[21:49:54.411] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:30:0)
[21:49:54.433] Build status: STARTED
[21:49:54.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:31:0) after 9m4s
[21:58:58.454] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:31:0)
[21:58:58.483] Build status: STARTED
[21:58:58.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:32:0) after 9m31s
[22:08:29.719] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:32:0)
[22:08:29.737] Build status: STARTED
[22:08:29.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:33:0) after 8m20s
[22:16:50.550] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:33:0)
[22:16:50.572] Build status: STARTED
[22:16:50.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:34:0) after 3m7s
[22:19:57.764] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:34:0)
[22:19:57.782] Build status: STARTED
[22:19:57.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:35:0) after 4m58s
[22:24:55.854] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:35:0)
[22:24:55.924] Build status: STARTED
[22:24:55.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:36:0) after 5m44s
[22:30:40.244] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:36:0)
[22:30:40.316] Build status: STARTED
[22:30:40.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:37:0) after 4m45s
[22:35:25.547] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:37:0)
[22:35:25.573] Build status: STARTED
[22:35:25.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:38:0) after 9m43s
[22:45:08.683] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:38:0)
[22:45:08.708] Build status: STARTED
[22:45:08.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:39:0) after 7m46s
[22:52:54.765] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:39:0)
[22:52:54.785] Build status: STARTED
[22:52:54.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8908836900366828416:40:0) after 4m12s
[22:53:55.266] Received PubSub notification, asking Buildbucket for the build status
[22:53:55.329] Build:
{
"id": "8743406838060017649",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 21730,
"createdBy": "project:chromium",
"createTime": "2024-07-03T19:21:22.859542790Z",
"startTime": "2024-07-03T19:23:07.859523461Z",
"endTime": "2024-07-03T22:53:54.960569159Z",
"updateTime": "2024-07-03T22:53:54.960569159Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "51d954d981101d6cc43894a4b372872c0b726e8f",
"ref": "refs/heads/main"
}
}
}
[22:53:55.329] Invocation finished in 3h32m34.053394567s with status FAILED