[21:51:18.315] New invocation is queued and will start shortly
[21:51:19.607] Starting the invocation (attempt 1)
[21:51:19.637] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/bdc479bd49cfb6d42c89db430b1e6aae52e9da62"
[21:51:19.637] Popped gitiles commit info from properties and tags
[21:51:19.637] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:51:19.638] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:51:19.638] Buildbucket request:
{
"requestId": "8922960593054802768",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bdc479bd49cfb6d42c89db430b1e6aae52e9da62",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8922960593054802768"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:51:20.289] Scheduled build:
{
"id": "8757530530946517745",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 19340,
"createdBy": "project:chromium",
"createTime": "2024-01-29T21:51:19.700585006Z",
"updateTime": "2024-01-29T21:51:19.700585006Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bdc479bd49cfb6d42c89db430b1e6aae52e9da62",
"ref": "refs/heads/main"
}
}
}
[21:51:20.289] Task URL: https://cr-buildbucket.appspot.com/build/8757530530946517745
[21:51:20.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:2:0) after 8m46s
[21:51:21.239] Received PubSub notification, asking Buildbucket for the build status
[21:51:21.262] Build status: SCHEDULED
[21:52:30.045] Received PubSub notification, asking Buildbucket for the build status
[21:52:30.061] Build status: STARTED
[22:00:06.339] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:2:0)
[22:00:06.364] Build status: STARTED
[22:00:06.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:5:0) after 7m58s
[22:08:04.384] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:5:0)
[22:08:04.405] Build status: STARTED
[22:08:04.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:6:0) after 7m19s
[22:15:23.493] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:6:0)
[22:15:23.527] Build status: STARTED
[22:15:23.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:7:0) after 7m20s
[22:22:43.649] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:7:0)
[22:22:43.668] Build status: STARTED
[22:22:43.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:8:0) after 7m51s
[22:30:34.709] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:8:0)
[22:30:34.727] Build status: STARTED
[22:30:34.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:9:0) after 3m53s
[22:34:27.751] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:9:0)
[22:34:27.773] Build status: STARTED
[22:34:27.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:10:0) after 5m48s
[22:40:15.800] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:10:0)
[22:40:15.824] Build status: STARTED
[22:40:15.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:11:0) after 6m28s
[22:46:43.994] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:11:0)
[22:46:44.020] Build status: STARTED
[22:46:44.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:12:0) after 3m51s
[22:50:35.085] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:12:0)
[22:50:35.106] Build status: STARTED
[22:50:35.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:13:0) after 3m14s
[22:53:49.093] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:13:0)
[22:53:49.114] Build status: STARTED
[22:53:49.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:14:0) after 6m21s
[23:00:10.269] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:14:0)
[23:00:10.315] Build status: STARTED
[23:00:10.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:15:0) after 9m44s
[23:09:54.380] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:15:0)
[23:09:54.401] Build status: STARTED
[23:09:54.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:16:0) after 5m6s
[23:15:00.435] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:16:0)
[23:15:00.459] Build status: STARTED
[23:15:00.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:17:0) after 4m47s
[23:19:47.485] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:17:0)
[23:19:47.504] Build status: STARTED
[23:19:47.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:18:0) after 7m47s
[23:27:34.524] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:18:0)
[23:27:34.542] Build status: STARTED
[23:27:34.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:19:0) after 8m0s
[23:35:34.564] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:19:0)
[23:35:34.588] Build status: STARTED
[23:35:34.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:20:0) after 9m12s
[23:44:46.609] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:20:0)
[23:44:46.636] Build status: STARTED
[23:44:46.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:21:0) after 6m53s
[23:51:40.979] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:21:0)
[23:51:40.997] Build status: STARTED
[23:51:40.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:22:0) after 4m33s
[23:56:14.024] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:22:0)
[23:56:14.041] Build status: STARTED
[23:56:14.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:23:0) after 2m20s
[23:58:34.060] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:23:0)
[23:58:34.083] Build status: STARTED
[23:58:34.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:24:0) after 8m58s
[00:07:32.166] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:24:0)
[00:07:32.188] Build status: STARTED
[00:07:32.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:25:0) after 2m10s
[00:09:42.171] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:25:0)
[00:09:42.188] Build status: STARTED
[00:09:42.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:26:0) after 2m21s
[00:12:03.340] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:26:0)
[00:12:03.360] Build status: STARTED
[00:12:03.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:27:0) after 5m0s
[00:17:03.410] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:27:0)
[00:17:03.429] Build status: STARTED
[00:17:03.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:28:0) after 3m29s
[00:20:32.483] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:28:0)
[00:20:32.514] Build status: STARTED
[00:20:32.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:29:0) after 9m57s
[00:30:29.563] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:29:0)
[00:30:29.581] Build status: STARTED
[00:30:29.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:30:0) after 5m40s
[00:36:09.618] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:30:0)
[00:36:09.644] Build status: STARTED
[00:36:09.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:31:0) after 9m20s
[00:45:29.668] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:31:0)
[00:45:29.685] Build status: STARTED
[00:45:29.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:32:0) after 8m1s
[00:53:30.763] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:32:0)
[00:53:30.777] Build status: STARTED
[00:53:30.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:33:0) after 6m55s
[01:00:25.806] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:33:0)
[01:00:25.841] Build status: STARTED
[01:00:25.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:34:0) after 7m29s
[01:07:54.984] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:34:0)
[01:07:55.002] Build status: STARTED
[01:07:55.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:35:0) after 8m16s
[01:16:11.021] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:35:0)
[01:16:11.045] Build status: STARTED
[01:16:11.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:36:0) after 4m48s
[01:20:59.099] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:36:0)
[01:20:59.128] Build status: STARTED
[01:20:59.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:37:0) after 5m31s
[01:26:30.143] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:37:0)
[01:26:30.186] Build status: STARTED
[01:26:30.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8922960593054802768:38:0) after 9m41s
[01:29:27.242] Received PubSub notification, asking Buildbucket for the build status
[01:29:27.475] Build:
{
"id": "8757530530946517745",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 19340,
"createdBy": "project:chromium",
"createTime": "2024-01-29T21:51:19.700585006Z",
"startTime": "2024-01-29T21:52:29.526962Z",
"endTime": "2024-01-30T01:29:26.651710Z",
"updateTime": "2024-01-30T01:29:26.651710Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bdc479bd49cfb6d42c89db430b1e6aae52e9da62",
"ref": "refs/heads/main"
}
}
}
[01:29:27.475] Invocation finished in 3h38m9.168804482s with status FAILED