[15:07:14.843] New invocation is queued and will start shortly
[15:07:15.902] Starting the invocation (attempt 1)
[15:07:15.930] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/43370bea081ca465815107bb85856ee193623607"
[15:07:15.930] Popped gitiles commit info from properties and tags
[15:07:15.930] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:07:15.930] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:07:15.930] Buildbucket request:
{
"requestId": "8924073177775547184",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "43370bea081ca465815107bb85856ee193623607",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8924073177775547184"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:07:16.613] Scheduled build:
{
"id": "8758643115900405585",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 19108,
"createdBy": "project:chromium",
"createTime": "2024-01-17T15:07:16.005549551Z",
"updateTime": "2024-01-17T15:07:16.005549551Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "43370bea081ca465815107bb85856ee193623607",
"ref": "refs/heads/main"
}
}
}
[15:07:16.613] Task URL: https://cr-buildbucket.appspot.com/build/8758643115900405585
[15:07:16.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:2:0) after 2m48s
[15:07:17.648] Received PubSub notification, asking Buildbucket for the build status
[15:07:17.678] Build status: SCHEDULED
[15:07:20.886] Received PubSub notification, asking Buildbucket for the build status
[15:07:20.908] Build status: STARTED
[15:10:04.781] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:2:0)
[15:10:05.434] Build status: STARTED
[15:10:05.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:5:0) after 7m34s
[15:17:39.850] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:5:0)
[15:17:39.871] Build status: STARTED
[15:17:39.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:6:0) after 4m25s
[15:22:05.007] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:6:0)
[15:22:05.080] Build status: STARTED
[15:22:05.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:7:0) after 6m47s
[15:28:52.650] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:7:0)
[15:28:52.690] Build status: STARTED
[15:28:52.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:8:0) after 6m44s
[15:35:36.807] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:8:0)
[15:35:36.844] Build status: STARTED
[15:35:36.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:9:0) after 7m8s
[15:42:44.994] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:9:0)
[15:42:45.024] Build status: STARTED
[15:42:45.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:10:0) after 5m12s
[15:47:57.042] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:10:0)
[15:47:57.057] Build status: STARTED
[15:47:57.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:11:0) after 8m47s
[15:56:44.262] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:11:0)
[15:56:44.286] Build status: STARTED
[15:56:44.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:12:0) after 5m56s
[16:02:40.384] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:12:0)
[16:02:40.416] Build status: STARTED
[16:02:40.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:13:0) after 5m33s
[16:08:13.536] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:13:0)
[16:08:13.552] Build status: STARTED
[16:08:13.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:14:0) after 9m32s
[16:17:45.570] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:14:0)
[16:17:45.589] Build status: STARTED
[16:17:45.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:15:0) after 1m35s
[16:19:20.605] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:15:0)
[16:19:20.639] Build status: STARTED
[16:19:20.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:16:0) after 9m10s
[16:28:30.944] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:16:0)
[16:28:30.986] Build status: STARTED
[16:28:30.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:17:0) after 4m45s
[16:33:16.106] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:17:0)
[16:33:16.126] Build status: STARTED
[16:33:16.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:18:0) after 4m27s
[16:37:43.123] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:18:0)
[16:37:43.146] Build status: STARTED
[16:37:43.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:19:0) after 4m13s
[16:41:56.537] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:19:0)
[16:41:56.612] Build status: STARTED
[16:41:56.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:20:0) after 3m33s
[16:45:29.817] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:20:0)
[16:45:29.898] Build status: STARTED
[16:45:29.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:21:0) after 2m30s
[16:47:59.934] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:21:0)
[16:48:00.080] Build status: STARTED
[16:48:00.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:22:0) after 7m25s
[16:55:25.265] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:22:0)
[16:55:25.293] Build status: STARTED
[16:55:25.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:23:0) after 1m24s
[16:56:49.315] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:23:0)
[16:56:49.334] Build status: STARTED
[16:56:49.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:24:0) after 9m14s
[17:06:03.386] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:24:0)
[17:06:03.442] Build status: STARTED
[17:06:03.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:25:0) after 8m3s
[17:14:06.459] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:25:0)
[17:14:06.494] Build status: STARTED
[17:14:06.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:26:0) after 5m22s
[17:19:29.222] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:26:0)
[17:19:29.245] Build status: STARTED
[17:19:29.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:27:0) after 4m7s
[17:23:36.437] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:27:0)
[17:23:36.516] Build status: STARTED
[17:23:36.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:28:0) after 2m51s
[17:26:27.533] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:28:0)
[17:26:27.548] Build status: STARTED
[17:26:27.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:29:0) after 9m12s
[17:35:39.859] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:29:0)
[17:35:39.877] Build status: STARTED
[17:35:39.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:30:0) after 1m58s
[17:37:37.894] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:30:0)
[17:37:37.909] Build status: STARTED
[17:37:37.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:31:0) after 7m55s
[17:45:32.992] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:31:0)
[17:45:33.017] Build status: STARTED
[17:45:33.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:32:0) after 7m12s
[17:52:45.365] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:32:0)
[17:52:45.387] Build status: STARTED
[17:52:45.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:33:0) after 2m18s
[17:55:03.455] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:33:0)
[17:55:03.524] Build status: STARTED
[17:55:03.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:34:0) after 4m6s
[17:59:09.583] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:34:0)
[17:59:09.605] Build status: STARTED
[17:59:09.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:35:0) after 6m56s
[18:06:05.646] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:35:0)
[18:06:05.675] Build status: STARTED
[18:06:05.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:36:0) after 6m56s
[18:13:01.697] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:36:0)
[18:13:01.725] Build status: STARTED
[18:13:01.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:37:0) after 2m35s
[18:15:36.845] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:37:0)
[18:15:36.865] Build status: STARTED
[18:15:36.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:38:0) after 1m27s
[18:17:03.882] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:38:0)
[18:17:03.900] Build status: STARTED
[18:17:03.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:39:0) after 7m58s
[18:25:01.920] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:39:0)
[18:25:01.943] Build status: STARTED
[18:25:01.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:40:0) after 5m35s
[18:30:37.008] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:40:0)
[18:30:37.041] Build status: STARTED
[18:30:37.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:41:0) after 3m2s
[18:33:39.101] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:41:0)
[18:33:39.145] Build status: STARTED
[18:33:39.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:42:0) after 3m59s
[18:37:38.161] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:42:0)
[18:37:38.182] Build status: STARTED
[18:37:38.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:43:0) after 5m7s
[18:42:45.203] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:43:0)
[18:42:45.221] Build status: STARTED
[18:42:45.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:44:0) after 3m32s
[18:46:17.242] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:44:0)
[18:46:17.259] Build status: STARTED
[18:46:17.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:45:0) after 4m51s
[18:51:08.288] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:45:0)
[18:51:08.325] Build status: STARTED
[18:51:08.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:46:0) after 5m11s
[18:56:19.346] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:46:0)
[18:56:19.363] Build status: STARTED
[18:56:19.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:47:0) after 6m47s
[19:03:06.383] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:47:0)
[19:03:06.412] Build status: STARTED
[19:03:06.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:48:0) after 8m40s
[19:11:46.436] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:48:0)
[19:11:46.461] Build status: STARTED
[19:11:46.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:49:0) after 6m37s
[19:18:23.479] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:49:0)
[19:18:23.495] Build status: STARTED
[19:18:23.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:50:0) after 6m30s
[19:24:53.569] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:50:0)
[19:24:53.589] Build status: STARTED
[19:24:53.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8924073177775547184:51:0) after 8m49s
[19:25:53.500] Received PubSub notification, asking Buildbucket for the build status
[19:25:53.527] Build:
{
"id": "8758643115900405585",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 19108,
"createdBy": "project:chromium",
"createTime": "2024-01-17T15:07:16.005549551Z",
"startTime": "2024-01-17T15:07:16.907625Z",
"endTime": "2024-01-17T19:25:52.561871Z",
"updateTime": "2024-01-17T19:25:52.561871Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "43370bea081ca465815107bb85856ee193623607",
"ref": "refs/heads/main"
}
}
}
[19:25:53.527] Invocation finished in 4h18m38.69425357s with status FAILED