[19:14:52.719] New invocation is queued and will start shortly
[19:14:53.759] Starting the invocation (attempt 1)
[19:14:53.785] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/1fa4dce1f591f33a9e855f15dbd1fa5292430c60"
[19:14:53.785] Popped gitiles commit info from properties and tags
[19:14:53.785] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:14:53.786] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:14:53.786] Buildbucket request:
{
"requestId": "8900230596004048752",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1fa4dce1f591f33a9e855f15dbd1fa5292430c60",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8900230596004048752"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:14:54.467] Scheduled build:
{
"id": "8734800534169247937",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 23014,
"createdBy": "project:chromium",
"createTime": "2024-10-06T19:14:53.839843142Z",
"updateTime": "2024-10-06T19:14:53.839843142Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1fa4dce1f591f33a9e855f15dbd1fa5292430c60",
"ref": "refs/heads/main"
}
}
}
[19:14:54.467] Task URL: https://cr-buildbucket.appspot.com/build/8734800534169247937
[19:14:54.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:2:0) after 6m15s
[19:14:55.470] Received PubSub notification, asking Buildbucket for the build status
[19:14:55.489] Build status: SCHEDULED
[19:16:09.253] Received PubSub notification, asking Buildbucket for the build status
[19:16:09.273] Build status: STARTED
[19:21:09.597] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:2:0)
[19:21:09.616] Build status: STARTED
[19:21:09.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:5:0) after 2m49s
[19:23:58.889] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:5:0)
[19:23:58.903] Build status: STARTED
[19:23:58.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:6:0) after 6m4s
[19:30:02.921] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:6:0)
[19:30:02.940] Build status: STARTED
[19:30:02.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:7:0) after 1m25s
[19:31:27.958] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:7:0)
[19:31:27.981] Build status: STARTED
[19:31:27.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:8:0) after 6m8s
[19:37:36.596] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:8:0)
[19:37:36.623] Build status: STARTED
[19:37:36.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:9:0) after 7m24s
[19:45:00.654] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:9:0)
[19:45:00.674] Build status: STARTED
[19:45:00.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:10:0) after 8m55s
[19:53:55.687] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:10:0)
[19:53:55.709] Build status: STARTED
[19:53:55.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:11:0) after 7m59s
[20:01:54.732] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:11:0)
[20:01:54.748] Build status: STARTED
[20:01:54.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:12:0) after 3m12s
[20:05:06.762] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:12:0)
[20:05:06.786] Build status: STARTED
[20:05:06.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:13:0) after 8m45s
[20:13:51.789] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:13:0)
[20:13:51.850] Build status: STARTED
[20:13:51.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:14:0) after 1m20s
[20:15:11.965] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:14:0)
[20:15:12.025] Build status: STARTED
[20:15:12.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:15:0) after 6m13s
[20:21:25.175] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:15:0)
[20:21:25.199] Build status: STARTED
[20:21:25.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:16:0) after 6m42s
[20:28:07.256] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:16:0)
[20:28:07.274] Build status: STARTED
[20:28:07.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:17:0) after 8m15s
[20:36:22.334] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:17:0)
[20:36:22.356] Build status: STARTED
[20:36:22.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:18:0) after 1m55s
[20:38:17.440] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:18:0)
[20:38:17.520] Build status: STARTED
[20:38:17.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:19:0) after 6m54s
[20:45:11.538] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:19:0)
[20:45:11.556] Build status: STARTED
[20:45:11.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:20:0) after 1m39s
[20:46:50.685] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:20:0)
[20:46:50.703] Build status: STARTED
[20:46:50.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:21:0) after 3m53s
[20:50:43.719] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:21:0)
[20:50:43.737] Build status: STARTED
[20:50:43.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:22:0) after 6m21s
[20:57:04.760] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:22:0)
[20:57:04.776] Build status: STARTED
[20:57:04.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:23:0) after 4m41s
[21:01:45.792] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:23:0)
[21:01:45.813] Build status: STARTED
[21:01:45.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:24:0) after 5m14s
[21:06:59.881] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:24:0)
[21:06:59.898] Build status: STARTED
[21:06:59.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:25:0) after 4m5s
[21:11:04.970] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:25:0)
[21:11:04.988] Build status: STARTED
[21:11:04.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:26:0) after 3m0s
[21:14:05.006] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:26:0)
[21:14:05.041] Build status: STARTED
[21:14:05.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:27:0) after 3m43s
[21:17:48.057] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:27:0)
[21:17:48.146] Build status: STARTED
[21:17:48.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:28:0) after 6m2s
[21:23:50.203] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:28:0)
[21:23:50.221] Build status: STARTED
[21:23:50.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:29:0) after 5m32s
[21:29:22.244] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:29:0)
[21:29:22.326] Build status: STARTED
[21:29:22.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:30:0) after 3m18s
[21:32:40.345] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:30:0)
[21:32:40.359] Build status: STARTED
[21:32:40.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:31:0) after 2m37s
[21:35:17.379] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:31:0)
[21:35:17.404] Build status: STARTED
[21:35:17.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:32:0) after 5m31s
[21:40:48.602] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:32:0)
[21:40:48.635] Build status: STARTED
[21:40:48.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:33:0) after 5m33s
[21:46:21.750] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:33:0)
[21:46:21.767] Build status: STARTED
[21:46:21.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:34:0) after 9m57s
[21:56:18.796] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:34:0)
[21:56:18.816] Build status: STARTED
[21:56:18.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:35:0) after 5m19s
[22:01:37.833] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:35:0)
[22:01:37.849] Build status: STARTED
[22:01:37.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:36:0) after 3m32s
[22:05:10.497] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:36:0)
[22:05:10.515] Build status: STARTED
[22:05:10.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:37:0) after 6m5s
[22:11:15.531] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:37:0)
[22:11:15.552] Build status: STARTED
[22:11:15.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:38:0) after 9m2s
[22:20:17.701] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:38:0)
[22:20:17.720] Build status: STARTED
[22:20:17.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:39:0) after 8m44s
[22:29:01.812] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:39:0)
[22:29:01.839] Build status: STARTED
[22:29:01.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:40:0) after 6m20s
[22:35:21.864] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:40:0)
[22:35:21.880] Build status: STARTED
[22:35:21.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:41:0) after 6m12s
[22:41:33.901] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:41:0)
[22:41:33.917] Build status: STARTED
[22:41:33.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:42:0) after 6m40s
[22:48:13.929] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:42:0)
[22:48:13.945] Build status: STARTED
[22:48:13.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:43:0) after 9m44s
[22:57:58.145] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:43:0)
[22:57:58.259] Build status: STARTED
[22:57:58.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:44:0) after 7m43s
[23:05:41.279] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:44:0)
[23:05:41.295] Build status: STARTED
[23:05:41.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:45:0) after 7m59s
[23:13:40.275] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:45:0)
[23:13:40.290] Build status: STARTED
[23:13:40.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:46:0) after 8m18s
[23:21:58.315] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:46:0)
[23:21:58.347] Build status: STARTED
[23:21:58.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:47:0) after 7m17s
[23:29:15.418] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:47:0)
[23:29:15.456] Build status: STARTED
[23:29:15.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:48:0) after 5m8s
[23:34:23.480] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:48:0)
[23:34:23.507] Build status: STARTED
[23:34:23.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900230596004048752:49:0) after 5m58s
[23:38:20.261] Received PubSub notification, asking Buildbucket for the build status
[23:38:20.277] Build:
{
"id": "8734800534169247937",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 23014,
"createdBy": "project:chromium",
"createTime": "2024-10-06T19:14:53.839843142Z",
"startTime": "2024-10-06T19:16:09.034243114Z",
"endTime": "2024-10-06T23:38:19.020232940Z",
"updateTime": "2024-10-06T23:38:19.020232940Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1fa4dce1f591f33a9e855f15dbd1fa5292430c60",
"ref": "refs/heads/main"
}
}
}
[23:38:20.277] Invocation finished in 4h23m27.571339211s with status FAILED