[18:12:24.678] New invocation is queued and will start shortly
[18:12:25.785] Starting the invocation (attempt 1)
[18:12:25.819] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/7380e4140a094a15b7c7de7cc32c5ccdab44f2e9"
[18:12:25.819] Popped gitiles commit info from properties and tags
[18:12:25.819] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:12:25.819] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:12:25.819] Buildbucket request:
{
"requestId": "8932305852335533088",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7380e4140a094a15b7c7de7cc32c5ccdab44f2e9",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8932305852335533088"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:12:26.929] Scheduled build:
{
"id": "8766875790276860017",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 18010,
"createdBy": "project:chromium",
"createTime": "2023-10-18T18:12:25.897018091Z",
"updateTime": "2023-10-18T18:12:25.897018091Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7380e4140a094a15b7c7de7cc32c5ccdab44f2e9",
"ref": "refs/heads/main"
}
}
}
[18:12:26.929] Task URL: https://cr-buildbucket.appspot.com/build/8766875790276860017
[18:12:26.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:2:0) after 8m7s
[18:12:27.658] Received PubSub notification, asking Buildbucket for the build status
[18:12:27.685] Build status: SCHEDULED
[18:12:44.397] Received PubSub notification, asking Buildbucket for the build status
[18:12:44.436] Build status: STARTED
[18:20:33.954] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:2:0)
[18:20:33.986] Build status: STARTED
[18:20:33.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:5:0) after 3m8s
[18:23:42.014] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:5:0)
[18:23:42.044] Build status: STARTED
[18:23:42.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:6:0) after 5m16s
[18:28:58.067] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:6:0)
[18:28:58.106] Build status: STARTED
[18:28:58.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:7:0) after 6m44s
[18:35:42.411] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:7:0)
[18:35:42.443] Build status: STARTED
[18:35:42.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:8:0) after 3m51s
[18:39:33.472] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:8:0)
[18:39:33.630] Build status: STARTED
[18:39:33.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:9:0) after 9m50s
[18:49:23.612] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:9:0)
[18:49:23.645] Build status: STARTED
[18:49:23.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:10:0) after 9m49s
[18:59:12.668] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:10:0)
[18:59:12.788] Build status: STARTED
[18:59:12.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:11:0) after 7m24s
[19:06:36.836] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:11:0)
[19:06:36.856] Build status: STARTED
[19:06:36.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:12:0) after 1m25s
[19:08:01.878] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:12:0)
[19:08:01.895] Build status: STARTED
[19:08:01.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:13:0) after 3m0s
[19:11:01.967] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:13:0)
[19:11:01.993] Build status: STARTED
[19:11:01.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:14:0) after 3m14s
[19:14:16.150] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:14:0)
[19:14:16.207] Build status: STARTED
[19:14:16.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:15:0) after 7m25s
[19:21:41.600] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:15:0)
[19:21:41.621] Build status: STARTED
[19:21:41.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:16:0) after 6m25s
[19:28:07.261] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:16:0)
[19:28:07.277] Build status: STARTED
[19:28:07.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:17:0) after 9m50s
[19:37:58.158] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:17:0)
[19:37:58.179] Build status: STARTED
[19:37:58.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:18:0) after 2m22s
[19:40:20.445] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:18:0)
[19:40:20.463] Build status: STARTED
[19:40:20.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:19:0) after 9m25s
[19:49:45.652] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:19:0)
[19:49:45.701] Build status: STARTED
[19:49:45.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:20:0) after 2m12s
[19:51:57.705] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:20:0)
[19:51:57.727] Build status: STARTED
[19:51:57.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:21:0) after 4m50s
[19:56:47.934] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:21:0)
[19:56:47.954] Build status: STARTED
[19:56:47.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:22:0) after 7m47s
[20:04:34.968] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:22:0)
[20:04:34.998] Build status: STARTED
[20:04:34.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:23:0) after 7m33s
[20:12:08.057] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:23:0)
[20:12:08.095] Build status: STARTED
[20:12:08.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:24:0) after 9m7s
[20:21:15.380] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:24:0)
[20:21:15.422] Build status: STARTED
[20:21:15.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:25:0) after 8m57s
[20:30:12.523] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:25:0)
[20:30:12.551] Build status: STARTED
[20:30:12.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:26:0) after 8m52s
[20:39:04.578] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:26:0)
[20:39:04.596] Build status: STARTED
[20:39:04.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:27:0) after 3m12s
[20:42:16.630] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:27:0)
[20:42:16.648] Build status: STARTED
[20:42:16.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:28:0) after 3m33s
[20:45:49.679] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:28:0)
[20:45:49.700] Build status: STARTED
[20:45:49.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:29:0) after 4m12s
[20:50:01.854] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:29:0)
[20:50:01.870] Build status: STARTED
[20:50:01.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:30:0) after 8m4s
[20:58:05.902] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:30:0)
[20:58:05.922] Build status: STARTED
[20:58:05.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:31:0) after 7m16s
[21:05:21.932] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:31:0)
[21:05:22.188] Build status: STARTED
[21:05:22.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:32:0) after 8m47s
[21:14:09.273] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:32:0)
[21:14:09.290] Build status: STARTED
[21:14:09.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:33:0) after 7m5s
[21:21:14.318] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:33:0)
[21:21:14.339] Build status: STARTED
[21:21:14.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:34:0) after 2m49s
[21:24:03.463] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:34:0)
[21:24:03.487] Build status: STARTED
[21:24:03.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:35:0) after 3m31s
[21:27:34.619] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:35:0)
[21:27:34.636] Build status: STARTED
[21:27:34.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:36:0) after 4m11s
[21:31:46.382] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:36:0)
[21:31:46.456] Build status: STARTED
[21:31:46.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932305852335533088:37:0) after 7m0s
[21:37:15.244] Received PubSub notification, asking Buildbucket for the build status
[21:37:15.268] Build:
{
"id": "8766875790276860017",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 18010,
"createdBy": "project:chromium",
"createTime": "2023-10-18T18:12:25.897018091Z",
"startTime": "2023-10-18T18:12:43.219247Z",
"endTime": "2023-10-18T21:36:17.563483846Z",
"updateTime": "2023-10-18T21:36:17.563483846Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7380e4140a094a15b7c7de7cc32c5ccdab44f2e9",
"ref": "refs/heads/main"
}
}
}
[21:37:15.268] Invocation finished in 3h24m50.718056306s with status FAILED