[19:04:39.496] New invocation is queued and will start shortly
[19:04:40.563] Starting the invocation (attempt 1)
[19:04:40.591] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/fd31fbc131121e2ca9b7cc48061e3100a36f8505"
[19:04:40.591] Popped gitiles commit info from properties and tags
[19:04:40.591] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:04:40.591] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:04:40.591] Buildbucket request:
{
"requestId": "8896879151258561664",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fd31fbc131121e2ca9b7cc48061e3100a36f8505",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8896879151258561664"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:04:41.209] Scheduled build:
{
"id": "8731449089375424881",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 23628,
"createdBy": "project:chromium",
"createTime": "2024-11-12T19:04:40.661447521Z",
"updateTime": "2024-11-12T19:04:40.661447521Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fd31fbc131121e2ca9b7cc48061e3100a36f8505",
"ref": "refs/heads/main"
}
}
}
[19:04:41.209] Task URL: https://cr-buildbucket.appspot.com/build/8731449089375424881
[19:04:41.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:2:0) after 8m53s
[19:04:42.215] Received PubSub notification, asking Buildbucket for the build status
[19:04:42.243] Build status: SCHEDULED
[19:06:18.359] Received PubSub notification, asking Buildbucket for the build status
[19:06:18.378] Build status: STARTED
[19:13:34.227] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:2:0)
[19:13:34.468] Build status: STARTED
[19:13:34.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:5:0) after 3m39s
[19:17:13.531] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:5:0)
[19:17:13.598] Build status: STARTED
[19:17:13.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:6:0) after 2m19s
[19:19:32.668] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:6:0)
[19:19:32.692] Build status: STARTED
[19:19:32.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:7:0) after 2m18s
[19:21:50.696] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:7:0)
[19:21:50.711] Build status: STARTED
[19:21:50.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:8:0) after 7m59s
[19:29:49.810] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:8:0)
[19:29:49.839] Build status: STARTED
[19:29:49.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:9:0) after 3m38s
[19:33:27.991] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:9:0)
[19:33:28.008] Build status: STARTED
[19:33:28.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:10:0) after 9m43s
[19:43:11.055] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:10:0)
[19:43:11.079] Build status: STARTED
[19:43:11.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:11:0) after 4m33s
[19:47:44.101] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:11:0)
[19:47:44.120] Build status: STARTED
[19:47:44.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:12:0) after 2m0s
[19:49:44.152] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:12:0)
[19:49:44.176] Build status: STARTED
[19:49:44.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:13:0) after 1m34s
[19:51:18.274] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:13:0)
[19:51:18.304] Build status: STARTED
[19:51:18.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:14:0) after 5m33s
[19:56:51.353] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:14:0)
[19:56:51.412] Build status: STARTED
[19:56:51.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:15:0) after 4m13s
[20:01:04.522] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:15:0)
[20:01:04.547] Build status: STARTED
[20:01:04.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:16:0) after 1m41s
[20:02:45.596] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:16:0)
[20:02:45.613] Build status: STARTED
[20:02:45.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:17:0) after 1m16s
[20:04:01.626] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:17:0)
[20:04:01.647] Build status: STARTED
[20:04:01.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:18:0) after 7m24s
[20:11:25.733] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:18:0)
[20:11:25.840] Build status: STARTED
[20:11:25.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:19:0) after 1m50s
[20:13:15.852] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:19:0)
[20:13:15.895] Build status: STARTED
[20:13:15.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:20:0) after 5m52s
[20:19:07.892] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:20:0)
[20:19:07.973] Build status: STARTED
[20:19:07.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:21:0) after 1m57s
[20:21:05.050] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:21:0)
[20:21:05.078] Build status: STARTED
[20:21:05.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:22:0) after 3m50s
[20:24:55.107] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:22:0)
[20:24:55.137] Build status: STARTED
[20:24:55.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:23:0) after 2m46s
[20:27:41.156] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:23:0)
[20:27:41.183] Build status: STARTED
[20:27:41.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:24:0) after 7m28s
[20:35:09.220] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:24:0)
[20:35:09.251] Build status: STARTED
[20:35:09.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:25:0) after 6m34s
[20:41:43.344] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:25:0)
[20:41:43.421] Build status: STARTED
[20:41:43.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:26:0) after 1m30s
[20:43:13.442] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:26:0)
[20:43:13.807] Build status: STARTED
[20:43:13.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:27:0) after 3m14s
[20:46:27.830] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:27:0)
[20:46:27.861] Build status: STARTED
[20:46:27.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:28:0) after 2m14s
[20:48:41.903] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:28:0)
[20:48:41.918] Build status: STARTED
[20:48:41.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:29:0) after 1m54s
[20:50:35.937] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:29:0)
[20:50:35.957] Build status: STARTED
[20:50:35.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:30:0) after 5m9s
[20:55:44.970] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:30:0)
[20:55:44.995] Build status: STARTED
[20:55:44.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:31:0) after 4m3s
[20:59:48.017] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:31:0)
[20:59:48.034] Build status: STARTED
[20:59:48.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:32:0) after 7m33s
[21:07:21.054] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:32:0)
[21:07:21.072] Build status: STARTED
[21:07:21.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:33:0) after 3m29s
[21:10:50.091] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:33:0)
[21:10:50.111] Build status: STARTED
[21:10:50.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:34:0) after 9m52s
[21:20:42.085] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:34:0)
[21:20:42.140] Build status: STARTED
[21:20:42.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:35:0) after 8m49s
[21:29:31.160] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:35:0)
[21:29:31.176] Build status: STARTED
[21:29:31.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:36:0) after 4m36s
[21:34:07.196] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:36:0)
[21:34:07.216] Build status: STARTED
[21:34:07.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:37:0) after 7m53s
[21:42:00.283] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:37:0)
[21:42:00.302] Build status: STARTED
[21:42:00.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:38:0) after 3m13s
[21:45:13.382] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:38:0)
[21:45:13.419] Build status: STARTED
[21:45:13.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:39:0) after 1m33s
[21:46:46.426] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:39:0)
[21:46:46.444] Build status: STARTED
[21:46:46.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:40:0) after 3m15s
[21:50:01.513] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:40:0)
[21:50:01.534] Build status: STARTED
[21:50:01.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:41:0) after 9m47s
[21:59:48.672] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:41:0)
[21:59:48.692] Build status: STARTED
[21:59:48.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:42:0) after 7m10s
[22:06:58.843] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:42:0)
[22:06:58.867] Build status: STARTED
[22:06:58.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:43:0) after 2m25s
[22:09:23.892] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:43:0)
[22:09:23.915] Build status: STARTED
[22:09:23.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8896879151258561664:44:0) after 1m7s
[22:09:38.699] Received PubSub notification, asking Buildbucket for the build status
[22:09:38.720] Build:
{
"id": "8731449089375424881",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 23628,
"createdBy": "project:chromium",
"createTime": "2024-11-12T19:04:40.661447521Z",
"startTime": "2024-11-12T19:06:18.076620215Z",
"endTime": "2024-11-12T22:09:38.382318492Z",
"updateTime": "2024-11-12T22:09:38.382318492Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fd31fbc131121e2ca9b7cc48061e3100a36f8505",
"ref": "refs/heads/main"
}
}
}
[22:09:38.720] Invocation finished in 3h4m59.237964027s with status FAILED