[05:25:16.550] New invocation is queued and will start shortly
[05:25:17.761] Starting the invocation (attempt 1)
[05:25:17.799] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/793d3a0521418985718f3bac3490e2fa8c15b2a6"
[05:25:17.799] Popped gitiles commit info from properties and tags
[05:25:17.799] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:25:17.799] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:25:17.799] Buildbucket request:
{
"requestId": "8973485138953822960",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "793d3a0521418985718f3bac3490e2fa8c15b2a6",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8973485138953822960"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[05:25:18.316] Scheduled build:
{
"id": "8808055076903721937",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 13587,
"createdBy": "project:chromium",
"createTime": "2022-07-21T05:25:17.873516042Z",
"updateTime": "2022-07-21T05:25:17.873516042Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "793d3a0521418985718f3bac3490e2fa8c15b2a6",
"ref": "refs/heads/main"
}
}
}
[05:25:18.316] Task URL: https://cr-buildbucket.appspot.com/build/8808055076903721937
[05:25:18.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:2:0) after 4m3s
[05:26:54.514] Received PubSub notification, asking Buildbucket for the build status
[05:26:54.536] Build status: STARTED
[05:29:21.363] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:2:0)
[05:29:21.394] Build status: STARTED
[05:29:21.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:4:0) after 6m37s
[05:35:58.623] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:4:0)
[05:35:58.643] Build status: STARTED
[05:35:58.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:5:0) after 2m19s
[05:38:17.664] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:5:0)
[05:38:17.682] Build status: STARTED
[05:38:17.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:6:0) after 6m33s
[05:44:50.703] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:6:0)
[05:44:50.820] Build status: STARTED
[05:44:50.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:7:0) after 4m48s
[05:49:38.939] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:7:0)
[05:49:38.958] Build status: STARTED
[05:49:38.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:8:0) after 4m3s
[05:53:42.061] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:8:0)
[05:53:42.086] Build status: STARTED
[05:53:42.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:9:0) after 3m2s
[05:56:44.157] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:9:0)
[05:56:44.176] Build status: STARTED
[05:56:44.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:10:0) after 8m28s
[06:05:12.285] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:10:0)
[06:05:12.305] Build status: STARTED
[06:05:12.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:11:0) after 4m58s
[06:10:10.602] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:11:0)
[06:10:10.654] Build status: STARTED
[06:10:10.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:12:0) after 6m51s
[06:17:01.749] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:12:0)
[06:17:01.777] Build status: STARTED
[06:17:01.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:13:0) after 6m9s
[06:23:10.809] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:13:0)
[06:23:10.831] Build status: STARTED
[06:23:10.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:14:0) after 8m28s
[06:31:38.851] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:14:0)
[06:31:38.870] Build status: STARTED
[06:31:38.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:15:0) after 5m25s
[06:37:03.986] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:15:0)
[06:37:04.008] Build status: STARTED
[06:37:04.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:16:0) after 3m13s
[06:40:17.233] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:16:0)
[06:40:17.260] Build status: STARTED
[06:40:17.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:17:0) after 9m19s
[06:49:36.287] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:17:0)
[06:49:36.326] Build status: STARTED
[06:49:36.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:18:0) after 7m30s
[06:57:06.690] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:18:0)
[06:57:06.712] Build status: STARTED
[06:57:06.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:19:0) after 1m48s
[06:58:54.845] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:19:0)
[06:58:54.874] Build status: STARTED
[06:58:54.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:20:0) after 6m29s
[07:05:23.894] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:20:0)
[07:05:23.915] Build status: STARTED
[07:05:23.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:21:0) after 5m54s
[07:11:18.018] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:21:0)
[07:11:18.047] Build status: STARTED
[07:11:18.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:22:0) after 4m40s
[07:15:58.166] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:22:0)
[07:15:58.197] Build status: STARTED
[07:15:58.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:23:0) after 8m21s
[07:24:19.232] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:23:0)
[07:24:19.271] Build status: STARTED
[07:24:19.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:24:0) after 2m57s
[07:27:16.552] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:24:0)
[07:27:16.579] Build status: STARTED
[07:27:16.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:25:0) after 1m25s
[07:28:41.643] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:25:0)
[07:28:41.668] Build status: STARTED
[07:28:41.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:26:0) after 8m18s
[07:36:59.707] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:26:0)
[07:36:59.754] Build status: STARTED
[07:36:59.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:27:0) after 6m13s
[07:43:12.781] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:27:0)
[07:43:12.815] Build status: STARTED
[07:43:12.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:28:0) after 3m1s
[07:46:13.954] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:28:0)
[07:46:14.001] Build status: STARTED
[07:46:14.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:29:0) after 9m51s
[07:56:05.033] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:29:0)
[07:56:05.075] Build status: STARTED
[07:56:05.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:30:0) after 1m21s
[07:57:26.138] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:30:0)
[07:57:26.172] Build status: STARTED
[07:57:26.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:31:0) after 2m35s
[08:00:01.408] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:31:0)
[08:00:01.443] Build status: STARTED
[08:00:01.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:32:0) after 5m42s
[08:05:43.463] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:32:0)
[08:05:43.495] Build status: STARTED
[08:05:43.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:33:0) after 8m30s
[08:14:13.619] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:33:0)
[08:14:13.643] Build status: STARTED
[08:14:13.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:34:0) after 8m7s
[08:22:20.749] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:34:0)
[08:22:20.840] Build status: STARTED
[08:22:20.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:35:0) after 8m35s
[08:30:56.021] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:35:0)
[08:30:56.042] Build status: STARTED
[08:30:56.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:36:0) after 9m59s
[08:40:55.194] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:36:0)
[08:40:55.218] Build status: STARTED
[08:40:55.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:37:0) after 3m27s
[08:44:22.238] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:37:0)
[08:44:22.342] Build status: STARTED
[08:44:22.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:38:0) after 3m32s
[08:47:54.385] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:38:0)
[08:47:54.420] Build status: STARTED
[08:47:54.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:39:0) after 6m13s
[08:54:07.442] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:39:0)
[08:54:07.468] Build status: STARTED
[08:54:07.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:40:0) after 1m49s
[08:55:56.640] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:40:0)
[08:55:56.670] Build status: STARTED
[08:55:56.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:41:0) after 8m21s
[09:04:17.704] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:41:0)
[09:04:17.731] Build status: STARTED
[09:04:17.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:42:0) after 4m0s
[09:08:17.850] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:42:0)
[09:08:17.874] Build status: STARTED
[09:08:17.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:43:0) after 6m1s
[09:14:18.893] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:43:0)
[09:14:18.958] Build status: STARTED
[09:14:18.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:44:0) after 5m54s
[09:20:13.054] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:44:0)
[09:20:13.077] Build status: STARTED
[09:20:13.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:45:0) after 7m30s
[09:27:43.184] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:45:0)
[09:27:43.217] Build status: STARTED
[09:27:43.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:46:0) after 3m55s
[09:31:38.250] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:46:0)
[09:31:38.289] Build status: STARTED
[09:31:38.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:47:0) after 8m23s
[09:40:01.311] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:47:0)
[09:40:01.333] Build status: STARTED
[09:40:01.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:48:0) after 6m48s
[09:46:49.355] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:48:0)
[09:46:49.392] Build status: STARTED
[09:46:49.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:49:0) after 7m41s
[09:54:30.602] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:49:0)
[09:54:30.722] Build status: STARTED
[09:54:30.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:50:0) after 8m35s
[10:03:05.745] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:50:0)
[10:03:05.818] Build status: STARTED
[10:03:05.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8973485138953822960:51:0) after 9m58s
[10:06:02.786] Received PubSub notification, asking Buildbucket for the build status
[10:06:02.816] Build:
{
"id": "8808055076903721937",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 13587,
"createdBy": "project:chromium",
"createTime": "2022-07-21T05:25:17.873516042Z",
"startTime": "2022-07-21T05:26:28.123412Z",
"endTime": "2022-07-21T10:06:02.271965396Z",
"updateTime": "2022-07-21T10:06:02.271965396Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "793d3a0521418985718f3bac3490e2fa8c15b2a6",
"ref": "refs/heads/main"
}
}
}
[10:06:02.816] Invocation finished in 4h40m46.282320913s with status FAILED