[21:03:29.291] New invocation is queued and will start shortly
[21:03:30.527] Starting the invocation (attempt 1)
[21:03:30.559] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/cc1f7095744b445040ccaad000639d0fb00c0626"
[21:03:30.559] Popped gitiles commit info from properties and tags
[21:03:30.560] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:03:30.561] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:03:30.562] Buildbucket request:
{
"requestId": "8932204492013026784",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cc1f7095744b445040ccaad000639d0fb00c0626",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8932204492013026784"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:03:31.296] Scheduled build:
{
"id": "8766774429957772865",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 18019,
"createdBy": "project:chromium",
"createTime": "2023-10-19T21:03:30.630770283Z",
"updateTime": "2023-10-19T21:03:30.630770283Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cc1f7095744b445040ccaad000639d0fb00c0626",
"ref": "refs/heads/main"
}
}
}
[21:03:31.296] Task URL: https://cr-buildbucket.appspot.com/build/8766774429957772865
[21:03:31.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:2:0) after 9m47s
[21:03:32.221] Received PubSub notification, asking Buildbucket for the build status
[21:03:32.256] Build status: SCHEDULED
[21:05:54.940] Received PubSub notification, asking Buildbucket for the build status
[21:05:54.964] Build status: STARTED
[21:13:18.604] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:2:0)
[21:13:18.628] Build status: STARTED
[21:13:18.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:5:0) after 6m47s
[21:20:05.797] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:5:0)
[21:20:05.832] Build status: STARTED
[21:20:05.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:6:0) after 9m2s
[21:29:07.934] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:6:0)
[21:29:07.962] Build status: STARTED
[21:29:07.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:7:0) after 6m32s
[21:35:40.417] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:7:0)
[21:35:40.440] Build status: STARTED
[21:35:40.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:8:0) after 8m16s
[21:43:56.492] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:8:0)
[21:43:56.581] Build status: STARTED
[21:43:56.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:9:0) after 8m35s
[21:52:31.929] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:9:0)
[21:52:31.950] Build status: STARTED
[21:52:31.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:10:0) after 2m23s
[21:54:54.980] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:10:0)
[21:54:55.025] Build status: STARTED
[21:54:55.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:11:0) after 8m27s
[22:03:22.684] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:11:0)
[22:03:22.706] Build status: STARTED
[22:03:22.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:12:0) after 8m58s
[22:12:20.860] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:12:0)
[22:12:20.955] Build status: STARTED
[22:12:20.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:13:0) after 3m59s
[22:16:20.007] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:13:0)
[22:16:20.025] Build status: STARTED
[22:16:20.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:14:0) after 5m22s
[22:21:42.052] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:14:0)
[22:21:42.071] Build status: STARTED
[22:21:42.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:15:0) after 5m6s
[22:26:48.132] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:15:0)
[22:26:48.175] Build status: STARTED
[22:26:48.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:16:0) after 3m3s
[22:29:51.346] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:16:0)
[22:29:51.376] Build status: STARTED
[22:29:51.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:17:0) after 1m29s
[22:31:20.430] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:17:0)
[22:31:20.448] Build status: STARTED
[22:31:20.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:18:0) after 9m13s
[22:40:33.498] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:18:0)
[22:40:33.522] Build status: STARTED
[22:40:33.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:19:0) after 7m9s
[22:47:42.763] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:19:0)
[22:47:42.784] Build status: STARTED
[22:47:42.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:20:0) after 1m30s
[22:49:13.413] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:20:0)
[22:49:13.488] Build status: STARTED
[22:49:13.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:21:0) after 8m59s
[22:58:12.509] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:21:0)
[22:58:12.526] Build status: STARTED
[22:58:12.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:22:0) after 6m55s
[23:05:07.893] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:22:0)
[23:05:07.924] Build status: STARTED
[23:05:07.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:23:0) after 6m13s
[23:11:20.945] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:23:0)
[23:11:20.962] Build status: STARTED
[23:11:20.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:24:0) after 2m18s
[23:13:38.983] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:24:0)
[23:13:39.011] Build status: STARTED
[23:13:39.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:25:0) after 7m48s
[23:21:27.041] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:25:0)
[23:21:27.081] Build status: STARTED
[23:21:27.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:26:0) after 1m33s
[23:23:00.180] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:26:0)
[23:23:00.256] Build status: STARTED
[23:23:00.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:27:0) after 8m35s
[23:31:35.256] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:27:0)
[23:31:35.275] Build status: STARTED
[23:31:35.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:28:0) after 2m14s
[23:33:50.320] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:28:0)
[23:33:50.341] Build status: STARTED
[23:33:50.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:29:0) after 2m44s
[23:36:34.599] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:29:0)
[23:36:34.625] Build status: STARTED
[23:36:34.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:30:0) after 3m42s
[23:40:16.962] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:30:0)
[23:40:16.994] Build status: STARTED
[23:40:16.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:31:0) after 8m30s
[23:48:47.080] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:31:0)
[23:48:47.103] Build status: STARTED
[23:48:47.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:32:0) after 1m53s
[23:50:40.246] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:32:0)
[23:50:40.266] Build status: STARTED
[23:50:40.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:33:0) after 2m9s
[23:52:49.285] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:33:0)
[23:52:49.301] Build status: STARTED
[23:52:49.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:34:0) after 4m15s
[23:57:04.494] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:34:0)
[23:57:04.526] Build status: STARTED
[23:57:04.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:35:0) after 3m46s
[00:00:50.661] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:35:0)
[00:00:50.694] Build status: STARTED
[00:00:50.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:36:0) after 4m30s
[00:05:20.879] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:36:0)
[00:05:20.901] Build status: STARTED
[00:05:20.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:37:0) after 1m55s
[00:07:15.938] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:37:0)
[00:07:15.963] Build status: STARTED
[00:07:15.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:38:0) after 2m7s
[00:09:22.984] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:38:0)
[00:09:23.011] Build status: STARTED
[00:09:23.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:39:0) after 1m9s
[00:10:32.141] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:39:0)
[00:10:32.159] Build status: STARTED
[00:10:32.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:40:0) after 3m35s
[00:14:07.308] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:40:0)
[00:14:07.335] Build status: STARTED
[00:14:07.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:41:0) after 2m55s
[00:17:02.373] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:41:0)
[00:17:02.390] Build status: STARTED
[00:17:02.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:42:0) after 3m45s
[00:20:47.719] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:42:0)
[00:20:47.738] Build status: STARTED
[00:20:47.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8932204492013026784:43:0) after 9m11s
[00:20:49.576] Received PubSub notification, asking Buildbucket for the build status
[00:20:49.600] Build:
{
"id": "8766774429957772865",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 18019,
"createdBy": "project:chromium",
"createTime": "2023-10-19T21:03:30.630770283Z",
"startTime": "2023-10-19T21:05:50.333290Z",
"endTime": "2023-10-20T00:20:49.071560963Z",
"updateTime": "2023-10-20T00:20:49.071560963Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cc1f7095744b445040ccaad000639d0fb00c0626",
"ref": "refs/heads/main"
}
}
}
[00:20:49.600] Invocation finished in 3h17m20.314014293s with status FAILED