[07:19:32.494] New invocation is queued and will start shortly
[07:19:33.598] Starting the invocation (attempt 1)
[07:19:33.623] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e6e6af6d15788de362e5c081b3f6638955e43e4a"
[07:19:33.623] Popped gitiles commit info from properties and tags
[07:19:33.623] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[07:19:33.623] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[07:19:33.623] Buildbucket request:
{
"requestId": "8923015439678827008",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e6e6af6d15788de362e5c081b3f6638955e43e4a",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8923015439678827008"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[07:19:34.755] Scheduled build:
{
"id": "8757585377726791537",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 19336,
"createdBy": "project:chromium",
"createTime": "2024-01-29T07:19:33.735446789Z",
"updateTime": "2024-01-29T07:19:33.735446789Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e6e6af6d15788de362e5c081b3f6638955e43e4a",
"ref": "refs/heads/main"
}
}
}
[07:19:34.755] Task URL: https://cr-buildbucket.appspot.com/build/8757585377726791537
[07:19:34.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:2:0) after 2m27s
[07:19:35.431] Received PubSub notification, asking Buildbucket for the build status
[07:19:35.449] Build status: SCHEDULED
[07:20:38.694] Received PubSub notification, asking Buildbucket for the build status
[07:20:38.717] Build status: STARTED
[07:22:01.787] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:2:0)
[07:22:01.808] Build status: STARTED
[07:22:01.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:5:0) after 1m22s
[07:23:23.925] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:5:0)
[07:23:24.009] Build status: STARTED
[07:23:24.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:6:0) after 7m47s
[07:31:11.110] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:6:0)
[07:31:11.127] Build status: STARTED
[07:31:11.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:7:0) after 6m38s
[07:37:49.154] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:7:0)
[07:37:49.184] Build status: STARTED
[07:37:49.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:8:0) after 6m43s
[07:44:32.207] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:8:0)
[07:44:32.239] Build status: STARTED
[07:44:32.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:9:0) after 7m47s
[07:52:19.335] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:9:0)
[07:52:19.353] Build status: STARTED
[07:52:19.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:10:0) after 6m32s
[07:58:51.368] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:10:0)
[07:58:51.388] Build status: STARTED
[07:58:51.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:11:0) after 9m40s
[08:08:31.443] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:11:0)
[08:08:31.464] Build status: STARTED
[08:08:31.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:12:0) after 5m35s
[08:14:06.482] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:12:0)
[08:14:06.500] Build status: STARTED
[08:14:06.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:13:0) after 6m33s
[08:20:39.522] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:13:0)
[08:20:39.557] Build status: STARTED
[08:20:39.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:14:0) after 8m58s
[08:29:37.579] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:14:0)
[08:29:37.604] Build status: STARTED
[08:29:37.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:15:0) after 4m11s
[08:33:48.633] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:15:0)
[08:33:48.651] Build status: STARTED
[08:33:48.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:16:0) after 1m0s
[08:34:48.669] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:16:0)
[08:34:48.685] Build status: STARTED
[08:34:48.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:17:0) after 3m45s
[08:38:33.713] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:17:0)
[08:38:33.827] Build status: STARTED
[08:38:33.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:18:0) after 6m18s
[08:44:51.876] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:18:0)
[08:44:51.896] Build status: STARTED
[08:44:51.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:19:0) after 2m43s
[08:47:35.055] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:19:0)
[08:47:35.086] Build status: STARTED
[08:47:35.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:20:0) after 9m46s
[08:57:21.332] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:20:0)
[08:57:21.352] Build status: STARTED
[08:57:21.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:21:0) after 1m51s
[08:59:12.678] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:21:0)
[08:59:12.697] Build status: STARTED
[08:59:12.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:22:0) after 2m6s
[09:01:18.869] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:22:0)
[09:01:18.947] Build status: STARTED
[09:01:18.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:23:0) after 2m5s
[09:03:24.248] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:23:0)
[09:03:24.338] Build status: STARTED
[09:03:24.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:24:0) after 7m47s
[09:11:11.599] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:24:0)
[09:11:11.673] Build status: STARTED
[09:11:11.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:25:0) after 2m0s
[09:13:11.803] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:25:0)
[09:13:11.824] Build status: STARTED
[09:13:11.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:26:0) after 3m26s
[09:16:37.946] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:26:0)
[09:16:37.964] Build status: STARTED
[09:16:37.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:27:0) after 5m0s
[09:21:37.987] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:27:0)
[09:21:38.009] Build status: STARTED
[09:21:38.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:28:0) after 1m22s
[09:23:00.093] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:28:0)
[09:23:00.112] Build status: STARTED
[09:23:00.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:29:0) after 7m25s
[09:30:25.297] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:29:0)
[09:30:25.317] Build status: STARTED
[09:30:25.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:30:0) after 8m45s
[09:39:10.357] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:30:0)
[09:39:10.403] Build status: STARTED
[09:39:10.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:31:0) after 6m26s
[09:45:36.640] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:31:0)
[09:45:36.661] Build status: STARTED
[09:45:36.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:32:0) after 7m48s
[09:53:24.801] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:32:0)
[09:53:24.899] Build status: STARTED
[09:53:24.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:33:0) after 2m55s
[09:56:20.009] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:33:0)
[09:56:20.025] Build status: STARTED
[09:56:20.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:34:0) after 6m0s
[10:02:20.084] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:34:0)
[10:02:20.111] Build status: STARTED
[10:02:20.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:35:0) after 2m7s
[10:04:27.131] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:35:0)
[10:04:27.154] Build status: STARTED
[10:04:27.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:36:0) after 7m0s
[10:11:27.272] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:36:0)
[10:11:27.291] Build status: STARTED
[10:11:27.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:37:0) after 5m54s
[10:17:21.386] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:37:0)
[10:17:21.429] Build status: STARTED
[10:17:21.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:38:0) after 8m44s
[10:26:05.474] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:38:0)
[10:26:05.489] Build status: STARTED
[10:26:05.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:39:0) after 5m57s
[10:32:02.522] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:39:0)
[10:32:02.572] Build status: STARTED
[10:32:02.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:40:0) after 8m0s
[10:40:02.679] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:40:0)
[10:40:02.723] Build status: STARTED
[10:40:02.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:41:0) after 9m15s
[10:49:17.741] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:41:0)
[10:49:17.758] Build status: STARTED
[10:49:17.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923015439678827008:42:0) after 9m4s
[10:53:46.237] Received PubSub notification, asking Buildbucket for the build status
[10:53:46.267] Build:
{
"id": "8757585377726791537",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 19336,
"createdBy": "project:chromium",
"createTime": "2024-01-29T07:19:33.735446789Z",
"startTime": "2024-01-29T07:20:37.883516Z",
"endTime": "2024-01-29T10:53:45.577053Z",
"updateTime": "2024-01-29T10:53:45.577053Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e6e6af6d15788de362e5c081b3f6638955e43e4a",
"ref": "refs/heads/main"
}
}
}
[10:53:46.267] Invocation finished in 3h34m13.77811492s with status FAILED