[05:50:53.263] New invocation is queued and will start shortly
[05:50:54.305] Starting the invocation (attempt 1)
[05:50:54.329] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/01f0fc37da6778c276ce0aa6eb78fe0d2f1c88dc"
[05:50:54.329] Popped gitiles commit info from properties and tags
[05:50:54.329] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:50:54.329] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:50:54.329] Buildbucket request:
{
"requestId": "8900643566602758592",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "01f0fc37da6778c276ce0aa6eb78fe0d2f1c88dc",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8900643566602758592"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[05:50:54.885] Scheduled build:
{
"id": "8735213504768030161",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 22972,
"createdBy": "project:chromium",
"createTime": "2024-10-02T05:50:54.385042762Z",
"updateTime": "2024-10-02T05:50:54.385042762Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "01f0fc37da6778c276ce0aa6eb78fe0d2f1c88dc",
"ref": "refs/heads/main"
}
}
}
[05:50:54.885] Task URL: https://cr-buildbucket.appspot.com/build/8735213504768030161
[05:50:54.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:2:0) after 8m28s
[05:50:55.789] Received PubSub notification, asking Buildbucket for the build status
[05:50:55.807] Build status: SCHEDULED
[05:51:54.527] Received PubSub notification, asking Buildbucket for the build status
[05:51:54.630] Build status: STARTED
[05:59:22.978] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:2:0)
[05:59:22.996] Build status: STARTED
[05:59:22.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:5:0) after 5m55s
[06:05:18.148] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:5:0)
[06:05:18.176] Build status: STARTED
[06:05:18.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:6:0) after 2m13s
[06:07:31.195] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:6:0)
[06:07:31.226] Build status: STARTED
[06:07:31.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:7:0) after 2m39s
[06:10:10.241] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:7:0)
[06:10:10.263] Build status: STARTED
[06:10:10.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:8:0) after 5m41s
[06:15:51.282] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:8:0)
[06:15:51.319] Build status: STARTED
[06:15:51.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:9:0) after 6m48s
[06:22:39.445] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:9:0)
[06:22:39.463] Build status: STARTED
[06:22:39.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:10:0) after 7m56s
[06:30:35.573] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:10:0)
[06:30:35.590] Build status: STARTED
[06:30:35.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:11:0) after 4m59s
[06:35:34.661] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:11:0)
[06:35:34.731] Build status: STARTED
[06:35:34.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:12:0) after 8m13s
[06:43:47.761] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:12:0)
[06:43:47.778] Build status: STARTED
[06:43:47.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:13:0) after 1m50s
[06:45:37.796] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:13:0)
[06:45:37.817] Build status: STARTED
[06:45:37.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:14:0) after 4m6s
[06:49:43.834] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:14:0)
[06:49:43.849] Build status: STARTED
[06:49:43.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:15:0) after 8m10s
[06:57:53.869] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:15:0)
[06:57:53.885] Build status: STARTED
[06:57:53.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:16:0) after 2m17s
[07:00:10.964] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:16:0)
[07:00:10.983] Build status: STARTED
[07:00:10.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:17:0) after 1m3s
[07:01:14.106] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:17:0)
[07:01:14.122] Build status: STARTED
[07:01:14.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:18:0) after 3m20s
[07:04:34.618] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:18:0)
[07:04:34.644] Build status: STARTED
[07:04:34.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:19:0) after 2m32s
[07:07:06.733] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:19:0)
[07:07:06.750] Build status: STARTED
[07:07:06.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:20:0) after 6m6s
[07:13:12.767] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:20:0)
[07:13:12.786] Build status: STARTED
[07:13:12.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:21:0) after 1m25s
[07:14:37.960] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:21:0)
[07:14:37.985] Build status: STARTED
[07:14:37.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:22:0) after 4m14s
[07:18:52.093] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:22:0)
[07:18:52.115] Build status: STARTED
[07:18:52.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:23:0) after 2m2s
[07:20:54.304] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:23:0)
[07:20:54.321] Build status: STARTED
[07:20:54.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:24:0) after 2m49s
[07:23:43.337] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:24:0)
[07:23:43.355] Build status: STARTED
[07:23:43.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:25:0) after 9m21s
[07:33:04.604] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:25:0)
[07:33:04.623] Build status: STARTED
[07:33:04.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:26:0) after 4m14s
[07:37:18.827] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:26:0)
[07:37:18.844] Build status: STARTED
[07:37:18.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:27:0) after 4m58s
[07:42:16.862] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:27:0)
[07:42:16.890] Build status: STARTED
[07:42:16.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:28:0) after 1m40s
[07:43:56.905] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:28:0)
[07:43:56.945] Build status: STARTED
[07:43:56.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:29:0) after 4m18s
[07:48:14.965] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:29:0)
[07:48:14.985] Build status: STARTED
[07:48:14.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:30:0) after 7m40s
[07:55:55.008] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:30:0)
[07:55:55.026] Build status: STARTED
[07:55:55.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:31:0) after 8m53s
[08:04:48.088] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:31:0)
[08:04:48.106] Build status: STARTED
[08:04:48.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:32:0) after 9m1s
[08:13:49.328] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:32:0)
[08:13:49.356] Build status: STARTED
[08:13:49.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:33:0) after 6m32s
[08:20:21.483] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:33:0)
[08:20:21.502] Build status: STARTED
[08:20:21.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:34:0) after 7m46s
[08:28:07.698] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:34:0)
[08:28:07.753] Build status: STARTED
[08:28:07.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:35:0) after 4m3s
[08:32:10.908] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:35:0)
[08:32:12.892] Build status: STARTED
[08:32:12.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:36:0) after 2m48s
[08:35:01.007] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:36:0)
[08:35:01.028] Build status: STARTED
[08:35:01.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:37:0) after 9m24s
[08:44:25.153] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:37:0)
[08:44:25.172] Build status: STARTED
[08:44:25.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:38:0) after 3m19s
[08:47:44.421] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:38:0)
[08:47:44.445] Build status: STARTED
[08:47:44.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:39:0) after 4m19s
[08:52:03.529] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:39:0)
[08:52:03.546] Build status: STARTED
[08:52:03.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:40:0) after 3m51s
[08:55:54.726] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:40:0)
[08:55:54.746] Build status: STARTED
[08:55:54.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:41:0) after 1m40s
[08:57:34.736] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:41:0)
[08:57:34.755] Build status: STARTED
[08:57:34.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:42:0) after 2m53s
[09:00:28.177] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:42:0)
[09:00:28.197] Build status: STARTED
[09:00:28.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:43:0) after 2m9s
[09:02:37.241] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:43:0)
[09:02:37.316] Build status: STARTED
[09:02:37.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:44:0) after 9m26s
[09:12:03.334] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:44:0)
[09:12:03.352] Build status: STARTED
[09:12:03.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:45:0) after 3m15s
[09:15:18.380] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:45:0)
[09:15:18.401] Build status: STARTED
[09:15:18.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:46:0) after 5m23s
[09:20:41.412] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:46:0)
[09:20:41.428] Build status: STARTED
[09:20:41.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:47:0) after 1m30s
[09:22:11.504] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:47:0)
[09:22:11.528] Build status: STARTED
[09:22:11.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:48:0) after 6m44s
[09:28:55.563] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:48:0)
[09:28:55.624] Build status: STARTED
[09:28:55.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:49:0) after 6m17s
[09:35:12.736] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:49:0)
[09:35:12.755] Build status: STARTED
[09:35:12.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:50:0) after 8m25s
[09:43:37.893] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:50:0)
[09:43:37.912] Build status: STARTED
[09:43:37.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:51:0) after 7m41s
[09:51:18.936] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:51:0)
[09:51:18.951] Build status: STARTED
[09:51:18.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:52:0) after 8m45s
[10:00:03.984] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:52:0)
[10:00:04.070] Build status: STARTED
[10:00:04.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:53:0) after 3m36s
[10:03:40.089] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:53:0)
[10:03:40.153] Build status: STARTED
[10:03:40.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:54:0) after 2m39s
[10:06:19.226] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:54:0)
[10:06:19.244] Build status: STARTED
[10:06:19.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:55:0) after 1m16s
[10:07:35.392] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:55:0)
[10:07:35.411] Build status: STARTED
[10:07:35.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:56:0) after 2m50s
[10:10:25.431] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:56:0)
[10:10:25.451] Build status: STARTED
[10:10:25.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900643566602758592:57:0) after 3m4s
[10:11:06.361] Received PubSub notification, asking Buildbucket for the build status
[10:11:06.433] Build:
{
"id": "8735213504768030161",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 22972,
"createdBy": "project:chromium",
"createTime": "2024-10-02T05:50:54.385042762Z",
"startTime": "2024-10-02T05:51:54.288727023Z",
"endTime": "2024-10-02T10:11:06.104916067Z",
"updateTime": "2024-10-02T10:11:06.104916067Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "01f0fc37da6778c276ce0aa6eb78fe0d2f1c88dc",
"ref": "refs/heads/main"
}
}
}
[10:11:06.433] Invocation finished in 4h20m13.180587313s with status FAILED