[02:13:46.106] New invocation is queued and will start shortly
[02:13:47.229] Starting the invocation (attempt 1)
[02:13:47.260] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/cb870773717136996f92e6f6dfe95d817323df5c"
[02:13:47.260] Popped gitiles commit info from properties and tags
[02:13:47.260] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:13:47.260] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:13:47.260] Buildbucket request:
{
"requestId": "8944324964368313680",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cb870773717136996f92e6f6dfe95d817323df5c",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8944324964368313680"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:13:47.662] Scheduled build:
{
"id": "8778894902436603185",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 16799,
"createdBy": "project:chromium",
"createTime": "2023-06-08T02:13:47.324092397Z",
"updateTime": "2023-06-08T02:13:47.324092397Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cb870773717136996f92e6f6dfe95d817323df5c",
"ref": "refs/heads/main"
}
}
}
[02:13:47.662] Task URL: https://cr-buildbucket.appspot.com/build/8778894902436603185
[02:13:47.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:2:0) after 3m45s
[02:16:18.583] Received PubSub notification, asking Buildbucket for the build status
[02:16:18.657] Build status: STARTED
[02:17:32.785] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:2:0)
[02:17:32.803] Build status: STARTED
[02:17:32.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:4:0) after 5m31s
[02:23:03.917] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:4:0)
[02:23:03.937] Build status: STARTED
[02:23:03.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:5:0) after 3m50s
[02:26:54.012] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:5:0)
[02:26:54.030] Build status: STARTED
[02:26:54.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:6:0) after 1m7s
[02:28:01.246] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:6:0)
[02:28:01.275] Build status: STARTED
[02:28:01.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:7:0) after 5m16s
[02:33:17.631] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:7:0)
[02:33:17.652] Build status: STARTED
[02:33:17.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:8:0) after 7m7s
[02:40:24.898] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:8:0)
[02:40:24.914] Build status: STARTED
[02:40:24.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:9:0) after 3m38s
[02:44:03.495] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:9:0)
[02:44:03.510] Build status: STARTED
[02:44:03.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:10:0) after 5m1s
[02:49:05.055] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:10:0)
[02:49:05.094] Build status: STARTED
[02:49:05.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:11:0) after 9m17s
[02:58:22.242] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:11:0)
[02:58:22.259] Build status: STARTED
[02:58:22.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:12:0) after 5m7s
[03:03:29.281] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:12:0)
[03:03:29.310] Build status: STARTED
[03:03:29.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:13:0) after 8m41s
[03:12:10.336] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:13:0)
[03:12:10.361] Build status: STARTED
[03:12:10.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:14:0) after 2m28s
[03:14:38.380] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:14:0)
[03:14:38.447] Build status: STARTED
[03:14:38.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:15:0) after 4m22s
[03:19:00.488] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:15:0)
[03:19:00.507] Build status: STARTED
[03:19:00.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:16:0) after 4m1s
[03:23:01.695] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:16:0)
[03:23:01.716] Build status: STARTED
[03:23:01.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:17:0) after 1m14s
[03:24:15.953] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:17:0)
[03:24:15.971] Build status: STARTED
[03:24:15.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:18:0) after 5m47s
[03:30:03.001] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:18:0)
[03:30:03.023] Build status: STARTED
[03:30:03.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:19:0) after 5m5s
[03:35:08.054] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:19:0)
[03:35:08.073] Build status: STARTED
[03:35:08.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:20:0) after 7m25s
[03:42:33.096] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:20:0)
[03:42:33.115] Build status: STARTED
[03:42:33.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:21:0) after 5m53s
[03:48:26.164] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:21:0)
[03:48:26.183] Build status: STARTED
[03:48:26.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:22:0) after 4m55s
[03:53:21.209] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:22:0)
[03:53:21.232] Build status: STARTED
[03:53:21.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:23:0) after 3m5s
[03:56:26.264] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:23:0)
[03:56:26.361] Build status: STARTED
[03:56:26.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:24:0) after 8m12s
[04:04:38.388] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:24:0)
[04:04:38.430] Build status: STARTED
[04:04:38.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:25:0) after 6m13s
[04:10:51.740] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:25:0)
[04:10:51.758] Build status: STARTED
[04:10:51.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:26:0) after 1m21s
[04:12:12.773] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:26:0)
[04:12:12.794] Build status: STARTED
[04:12:12.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:27:0) after 9m59s
[04:22:11.867] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:27:0)
[04:22:11.884] Build status: STARTED
[04:22:11.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:28:0) after 3m41s
[04:25:53.192] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:28:0)
[04:25:53.210] Build status: STARTED
[04:25:53.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:29:0) after 7m10s
[04:33:03.226] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:29:0)
[04:33:03.285] Build status: STARTED
[04:33:03.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:30:0) after 2m32s
[04:35:35.392] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:30:0)
[04:35:35.414] Build status: STARTED
[04:35:35.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:31:0) after 6m43s
[04:42:18.407] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:31:0)
[04:42:18.424] Build status: STARTED
[04:42:18.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:32:0) after 9m33s
[04:51:51.471] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:32:0)
[04:51:51.491] Build status: STARTED
[04:51:51.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:33:0) after 4m17s
[04:56:08.619] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:33:0)
[04:56:08.652] Build status: STARTED
[04:56:08.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:34:0) after 3m28s
[04:59:36.771] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:34:0)
[04:59:36.795] Build status: STARTED
[04:59:36.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:35:0) after 1m32s
[05:01:08.916] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:35:0)
[05:01:08.970] Build status: STARTED
[05:01:08.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:36:0) after 8m31s
[05:09:39.956] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:36:0)
[05:09:39.974] Build status: STARTED
[05:09:39.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:37:0) after 9m36s
[05:19:16.138] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:37:0)
[05:19:16.168] Build status: STARTED
[05:19:16.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:38:0) after 7m59s
[05:27:15.205] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:38:0)
[05:27:15.227] Build status: STARTED
[05:27:15.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:39:0) after 3m56s
[05:31:11.287] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:39:0)
[05:31:11.303] Build status: STARTED
[05:31:11.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:40:0) after 9m31s
[05:40:42.291] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:40:0)
[05:40:42.307] Build status: STARTED
[05:40:42.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:41:0) after 9m24s
[05:50:06.332] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:41:0)
[05:50:06.350] Build status: STARTED
[05:50:06.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:42:0) after 7m52s
[05:57:58.390] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:42:0)
[05:57:58.418] Build status: STARTED
[05:57:58.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:43:0) after 2m4s
[06:00:02.452] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:43:0)
[06:00:02.479] Build status: STARTED
[06:00:02.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:44:0) after 1m33s
[06:01:35.502] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:44:0)
[06:01:35.522] Build status: STARTED
[06:01:35.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:45:0) after 2m32s
[06:04:07.548] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:45:0)
[06:04:07.563] Build status: STARTED
[06:04:07.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:46:0) after 5m6s
[06:09:13.805] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:46:0)
[06:09:13.827] Build status: STARTED
[06:09:13.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:47:0) after 1m2s
[06:10:16.187] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:47:0)
[06:10:16.361] Build status: STARTED
[06:10:16.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:48:0) after 3m12s
[06:13:28.509] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:48:0)
[06:13:28.528] Build status: STARTED
[06:13:28.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:49:0) after 1m49s
[06:15:17.555] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:49:0)
[06:15:17.622] Build status: STARTED
[06:15:17.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:50:0) after 3m58s
[06:19:15.836] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:50:0)
[06:19:15.855] Build status: STARTED
[06:19:15.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:51:0) after 5m34s
[06:24:49.981] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:51:0)
[06:24:49.999] Build status: STARTED
[06:24:49.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:52:0) after 8m16s
[06:33:06.024] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:52:0)
[06:33:06.046] Build status: STARTED
[06:33:06.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:53:0) after 2m37s
[06:35:43.082] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:53:0)
[06:35:43.101] Build status: STARTED
[06:35:43.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:54:0) after 1m12s
[06:36:55.131] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:54:0)
[06:36:55.148] Build status: STARTED
[06:36:55.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:55:0) after 5m16s
[06:42:11.187] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:55:0)
[06:42:11.210] Build status: STARTED
[06:42:11.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:56:0) after 4m23s
[06:46:34.241] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:56:0)
[06:46:34.264] Build status: STARTED
[06:46:34.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:57:0) after 2m41s
[06:49:15.464] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:57:0)
[06:49:15.525] Build status: STARTED
[06:49:15.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:58:0) after 5m46s
[06:55:01.640] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:58:0)
[06:55:01.657] Build status: STARTED
[06:55:01.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:59:0) after 4m33s
[06:59:34.661] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:59:0)
[06:59:34.682] Build status: STARTED
[06:59:34.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:60:0) after 8m57s
[07:08:31.952] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:60:0)
[07:08:31.971] Build status: STARTED
[07:08:31.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:61:0) after 2m58s
[07:11:30.047] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:61:0)
[07:11:30.124] Build status: STARTED
[07:11:30.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:62:0) after 2m17s
[07:13:47.153] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:62:0)
[07:13:47.174] Build status: STARTED
[07:13:47.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:63:0) after 1m37s
[07:15:24.259] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:63:0)
[07:15:24.274] Build status: STARTED
[07:15:24.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:64:0) after 2m13s
[07:17:37.304] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:64:0)
[07:17:37.322] Build status: STARTED
[07:17:37.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:65:0) after 8m32s
[07:26:09.385] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:65:0)
[07:26:09.404] Build status: STARTED
[07:26:09.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:66:0) after 7m45s
[07:33:54.449] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:66:0)
[07:33:54.473] Build status: STARTED
[07:33:54.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:67:0) after 5m47s
[07:39:41.661] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:67:0)
[07:39:41.679] Build status: STARTED
[07:39:41.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:68:0) after 3m41s
[07:43:22.850] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:68:0)
[07:43:22.908] Build status: STARTED
[07:43:22.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:69:0) after 7m10s
[07:50:32.988] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:69:0)
[07:50:33.013] Build status: STARTED
[07:50:33.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:70:0) after 6m42s
[07:57:15.213] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:70:0)
[07:57:15.235] Build status: STARTED
[07:57:15.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:71:0) after 9m26s
[08:06:41.720] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:71:0)
[08:06:41.740] Build status: STARTED
[08:06:41.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:72:0) after 8m19s
[08:15:00.788] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:72:0)
[08:15:00.805] Build status: STARTED
[08:15:00.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:73:0) after 4m49s
[08:19:49.959] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:73:0)
[08:19:49.980] Build status: STARTED
[08:19:49.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:74:0) after 5m28s
[08:25:18.227] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:74:0)
[08:25:18.268] Build status: STARTED
[08:25:18.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:75:0) after 3m24s
[08:28:42.319] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:75:0)
[08:28:42.409] Build status: STARTED
[08:28:42.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:76:0) after 7m57s
[08:36:39.726] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:76:0)
[08:36:39.745] Build status: STARTED
[08:36:39.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:77:0) after 9m3s
[08:45:42.823] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:77:0)
[08:45:42.838] Build status: STARTED
[08:45:42.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:78:0) after 2m51s
[08:48:34.073] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:78:0)
[08:48:34.094] Build status: STARTED
[08:48:34.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:79:0) after 6m39s
[08:55:13.118] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:79:0)
[08:55:13.137] Build status: STARTED
[08:55:13.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:80:0) after 6m25s
[09:01:38.382] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:80:0)
[09:01:38.397] Build status: STARTED
[09:01:38.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:81:0) after 6m9s
[09:07:47.559] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:81:0)
[09:07:47.586] Build status: STARTED
[09:07:47.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:82:0) after 6m29s
[09:14:16.710] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:82:0)
[09:14:16.726] Build status: STARTED
[09:14:16.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:83:0) after 6m0s
[09:20:16.837] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:83:0)
[09:20:16.858] Build status: STARTED
[09:20:16.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:84:0) after 6m44s
[09:27:00.901] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:84:0)
[09:27:00.923] Build status: STARTED
[09:27:00.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:85:0) after 5m18s
[09:32:18.970] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:85:0)
[09:32:18.990] Build status: STARTED
[09:32:18.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:86:0) after 5m0s
[09:37:19.014] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:86:0)
[09:37:19.032] Build status: STARTED
[09:37:19.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:87:0) after 8m35s
[09:45:54.142] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:87:0)
[09:45:54.162] Build status: STARTED
[09:45:54.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:88:0) after 8m25s
[09:54:19.197] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:88:0)
[09:54:19.216] Build status: STARTED
[09:54:19.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:89:0) after 2m25s
[09:56:44.325] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:89:0)
[09:56:44.341] Build status: STARTED
[09:56:44.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:90:0) after 1m1s
[09:57:45.437] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:90:0)
[09:57:45.458] Build status: STARTED
[09:57:45.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:91:0) after 4m28s
[10:02:13.841] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:91:0)
[10:02:13.869] Build status: STARTED
[10:02:13.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:92:0) after 5m21s
[10:07:34.913] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:92:0)
[10:07:34.964] Build status: STARTED
[10:07:34.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:93:0) after 1m53s
[10:09:28.345] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:93:0)
[10:09:28.369] Build status: STARTED
[10:09:28.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:94:0) after 3m52s
[10:13:20.439] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:94:0)
[10:13:20.462] Build status: STARTED
[10:13:20.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:95:0) after 6m45s
[10:20:05.519] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:95:0)
[10:20:05.536] Build status: STARTED
[10:20:05.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:96:0) after 3m45s
[10:23:50.568] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:96:0)
[10:23:50.589] Build status: STARTED
[10:23:50.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:97:0) after 9m25s
[10:33:15.657] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:97:0)
[10:33:15.761] Build status: STARTED
[10:33:15.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:98:0) after 2m7s
[10:35:22.798] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:98:0)
[10:35:22.818] Build status: STARTED
[10:35:22.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:99:0) after 4m10s
[10:39:32.946] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:99:0)
[10:39:32.965] Build status: STARTED
[10:39:32.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:100:0) after 4m13s
[10:43:46.018] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:100:0)
[10:43:46.034] Build status: STARTED
[10:43:46.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:101:0) after 4m16s
[10:48:02.164] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:101:0)
[10:48:02.180] Build status: STARTED
[10:48:02.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:102:0) after 4m52s
[10:52:54.316] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:102:0)
[10:52:54.332] Build status: STARTED
[10:52:54.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:103:0) after 1m19s
[10:54:13.476] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:103:0)
[10:54:13.496] Build status: STARTED
[10:54:13.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8944324964368313680:104:0) after 5m9s
[10:58:29.163] Received PubSub notification, asking Buildbucket for the build status
[10:58:29.183] Build:
{
"id": "8778894902436603185",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 16799,
"createdBy": "project:chromium",
"createTime": "2023-06-08T02:13:47.324092397Z",
"startTime": "2023-06-08T02:15:40.884432Z",
"endTime": "2023-06-08T10:58:28.827378012Z",
"updateTime": "2023-06-08T10:58:28.827378012Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cb870773717136996f92e6f6dfe95d817323df5c",
"ref": "refs/heads/main"
}
}
}
[10:58:29.183] Invocation finished in 8h44m43.084360601s with status FAILED