[22:07:36.166] New invocation is queued and will start shortly
[22:07:37.559] Starting the invocation (attempt 1)
[22:07:37.615] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/273b7e3a563541b67c7934f39d47cf14984dd9ef"
[22:07:37.615] Popped gitiles commit info from properties and tags
[22:07:37.616] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:07:37.616] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:07:37.616] Buildbucket request:
{
"requestId": "8957205221000537312",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "273b7e3a563541b67c7934f39d47cf14984dd9ef",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8957205221000537312"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:07:38.040] Scheduled build:
{
"id": "8791775158733055681",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 15879,
"createdBy": "project:chromium",
"createTime": "2023-01-16T22:07:37.705599797Z",
"updateTime": "2023-01-16T22:07:37.705599797Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "273b7e3a563541b67c7934f39d47cf14984dd9ef",
"ref": "refs/heads/main"
}
}
}
[22:07:38.040] Task URL: https://cr-buildbucket.appspot.com/build/8791775158733055681
[22:07:38.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:2:0) after 8m18s
[22:12:22.769] Received PubSub notification, asking Buildbucket for the build status
[22:12:22.809] Build status: STARTED
[22:15:56.264] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:2:0)
[22:15:56.300] Build status: STARTED
[22:15:56.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:4:0) after 1m39s
[22:17:35.355] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:4:0)
[22:17:35.380] Build status: STARTED
[22:17:35.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:5:0) after 2m56s
[22:20:31.614] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:5:0)
[22:20:31.654] Build status: STARTED
[22:20:31.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:6:0) after 4m36s
[22:25:07.805] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:6:0)
[22:25:07.838] Build status: STARTED
[22:25:07.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:7:0) after 3m20s
[22:28:27.876] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:7:0)
[22:28:27.898] Build status: STARTED
[22:28:27.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:8:0) after 6m34s
[22:35:01.929] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:8:0)
[22:35:01.961] Build status: STARTED
[22:35:01.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:9:0) after 4m42s
[22:39:43.985] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:9:0)
[22:39:44.012] Build status: STARTED
[22:39:44.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:10:0) after 8m52s
[22:48:36.334] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:10:0)
[22:48:36.358] Build status: STARTED
[22:48:36.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:11:0) after 6m17s
[22:54:53.500] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:11:0)
[22:54:53.543] Build status: STARTED
[22:54:53.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:12:0) after 2m31s
[22:57:24.747] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:12:0)
[22:57:24.772] Build status: STARTED
[22:57:24.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:13:0) after 4m53s
[23:02:18.052] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:13:0)
[23:02:18.077] Build status: STARTED
[23:02:18.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:14:0) after 1m13s
[23:03:31.242] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:14:0)
[23:03:31.297] Build status: STARTED
[23:03:31.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:15:0) after 8m15s
[23:11:46.323] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:15:0)
[23:11:46.347] Build status: STARTED
[23:11:46.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:16:0) after 4m1s
[23:15:47.611] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:16:0)
[23:15:47.635] Build status: STARTED
[23:15:47.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:17:0) after 4m23s
[23:20:10.798] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:17:0)
[23:20:10.822] Build status: STARTED
[23:20:10.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:18:0) after 3m59s
[23:24:09.911] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:18:0)
[23:24:09.933] Build status: STARTED
[23:24:09.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:19:0) after 4m25s
[23:28:34.963] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:19:0)
[23:28:34.982] Build status: STARTED
[23:28:34.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:20:0) after 3m53s
[23:32:27.962] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:20:0)
[23:32:27.983] Build status: STARTED
[23:32:27.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:21:0) after 3m37s
[23:36:05.007] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:21:0)
[23:36:05.035] Build status: STARTED
[23:36:05.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:22:0) after 8m6s
[23:44:11.055] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:22:0)
[23:44:11.078] Build status: STARTED
[23:44:11.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:23:0) after 6m41s
[23:50:52.515] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:23:0)
[23:50:52.534] Build status: STARTED
[23:50:52.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:24:0) after 7m54s
[23:58:46.534] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:24:0)
[23:58:46.554] Build status: STARTED
[23:58:46.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:25:0) after 8m26s
[00:07:12.597] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:25:0)
[00:07:12.617] Build status: STARTED
[00:07:12.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:26:0) after 7m19s
[00:14:31.683] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:26:0)
[00:14:31.705] Build status: STARTED
[00:14:31.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:27:0) after 2m44s
[00:17:15.728] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:27:0)
[00:17:15.748] Build status: STARTED
[00:17:15.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:28:0) after 4m47s
[00:22:03.029] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:28:0)
[00:22:03.051] Build status: STARTED
[00:22:03.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:29:0) after 6m30s
[00:28:33.118] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:29:0)
[00:28:33.150] Build status: STARTED
[00:28:33.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:30:0) after 3m0s
[00:31:33.211] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:30:0)
[00:31:33.234] Build status: STARTED
[00:31:33.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:31:0) after 2m10s
[00:33:43.293] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:31:0)
[00:33:43.318] Build status: STARTED
[00:33:43.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:32:0) after 3m18s
[00:37:01.339] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:32:0)
[00:37:01.360] Build status: STARTED
[00:37:01.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:33:0) after 9m36s
[00:46:37.655] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:33:0)
[00:46:37.694] Build status: STARTED
[00:46:37.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:34:0) after 8m58s
[00:55:35.716] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:34:0)
[00:55:35.744] Build status: STARTED
[00:55:35.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:35:0) after 7m11s
[01:02:46.764] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:35:0)
[01:02:46.789] Build status: STARTED
[01:02:46.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:36:0) after 2m43s
[01:05:29.861] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:36:0)
[01:05:29.885] Build status: STARTED
[01:05:29.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:37:0) after 5m16s
[01:10:45.914] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:37:0)
[01:10:45.934] Build status: STARTED
[01:10:45.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:38:0) after 1m51s
[01:12:36.957] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:38:0)
[01:12:36.983] Build status: STARTED
[01:12:36.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:39:0) after 8m45s
[01:21:22.415] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:39:0)
[01:21:22.442] Build status: STARTED
[01:21:22.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:40:0) after 4m42s
[01:26:04.469] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:40:0)
[01:26:04.490] Build status: STARTED
[01:26:04.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:41:0) after 1m9s
[01:27:13.513] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:41:0)
[01:27:13.536] Build status: STARTED
[01:27:13.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:42:0) after 8m11s
[01:35:24.701] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:42:0)
[01:35:24.721] Build status: STARTED
[01:35:24.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:43:0) after 5m2s
[01:40:26.955] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:43:0)
[01:40:26.981] Build status: STARTED
[01:40:26.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:44:0) after 7m22s
[01:47:48.975] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:44:0)
[01:47:48.999] Build status: STARTED
[01:47:48.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:45:0) after 2m19s
[01:50:08.206] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:45:0)
[01:50:08.229] Build status: STARTED
[01:50:08.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:46:0) after 2m53s
[01:53:01.353] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:46:0)
[01:53:01.378] Build status: STARTED
[01:53:01.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:47:0) after 5m52s
[01:58:53.498] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:47:0)
[01:58:53.605] Build status: STARTED
[01:58:53.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:48:0) after 9m40s
[02:08:33.720] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:48:0)
[02:08:33.743] Build status: STARTED
[02:08:33.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:49:0) after 4m2s
[02:12:35.780] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:49:0)
[02:12:35.804] Build status: STARTED
[02:12:35.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:50:0) after 6m24s
[02:18:59.796] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:50:0)
[02:18:59.822] Build status: STARTED
[02:18:59.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:51:0) after 5m2s
[02:24:01.892] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:51:0)
[02:24:01.915] Build status: STARTED
[02:24:01.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:52:0) after 4m24s
[02:28:26.005] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:52:0)
[02:28:26.027] Build status: STARTED
[02:28:26.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:53:0) after 3m51s
[02:32:17.204] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:53:0)
[02:32:17.239] Build status: STARTED
[02:32:17.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:54:0) after 2m43s
[02:35:00.835] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:54:0)
[02:35:00.857] Build status: STARTED
[02:35:00.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:55:0) after 9m14s
[02:44:14.879] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:55:0)
[02:44:14.914] Build status: STARTED
[02:44:14.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:56:0) after 4m27s
[02:48:41.938] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:56:0)
[02:48:41.965] Build status: STARTED
[02:48:41.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:57:0) after 8m34s
[02:57:16.082] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:57:0)
[02:57:16.108] Build status: STARTED
[02:57:16.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:58:0) after 1m53s
[02:59:09.201] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:58:0)
[02:59:09.226] Build status: STARTED
[02:59:09.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:59:0) after 2m24s
[03:01:33.250] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:59:0)
[03:01:33.359] Build status: STARTED
[03:01:33.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:60:0) after 5m16s
[03:06:49.384] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:60:0)
[03:06:49.407] Build status: STARTED
[03:06:49.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:61:0) after 5m8s
[03:11:57.637] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:61:0)
[03:11:57.657] Build status: STARTED
[03:11:57.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:62:0) after 2m50s
[03:14:47.678] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:62:0)
[03:14:47.698] Build status: STARTED
[03:14:47.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:63:0) after 8m21s
[03:23:09.179] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:63:0)
[03:23:09.201] Build status: STARTED
[03:23:09.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:64:0) after 8m25s
[03:31:34.261] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:64:0)
[03:31:34.286] Build status: STARTED
[03:31:34.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:65:0) after 1m53s
[03:33:27.306] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:65:0)
[03:33:27.328] Build status: STARTED
[03:33:27.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:66:0) after 9m14s
[03:42:41.579] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:66:0)
[03:42:41.603] Build status: STARTED
[03:42:41.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:67:0) after 9m9s
[03:51:50.636] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:67:0)
[03:51:50.657] Build status: STARTED
[03:51:50.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:68:0) after 2m56s
[03:54:46.674] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:68:0)
[03:54:46.692] Build status: STARTED
[03:54:46.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:69:0) after 5m55s
[04:00:41.855] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:69:0)
[04:00:41.876] Build status: STARTED
[04:00:41.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:70:0) after 1m43s
[04:02:25.014] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:70:0)
[04:02:25.038] Build status: STARTED
[04:02:25.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:71:0) after 2m12s
[04:04:37.123] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:71:0)
[04:04:37.180] Build status: STARTED
[04:04:37.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:72:0) after 2m42s
[04:07:19.227] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:72:0)
[04:07:19.249] Build status: STARTED
[04:07:19.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:73:0) after 5m31s
[04:12:50.296] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:73:0)
[04:12:50.318] Build status: STARTED
[04:12:50.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:74:0) after 1m32s
[04:14:22.385] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:74:0)
[04:14:22.407] Build status: STARTED
[04:14:22.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:75:0) after 2m54s
[04:17:16.683] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:75:0)
[04:17:16.705] Build status: STARTED
[04:17:16.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:76:0) after 5m51s
[04:23:07.726] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:76:0)
[04:23:07.752] Build status: STARTED
[04:23:07.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:77:0) after 2m36s
[04:25:43.731] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:77:0)
[04:25:43.756] Build status: STARTED
[04:25:43.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:78:0) after 6m16s
[04:31:59.778] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:78:0)
[04:31:59.933] Build status: STARTED
[04:31:59.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:79:0) after 6m50s
[04:38:50.063] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:79:0)
[04:38:50.086] Build status: STARTED
[04:38:50.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:80:0) after 3m0s
[04:41:50.206] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:80:0)
[04:41:50.229] Build status: STARTED
[04:41:50.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:81:0) after 8m28s
[04:50:18.255] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:81:0)
[04:50:18.333] Build status: STARTED
[04:50:18.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:82:0) after 7m58s
[04:58:16.353] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:82:0)
[04:58:16.382] Build status: STARTED
[04:58:16.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:83:0) after 6m10s
[05:04:26.387] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:83:0)
[05:04:26.411] Build status: STARTED
[05:04:26.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:84:0) after 2m26s
[05:06:52.424] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:84:0)
[05:06:52.442] Build status: STARTED
[05:06:52.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:85:0) after 7m42s
[05:14:34.581] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:85:0)
[05:14:34.602] Build status: STARTED
[05:14:34.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:86:0) after 8m39s
[05:23:13.637] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:86:0)
[05:23:13.701] Build status: STARTED
[05:23:13.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:87:0) after 4m46s
[05:27:59.876] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:87:0)
[05:27:59.935] Build status: STARTED
[05:27:59.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:88:0) after 7m34s
[05:35:33.959] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:88:0)
[05:35:34.030] Build status: STARTED
[05:35:34.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:89:0) after 3m39s
[05:39:13.057] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:89:0)
[05:39:13.078] Build status: STARTED
[05:39:13.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:90:0) after 7m36s
[05:46:49.102] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:90:0)
[05:46:49.122] Build status: STARTED
[05:46:49.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:91:0) after 6m16s
[05:53:05.161] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:91:0)
[05:53:05.180] Build status: STARTED
[05:53:05.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:92:0) after 8m5s
[06:01:10.234] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:92:0)
[06:01:10.263] Build status: STARTED
[06:01:10.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:93:0) after 5m56s
[06:07:06.649] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:93:0)
[06:07:06.673] Build status: STARTED
[06:07:06.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:94:0) after 3m15s
[06:10:21.716] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:94:0)
[06:10:21.740] Build status: STARTED
[06:10:21.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:95:0) after 1m15s
[06:11:36.797] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:95:0)
[06:11:36.824] Build status: STARTED
[06:11:36.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:96:0) after 4m6s
[06:15:42.923] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:96:0)
[06:15:42.945] Build status: STARTED
[06:15:42.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:97:0) after 6m4s
[06:21:46.979] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:97:0)
[06:21:46.999] Build status: STARTED
[06:21:46.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:98:0) after 4m11s
[06:25:58.211] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:98:0)
[06:25:58.231] Build status: STARTED
[06:25:58.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:99:0) after 9m35s
[06:35:33.498] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:99:0)
[06:35:33.524] Build status: STARTED
[06:35:33.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:100:0) after 8m16s
[06:43:49.633] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:100:0)
[06:43:49.657] Build status: STARTED
[06:43:49.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8957205221000537312:101:0) after 6m10s
[06:44:07.623] Received PubSub notification, asking Buildbucket for the build status
[06:44:07.648] Build:
{
"id": "8791775158733055681",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 15879,
"createdBy": "project:chromium",
"createTime": "2023-01-16T22:07:37.705599797Z",
"startTime": "2023-01-16T22:12:22.038262Z",
"endTime": "2023-01-17T06:44:07.395007019Z",
"updateTime": "2023-01-17T06:44:07.395007019Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "273b7e3a563541b67c7934f39d47cf14984dd9ef",
"ref": "refs/heads/main"
}
}
}
[06:44:07.648] Invocation finished in 8h36m31.489457521s with status FAILED