[17:29:23.371] New invocation is queued and will start shortly
[17:29:24.488] Starting the invocation (attempt 1)
[17:29:24.531] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/5fa96fdec7a1f089b5152d37a382285d23703979"
[17:29:24.531] Popped gitiles commit info from properties and tags
[17:29:24.531] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[17:29:24.531] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[17:29:24.531] Buildbucket request:
{
"requestId": "8956316755043740944",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5fa96fdec7a1f089b5152d37a382285d23703979",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8956316755043740944"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[17:29:25.102] Scheduled build:
{
"id": "8790886693005964321",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 15935,
"createdBy": "project:chromium",
"createTime": "2023-01-26T17:29:24.650434426Z",
"updateTime": "2023-01-26T17:29:24.650434426Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5fa96fdec7a1f089b5152d37a382285d23703979",
"ref": "refs/heads/main"
}
}
}
[17:29:25.102] Task URL: https://cr-buildbucket.appspot.com/build/8790886693005964321
[17:29:25.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:2:0) after 4m52s
[17:30:21.352] Received PubSub notification, asking Buildbucket for the build status
[17:30:21.379] Build status: STARTED
[17:34:17.181] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:2:0)
[17:34:17.202] Build status: STARTED
[17:34:17.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:4:0) after 2m4s
[17:36:21.361] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:4:0)
[17:36:21.398] Build status: STARTED
[17:36:21.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:5:0) after 2m53s
[17:39:14.854] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:5:0)
[17:39:14.901] Build status: STARTED
[17:39:14.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:6:0) after 8m14s
[17:47:28.922] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:6:0)
[17:47:28.947] Build status: STARTED
[17:47:28.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:7:0) after 4m25s
[17:51:53.976] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:7:0)
[17:51:53.995] Build status: STARTED
[17:51:53.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:8:0) after 5m7s
[17:57:01.217] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:8:0)
[17:57:01.246] Build status: STARTED
[17:57:01.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:9:0) after 8m25s
[18:05:26.489] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:9:0)
[18:05:26.558] Build status: STARTED
[18:05:26.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:10:0) after 1m23s
[18:06:49.692] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:10:0)
[18:06:49.715] Build status: STARTED
[18:06:49.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:11:0) after 2m34s
[18:09:23.737] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:11:0)
[18:09:23.922] Build status: STARTED
[18:09:23.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:12:0) after 8m43s
[18:18:06.947] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:12:0)
[18:18:06.980] Build status: STARTED
[18:18:06.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:13:0) after 3m58s
[18:22:05.023] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:13:0)
[18:22:05.041] Build status: STARTED
[18:22:05.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:14:0) after 2m21s
[18:24:26.084] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:14:0)
[18:24:26.108] Build status: STARTED
[18:24:26.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:15:0) after 5m36s
[18:30:02.299] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:15:0)
[18:30:02.325] Build status: STARTED
[18:30:02.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:16:0) after 2m46s
[18:32:48.363] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:16:0)
[18:32:48.417] Build status: STARTED
[18:32:48.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:17:0) after 3m9s
[18:35:57.963] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:17:0)
[18:35:58.006] Build status: STARTED
[18:35:58.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:18:0) after 9m59s
[18:45:57.159] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:18:0)
[18:45:57.179] Build status: STARTED
[18:45:57.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:19:0) after 9m7s
[18:55:04.239] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:19:0)
[18:55:04.351] Build status: STARTED
[18:55:04.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:20:0) after 3m37s
[18:58:41.609] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:20:0)
[18:58:41.655] Build status: STARTED
[18:58:41.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:21:0) after 4m46s
[19:03:27.917] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:21:0)
[19:03:27.940] Build status: STARTED
[19:03:27.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:22:0) after 7m3s
[19:10:31.076] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:22:0)
[19:10:31.098] Build status: STARTED
[19:10:31.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:23:0) after 5m3s
[19:15:34.614] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:23:0)
[19:15:34.683] Build status: STARTED
[19:15:34.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:24:0) after 5m46s
[19:21:20.850] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:24:0)
[19:21:20.870] Build status: STARTED
[19:21:20.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:25:0) after 3m58s
[19:25:19.209] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:25:0)
[19:25:19.248] Build status: STARTED
[19:25:19.248] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:26:0) after 4m11s
[19:29:30.352] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:26:0)
[19:29:30.431] Build status: STARTED
[19:29:30.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:27:0) after 6m34s
[19:36:04.755] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:27:0)
[19:36:04.778] Build status: STARTED
[19:36:04.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:28:0) after 4m14s
[19:40:18.800] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:28:0)
[19:40:18.819] Build status: STARTED
[19:40:18.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:29:0) after 1m13s
[19:41:31.831] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:29:0)
[19:41:31.851] Build status: STARTED
[19:41:31.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:30:0) after 1m51s
[19:43:22.874] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:30:0)
[19:43:22.922] Build status: STARTED
[19:43:22.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:31:0) after 4m10s
[19:47:33.033] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:31:0)
[19:47:33.063] Build status: STARTED
[19:47:33.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:32:0) after 7m4s
[19:54:37.646] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:32:0)
[19:54:37.697] Build status: STARTED
[19:54:37.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:33:0) after 5m9s
[19:59:46.741] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:33:0)
[19:59:46.769] Build status: STARTED
[19:59:46.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:34:0) after 2m29s
[20:02:15.791] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:34:0)
[20:02:15.817] Build status: STARTED
[20:02:15.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:35:0) after 3m48s
[20:06:03.899] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:35:0)
[20:06:03.919] Build status: STARTED
[20:06:03.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:36:0) after 5m11s
[20:11:15.058] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:36:0)
[20:11:15.080] Build status: STARTED
[20:11:15.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:37:0) after 7m57s
[20:19:12.213] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:37:0)
[20:19:12.236] Build status: STARTED
[20:19:12.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:38:0) after 9m24s
[20:28:36.339] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:38:0)
[20:28:36.371] Build status: STARTED
[20:28:36.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:39:0) after 6m0s
[20:34:36.711] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:39:0)
[20:34:36.740] Build status: STARTED
[20:34:36.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:40:0) after 6m37s
[20:41:14.174] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:40:0)
[20:41:14.202] Build status: STARTED
[20:41:14.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:41:0) after 2m35s
[20:43:49.288] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:41:0)
[20:43:49.310] Build status: STARTED
[20:43:49.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:42:0) after 7m19s
[20:51:08.893] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:42:0)
[20:51:08.913] Build status: STARTED
[20:51:08.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:43:0) after 7m3s
[20:58:11.933] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:43:0)
[20:58:11.957] Build status: STARTED
[20:58:11.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:44:0) after 1m37s
[20:59:49.134] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:44:0)
[20:59:49.153] Build status: STARTED
[20:59:49.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:45:0) after 4m12s
[21:04:01.322] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:45:0)
[21:04:01.345] Build status: STARTED
[21:04:01.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:46:0) after 6m3s
[21:10:04.675] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:46:0)
[21:10:04.706] Build status: STARTED
[21:10:04.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:47:0) after 4m31s
[21:14:35.838] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:47:0)
[21:14:35.864] Build status: STARTED
[21:14:35.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:48:0) after 3m59s
[21:18:34.892] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:48:0)
[21:18:34.915] Build status: STARTED
[21:18:34.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:49:0) after 3m4s
[21:21:39.119] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:49:0)
[21:21:39.151] Build status: STARTED
[21:21:39.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:50:0) after 2m59s
[21:24:38.462] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:50:0)
[21:24:38.487] Build status: STARTED
[21:24:38.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:51:0) after 1m14s
[21:25:52.681] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:51:0)
[21:25:52.704] Build status: STARTED
[21:25:52.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:52:0) after 3m20s
[21:29:12.862] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:52:0)
[21:29:12.887] Build status: STARTED
[21:29:12.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:53:0) after 8m20s
[21:37:33.100] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:53:0)
[21:37:33.132] Build status: STARTED
[21:37:33.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:54:0) after 1m49s
[21:39:22.250] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:54:0)
[21:39:22.272] Build status: STARTED
[21:39:22.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:55:0) after 3m59s
[21:43:21.769] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:55:0)
[21:43:21.810] Build status: STARTED
[21:43:21.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:56:0) after 9m10s
[21:52:31.902] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:56:0)
[21:52:31.930] Build status: STARTED
[21:52:31.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:57:0) after 3m54s
[21:56:26.058] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:57:0)
[21:56:26.080] Build status: STARTED
[21:56:26.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:58:0) after 3m26s
[21:59:52.134] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:58:0)
[21:59:52.163] Build status: STARTED
[21:59:52.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:59:0) after 5m17s
[22:05:09.186] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:59:0)
[22:05:09.214] Build status: STARTED
[22:05:09.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:60:0) after 6m42s
[22:11:51.242] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:60:0)
[22:11:51.293] Build status: STARTED
[22:11:51.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:61:0) after 2m36s
[22:14:27.403] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:61:0)
[22:14:27.428] Build status: STARTED
[22:14:27.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:62:0) after 1m20s
[22:15:47.547] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:62:0)
[22:15:47.568] Build status: STARTED
[22:15:47.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:63:0) after 2m2s
[22:17:49.644] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:63:0)
[22:17:49.723] Build status: STARTED
[22:17:49.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:64:0) after 1m26s
[22:19:15.754] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:64:0)
[22:19:15.775] Build status: STARTED
[22:19:15.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:65:0) after 7m23s
[22:26:39.143] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:65:0)
[22:26:39.171] Build status: STARTED
[22:26:39.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:66:0) after 3m45s
[22:30:24.717] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:66:0)
[22:30:24.737] Build status: STARTED
[22:30:24.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:67:0) after 7m32s
[22:37:56.831] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:67:0)
[22:37:56.854] Build status: STARTED
[22:37:56.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:68:0) after 2m9s
[22:40:05.879] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:68:0)
[22:40:05.924] Build status: STARTED
[22:40:05.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:69:0) after 9m12s
[22:49:18.104] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:69:0)
[22:49:18.125] Build status: STARTED
[22:49:18.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:70:0) after 1m39s
[22:50:57.168] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:70:0)
[22:50:57.238] Build status: STARTED
[22:50:57.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:71:0) after 5m25s
[22:56:22.434] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:71:0)
[22:56:22.455] Build status: STARTED
[22:56:22.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:72:0) after 2m8s
[22:58:30.484] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:72:0)
[22:58:30.522] Build status: STARTED
[22:58:30.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:73:0) after 5m47s
[23:04:17.840] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:73:0)
[23:04:17.966] Build status: STARTED
[23:04:17.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:74:0) after 5m28s
[23:09:46.178] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:74:0)
[23:09:46.198] Build status: STARTED
[23:09:46.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:75:0) after 4m11s
[23:13:57.524] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:75:0)
[23:13:57.548] Build status: STARTED
[23:13:57.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:76:0) after 6m39s
[23:20:37.067] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:76:0)
[23:20:37.095] Build status: STARTED
[23:20:37.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:77:0) after 7m16s
[23:27:53.220] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:77:0)
[23:27:53.243] Build status: STARTED
[23:27:53.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:78:0) after 7m48s
[23:35:41.370] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:78:0)
[23:35:41.403] Build status: STARTED
[23:35:41.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:79:0) after 5m22s
[23:41:03.588] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:79:0)
[23:41:03.607] Build status: STARTED
[23:41:03.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:80:0) after 5m0s
[23:46:04.555] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:80:0)
[23:46:04.579] Build status: STARTED
[23:46:04.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:81:0) after 7m12s
[23:53:16.711] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:81:0)
[23:53:16.734] Build status: STARTED
[23:53:16.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:82:0) after 6m37s
[23:59:53.928] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:82:0)
[23:59:53.948] Build status: STARTED
[23:59:53.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:83:0) after 2m11s
[00:02:05.550] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:83:0)
[00:02:05.580] Build status: STARTED
[00:02:05.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:84:0) after 6m10s
[00:08:15.778] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:84:0)
[00:08:15.803] Build status: STARTED
[00:08:15.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:85:0) after 2m4s
[00:10:19.921] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:85:0)
[00:10:20.030] Build status: STARTED
[00:10:20.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:86:0) after 5m59s
[00:16:19.149] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:86:0)
[00:16:19.178] Build status: STARTED
[00:16:19.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:87:0) after 5m7s
[00:21:26.547] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:87:0)
[00:21:26.575] Build status: STARTED
[00:21:26.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:88:0) after 4m27s
[00:25:53.634] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:88:0)
[00:25:53.657] Build status: STARTED
[00:25:53.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:89:0) after 8m56s
[00:34:49.681] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:89:0)
[00:34:49.709] Build status: STARTED
[00:34:49.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:90:0) after 9m20s
[00:44:10.155] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:90:0)
[00:44:10.178] Build status: STARTED
[00:44:10.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:91:0) after 6m16s
[00:50:26.214] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:91:0)
[00:50:26.236] Build status: STARTED
[00:50:26.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:92:0) after 2m18s
[00:52:44.471] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:92:0)
[00:52:44.494] Build status: STARTED
[00:52:44.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:93:0) after 1m16s
[00:54:00.628] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:93:0)
[00:54:00.660] Build status: STARTED
[00:54:00.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:94:0) after 8m20s
[01:02:20.685] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:94:0)
[01:02:20.709] Build status: STARTED
[01:02:20.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:95:0) after 3m50s
[01:06:10.911] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:95:0)
[01:06:10.936] Build status: STARTED
[01:06:10.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:96:0) after 8m47s
[01:14:57.972] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:96:0)
[01:14:58.024] Build status: STARTED
[01:14:58.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:97:0) after 7m36s
[01:22:34.053] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:97:0)
[01:22:34.154] Build status: STARTED
[01:22:34.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:98:0) after 6m54s
[01:29:28.188] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:98:0)
[01:29:28.225] Build status: STARTED
[01:29:28.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:99:0) after 7m45s
[01:37:13.495] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:99:0)
[01:37:13.513] Build status: STARTED
[01:37:13.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:100:0) after 8m26s
[01:45:40.172] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:100:0)
[01:45:40.195] Build status: STARTED
[01:45:40.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:101:0) after 9m42s
[01:55:22.273] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:101:0)
[01:55:22.298] Build status: STARTED
[01:55:22.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:102:0) after 3m18s
[01:58:40.619] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:102:0)
[01:58:40.641] Build status: STARTED
[01:58:40.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:103:0) after 9m13s
[02:07:53.920] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:103:0)
[02:07:53.946] Build status: STARTED
[02:07:53.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:104:0) after 9m9s
[02:17:02.971] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:104:0)
[02:17:03.055] Build status: STARTED
[02:17:03.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:105:0) after 2m31s
[02:19:34.075] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:105:0)
[02:19:34.093] Build status: STARTED
[02:19:34.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:106:0) after 9m55s
[02:29:29.119] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:106:0)
[02:29:29.144] Build status: STARTED
[02:29:29.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:107:0) after 5m30s
[02:34:59.299] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:107:0)
[02:34:59.333] Build status: STARTED
[02:34:59.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:108:0) after 8m32s
[02:43:31.394] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:108:0)
[02:43:31.416] Build status: STARTED
[02:43:31.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:109:0) after 7m40s
[02:51:11.449] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:109:0)
[02:51:11.470] Build status: STARTED
[02:51:11.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:110:0) after 1m24s
[02:52:35.492] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:110:0)
[02:52:35.524] Build status: STARTED
[02:52:35.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:111:0) after 3m44s
[02:56:19.950] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:111:0)
[02:56:19.971] Build status: STARTED
[02:56:19.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:112:0) after 6m12s
[03:02:32.124] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:112:0)
[03:02:32.154] Build status: STARTED
[03:02:32.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:113:0) after 7m35s
[03:10:07.184] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:113:0)
[03:10:07.205] Build status: STARTED
[03:10:07.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8956316755043740944:114:0) after 4m4s
[03:12:37.102] Received PubSub notification, asking Buildbucket for the build status
[03:12:37.128] Build:
{
"id": "8790886693005964321",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 15935,
"createdBy": "project:chromium",
"createTime": "2023-01-26T17:29:24.650434426Z",
"startTime": "2023-01-26T17:30:20.302087Z",
"endTime": "2023-01-27T03:12:28.105084792Z",
"updateTime": "2023-01-27T03:12:28.105084792Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5fa96fdec7a1f089b5152d37a382285d23703979",
"ref": "refs/heads/main"
}
}
}
[03:12:37.129] Invocation finished in 9h43m13.805616903s with status FAILED