[18:37:49.387] New invocation is queued and will start shortly
[18:37:50.465] Starting the invocation (attempt 1)
[18:37:50.503] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/b14a8277f5e95e52b51ce79be6cd22add29df12e"
[18:37:50.503] Popped gitiles commit info from properties and tags
[18:37:50.503] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:37:50.503] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:37:50.503] Buildbucket request:
{
"requestId": "8946890365029002400",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b14a8277f5e95e52b51ce79be6cd22add29df12e",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8946890365029002400"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:37:50.926] Scheduled build:
{
"id": "8781460303126025633",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 16589,
"createdBy": "project:chromium",
"createTime": "2023-05-10T18:37:50.575105684Z",
"updateTime": "2023-05-10T18:37:50.575105684Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b14a8277f5e95e52b51ce79be6cd22add29df12e",
"ref": "refs/heads/main"
}
},
"canary": true
}
[18:37:50.926] Task URL: https://cr-buildbucket.appspot.com/build/8781460303126025633
[18:37:50.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:2:0) after 6m35s
[18:38:09.052] Received PubSub notification, asking Buildbucket for the build status
[18:38:09.121] Build status: STARTED
[18:44:26.147] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:2:0)
[18:44:26.194] Build status: STARTED
[18:44:26.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:4:0) after 9m3s
[18:53:29.419] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:4:0)
[18:53:29.449] Build status: STARTED
[18:53:29.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:5:0) after 3m59s
[18:57:28.490] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:5:0)
[18:57:28.525] Build status: STARTED
[18:57:28.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:6:0) after 3m35s
[19:01:03.544] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:6:0)
[19:01:03.568] Build status: STARTED
[19:01:03.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:7:0) after 5m51s
[19:06:54.995] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:7:0)
[19:06:55.024] Build status: STARTED
[19:06:55.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:8:0) after 4m52s
[19:11:47.050] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:8:0)
[19:11:47.074] Build status: STARTED
[19:11:47.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:9:0) after 8m4s
[19:19:51.114] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:9:0)
[19:19:51.136] Build status: STARTED
[19:19:51.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:10:0) after 3m40s
[19:23:31.368] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:10:0)
[19:23:31.403] Build status: STARTED
[19:23:31.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:11:0) after 5m35s
[19:29:06.491] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:11:0)
[19:29:06.551] Build status: STARTED
[19:29:06.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:12:0) after 7m54s
[19:37:00.698] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:12:0)
[19:37:00.718] Build status: STARTED
[19:37:00.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:13:0) after 5m31s
[19:42:31.965] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:13:0)
[19:42:31.999] Build status: STARTED
[19:42:31.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:14:0) after 5m6s
[19:47:38.326] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:14:0)
[19:47:38.355] Build status: STARTED
[19:47:38.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:15:0) after 6m15s
[19:53:53.451] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:15:0)
[19:53:53.469] Build status: STARTED
[19:53:53.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:16:0) after 6m41s
[20:00:34.848] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:16:0)
[20:00:34.923] Build status: STARTED
[20:00:34.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:17:0) after 9m18s
[20:09:53.055] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:17:0)
[20:09:53.098] Build status: STARTED
[20:09:53.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:18:0) after 5m50s
[20:15:43.155] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:18:0)
[20:15:43.174] Build status: STARTED
[20:15:43.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:19:0) after 4m38s
[20:20:21.225] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:19:0)
[20:20:21.281] Build status: STARTED
[20:20:21.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:20:0) after 9m11s
[20:29:32.310] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:20:0)
[20:29:32.337] Build status: STARTED
[20:29:32.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:21:0) after 9m2s
[20:38:34.366] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:21:0)
[20:38:34.385] Build status: STARTED
[20:38:34.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:22:0) after 6m36s
[20:45:10.527] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:22:0)
[20:45:10.547] Build status: STARTED
[20:45:10.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:23:0) after 9m24s
[20:54:34.624] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:23:0)
[20:54:34.646] Build status: STARTED
[20:54:34.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:24:0) after 5m24s
[20:59:58.878] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:24:0)
[20:59:58.977] Build status: STARTED
[20:59:58.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:25:0) after 2m48s
[21:02:47.358] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:25:0)
[21:02:47.381] Build status: STARTED
[21:02:47.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:26:0) after 8m8s
[21:10:55.417] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:26:0)
[21:10:55.439] Build status: STARTED
[21:10:55.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:27:0) after 6m53s
[21:17:48.475] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:27:0)
[21:17:48.492] Build status: STARTED
[21:17:48.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:28:0) after 3m17s
[21:21:05.581] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:28:0)
[21:21:05.603] Build status: STARTED
[21:21:05.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:29:0) after 1m56s
[21:23:01.611] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:29:0)
[21:23:01.637] Build status: STARTED
[21:23:01.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:30:0) after 9m5s
[21:32:06.763] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:30:0)
[21:32:06.892] Build status: STARTED
[21:32:06.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:31:0) after 7m6s
[21:39:12.925] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:31:0)
[21:39:13.080] Build status: STARTED
[21:39:13.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:32:0) after 4m48s
[21:44:01.467] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:32:0)
[21:44:01.516] Build status: STARTED
[21:44:01.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:33:0) after 5m25s
[21:49:26.568] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:33:0)
[21:49:26.593] Build status: STARTED
[21:49:26.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:34:0) after 6m48s
[21:56:14.979] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:34:0)
[21:56:15.019] Build status: STARTED
[21:56:15.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:35:0) after 2m24s
[21:58:39.080] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:35:0)
[21:58:39.101] Build status: STARTED
[21:58:39.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:36:0) after 6m57s
[22:05:36.139] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:36:0)
[22:05:36.186] Build status: STARTED
[22:05:36.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:37:0) after 9m21s
[22:14:57.242] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:37:0)
[22:14:57.270] Build status: STARTED
[22:14:57.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:38:0) after 6m21s
[22:21:18.454] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:38:0)
[22:21:18.479] Build status: STARTED
[22:21:18.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:39:0) after 6m58s
[22:28:16.658] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:39:0)
[22:28:16.729] Build status: STARTED
[22:28:16.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:40:0) after 3m40s
[22:31:56.778] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:40:0)
[22:31:56.800] Build status: STARTED
[22:31:56.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:41:0) after 4m44s
[22:36:40.873] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:41:0)
[22:36:40.899] Build status: STARTED
[22:36:40.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:42:0) after 2m30s
[22:39:11.109] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:42:0)
[22:39:11.134] Build status: STARTED
[22:39:11.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:43:0) after 3m6s
[22:42:17.263] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:43:0)
[22:42:17.284] Build status: STARTED
[22:42:17.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:44:0) after 9m27s
[22:51:44.492] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:44:0)
[22:51:44.580] Build status: STARTED
[22:51:44.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:45:0) after 3m45s
[22:55:29.864] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:45:0)
[22:55:29.881] Build status: STARTED
[22:55:29.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:46:0) after 3m7s
[22:58:36.913] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:46:0)
[22:58:36.933] Build status: STARTED
[22:58:36.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:47:0) after 1m22s
[22:59:59.113] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:47:0)
[22:59:59.133] Build status: STARTED
[22:59:59.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:48:0) after 4m29s
[23:04:28.158] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:48:0)
[23:04:28.212] Build status: STARTED
[23:04:28.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:49:0) after 8m4s
[23:12:32.309] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:49:0)
[23:12:32.346] Build status: STARTED
[23:12:32.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:50:0) after 7m24s
[23:19:57.488] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:50:0)
[23:19:57.539] Build status: STARTED
[23:19:57.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:51:0) after 6m14s
[23:26:11.667] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:51:0)
[23:26:11.689] Build status: STARTED
[23:26:11.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:52:0) after 8m14s
[23:34:25.714] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:52:0)
[23:34:25.739] Build status: STARTED
[23:34:25.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:53:0) after 2m51s
[23:37:16.763] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:53:0)
[23:37:16.802] Build status: STARTED
[23:37:16.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:54:0) after 3m10s
[23:40:27.029] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:54:0)
[23:40:27.058] Build status: STARTED
[23:40:27.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:55:0) after 2m42s
[23:43:09.157] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:55:0)
[23:43:09.185] Build status: STARTED
[23:43:09.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:56:0) after 2m30s
[23:45:39.444] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:56:0)
[23:45:39.466] Build status: STARTED
[23:45:39.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:57:0) after 4m53s
[23:50:32.498] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:57:0)
[23:50:32.517] Build status: STARTED
[23:50:32.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:58:0) after 3m42s
[23:54:14.543] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:58:0)
[23:54:14.565] Build status: STARTED
[23:54:14.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:59:0) after 4m14s
[23:58:28.589] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:59:0)
[23:58:28.615] Build status: STARTED
[23:58:28.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:60:0) after 7m50s
[00:06:18.997] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:60:0)
[00:06:19.099] Build status: STARTED
[00:06:19.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:61:0) after 1m16s
[00:07:35.248] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:61:0)
[00:07:35.273] Build status: STARTED
[00:07:35.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:62:0) after 4m24s
[00:11:59.311] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:62:0)
[00:11:59.330] Build status: STARTED
[00:11:59.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:63:0) after 6m32s
[00:18:31.453] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:63:0)
[00:18:31.475] Build status: STARTED
[00:18:31.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:64:0) after 5m41s
[00:24:12.502] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:64:0)
[00:24:12.773] Build status: STARTED
[00:24:12.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:65:0) after 2m57s
[00:27:10.133] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:65:0)
[00:27:10.158] Build status: STARTED
[00:27:10.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:66:0) after 1m1s
[00:28:11.241] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:66:0)
[00:28:11.262] Build status: STARTED
[00:28:11.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:67:0) after 9m4s
[00:37:15.559] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:67:0)
[00:37:15.617] Build status: STARTED
[00:37:15.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:68:0) after 7m57s
[00:45:12.731] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:68:0)
[00:45:12.748] Build status: STARTED
[00:45:12.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:69:0) after 5m43s
[00:50:55.812] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:69:0)
[00:50:55.864] Build status: STARTED
[00:50:55.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:70:0) after 5m7s
[00:56:03.216] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:70:0)
[00:56:03.237] Build status: STARTED
[00:56:03.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:71:0) after 4m24s
[01:00:27.406] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:71:0)
[01:00:27.914] Build status: STARTED
[01:00:27.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:72:0) after 4m44s
[01:05:11.950] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:72:0)
[01:05:12.012] Build status: STARTED
[01:05:12.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:73:0) after 2m30s
[01:07:42.139] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:73:0)
[01:07:42.157] Build status: STARTED
[01:07:42.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:74:0) after 1m15s
[01:08:57.696] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:74:0)
[01:08:57.716] Build status: STARTED
[01:08:57.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:75:0) after 4m12s
[01:13:09.836] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:75:0)
[01:13:09.860] Build status: STARTED
[01:13:09.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:76:0) after 6m25s
[01:19:34.895] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:76:0)
[01:19:34.910] Build status: STARTED
[01:19:34.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:77:0) after 3m46s
[01:23:21.174] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:77:0)
[01:23:21.196] Build status: STARTED
[01:23:21.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:78:0) after 1m14s
[01:24:35.431] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:78:0)
[01:24:35.450] Build status: STARTED
[01:24:35.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:79:0) after 8m8s
[01:32:43.560] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:79:0)
[01:32:43.652] Build status: STARTED
[01:32:43.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:80:0) after 7m37s
[01:40:20.686] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:80:0)
[01:40:20.874] Build status: STARTED
[01:40:20.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:81:0) after 9m36s
[01:49:56.951] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:81:0)
[01:49:56.975] Build status: STARTED
[01:49:56.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:82:0) after 3m5s
[01:53:02.116] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:82:0)
[01:53:02.135] Build status: STARTED
[01:53:02.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:83:0) after 4m54s
[01:57:56.287] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:83:0)
[01:57:56.307] Build status: STARTED
[01:57:56.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:84:0) after 1m43s
[01:59:39.339] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:84:0)
[01:59:39.402] Build status: STARTED
[01:59:39.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:85:0) after 1m38s
[02:01:17.438] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:85:0)
[02:01:17.457] Build status: STARTED
[02:01:17.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:86:0) after 7m18s
[02:08:35.939] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:86:0)
[02:08:35.956] Build status: STARTED
[02:08:35.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:87:0) after 9m45s
[02:18:20.983] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:87:0)
[02:18:21.002] Build status: STARTED
[02:18:21.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:88:0) after 2m43s
[02:21:04.149] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:88:0)
[02:21:04.281] Build status: STARTED
[02:21:04.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:89:0) after 6m4s
[02:27:08.310] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:89:0)
[02:27:08.331] Build status: STARTED
[02:27:08.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:90:0) after 9m15s
[02:36:23.389] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:90:0)
[02:36:23.407] Build status: STARTED
[02:36:23.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:91:0) after 2m36s
[02:38:59.716] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:91:0)
[02:38:59.747] Build status: STARTED
[02:38:59.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:92:0) after 1m25s
[02:40:24.895] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:92:0)
[02:40:24.957] Build status: STARTED
[02:40:24.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:93:0) after 2m56s
[02:43:21.556] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:93:0)
[02:43:21.605] Build status: STARTED
[02:43:21.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:94:0) after 9m37s
[02:52:58.704] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:94:0)
[02:52:58.722] Build status: STARTED
[02:52:58.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8946890365029002400:95:0) after 4m40s
[02:54:57.836] Received PubSub notification, asking Buildbucket for the build status
[02:54:57.860] Build:
{
"id": "8781460303126025633",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 16589,
"createdBy": "project:chromium",
"createTime": "2023-05-10T18:37:50.575105684Z",
"startTime": "2023-05-10T18:38:08.537744Z",
"endTime": "2023-05-11T02:54:57.498061206Z",
"updateTime": "2023-05-11T02:54:57.498061206Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b14a8277f5e95e52b51ce79be6cd22add29df12e",
"ref": "refs/heads/main"
}
},
"canary": true
}
[02:54:57.860] Invocation finished in 8h17m8.483853127s with status FAILED