[06:52:36.877] New invocation is queued and will start shortly
[06:52:38.033] Starting the invocation (attempt 1)
[06:52:38.066] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/750874ebaf7e445887cd81746861703fea637cba"
[06:52:38.067] Popped gitiles commit info from properties and tags
[06:52:38.067] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[06:52:38.067] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[06:52:38.067] Buildbucket request:
{
"requestId": "8946028763243817328",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "750874ebaf7e445887cd81746861703fea637cba",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8946028763243817328"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[06:52:38.489] Scheduled build:
{
"id": "8780598701276987601",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 19001,
"createdBy": "project:chromium",
"createTime": "2023-05-20T06:52:38.130970070Z",
"updateTime": "2023-05-20T06:52:38.130970070Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "750874ebaf7e445887cd81746861703fea637cba",
"ref": "refs/heads/main"
}
}
}
[06:52:38.489] Task URL: https://cr-buildbucket.appspot.com/build/8780598701276987601
[06:52:38.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:2:0) after 7m37s
[06:57:00.414] Received PubSub notification, asking Buildbucket for the build status
[06:57:00.437] Build status: STARTED
[07:00:15.568] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:2:0)
[07:00:15.618] Build status: STARTED
[07:00:15.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:4:0) after 4m21s
[07:04:37.176] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:4:0)
[07:04:37.195] Build status: STARTED
[07:04:37.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:5:0) after 5m18s
[07:09:55.318] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:5:0)
[07:09:55.342] Build status: STARTED
[07:09:55.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:6:0) after 8m46s
[07:18:41.598] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:6:0)
[07:18:41.628] Build status: STARTED
[07:18:41.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:7:0) after 9m16s
[07:27:58.101] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:7:0)
[07:27:58.120] Build status: STARTED
[07:27:58.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:8:0) after 6m48s
[07:34:46.156] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:8:0)
[07:34:46.175] Build status: STARTED
[07:34:46.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:9:0) after 9m28s
[07:44:14.202] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:9:0)
[07:44:14.225] Build status: STARTED
[07:44:14.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:10:0) after 4m47s
[07:49:01.905] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:10:0)
[07:49:02.017] Build status: STARTED
[07:49:02.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:11:0) after 2m2s
[07:51:04.160] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:11:0)
[07:51:04.179] Build status: STARTED
[07:51:04.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:12:0) after 6m45s
[07:57:49.398] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:12:0)
[07:57:49.446] Build status: STARTED
[07:57:49.446] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:13:0) after 7m9s
[08:04:58.466] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:13:0)
[08:04:58.485] Build status: STARTED
[08:04:58.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:14:0) after 8m3s
[08:13:02.229] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:14:0)
[08:13:02.279] Build status: STARTED
[08:13:02.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:15:0) after 4m9s
[08:17:11.597] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:15:0)
[08:17:11.617] Build status: STARTED
[08:17:11.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:16:0) after 5m57s
[08:23:08.715] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:16:0)
[08:23:08.736] Build status: STARTED
[08:23:08.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:17:0) after 1m34s
[08:24:42.757] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:17:0)
[08:24:42.777] Build status: STARTED
[08:24:42.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:18:0) after 6m9s
[08:30:52.041] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:18:0)
[08:30:52.065] Build status: STARTED
[08:30:52.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:19:0) after 3m48s
[08:34:40.197] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:19:0)
[08:34:40.221] Build status: STARTED
[08:34:40.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:20:0) after 7m12s
[08:41:52.568] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:20:0)
[08:41:52.589] Build status: STARTED
[08:41:52.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:21:0) after 5m43s
[08:47:35.803] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:21:0)
[08:47:35.820] Build status: STARTED
[08:47:35.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:22:0) after 4m48s
[08:52:24.282] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:22:0)
[08:52:24.303] Build status: STARTED
[08:52:24.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:23:0) after 7m33s
[08:59:58.031] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:23:0)
[08:59:58.051] Build status: STARTED
[08:59:58.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:24:0) after 1m44s
[09:01:42.362] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:24:0)
[09:01:42.551] Build status: STARTED
[09:01:42.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:25:0) after 5m51s
[09:07:33.754] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:25:0)
[09:07:33.774] Build status: STARTED
[09:07:33.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:26:0) after 8m21s
[09:15:54.811] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:26:0)
[09:15:54.831] Build status: STARTED
[09:15:54.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:27:0) after 8m48s
[09:24:43.183] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:27:0)
[09:24:43.272] Build status: STARTED
[09:24:43.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:28:0) after 3m32s
[09:28:15.818] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:28:0)
[09:28:15.843] Build status: STARTED
[09:28:15.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:29:0) after 2m56s
[09:31:12.002] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:29:0)
[09:31:12.021] Build status: STARTED
[09:31:12.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:30:0) after 3m55s
[09:35:07.101] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:30:0)
[09:35:07.119] Build status: STARTED
[09:35:07.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:31:0) after 2m1s
[09:37:08.151] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:31:0)
[09:37:08.179] Build status: STARTED
[09:37:08.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:32:0) after 5m20s
[09:42:28.166] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:32:0)
[09:42:28.188] Build status: STARTED
[09:42:28.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:33:0) after 4m34s
[09:47:02.420] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:33:0)
[09:47:02.439] Build status: STARTED
[09:47:02.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:34:0) after 1m47s
[09:48:49.830] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:34:0)
[09:48:49.849] Build status: STARTED
[09:48:49.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:35:0) after 3m19s
[09:52:09.012] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:35:0)
[09:52:09.082] Build status: STARTED
[09:52:09.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:36:0) after 4m8s
[09:56:17.301] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:36:0)
[09:56:17.322] Build status: STARTED
[09:56:17.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:37:0) after 6m19s
[10:02:36.350] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:37:0)
[10:02:36.439] Build status: STARTED
[10:02:36.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:38:0) after 7m2s
[10:09:38.648] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:38:0)
[10:09:38.669] Build status: STARTED
[10:09:38.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:39:0) after 3m1s
[10:12:39.703] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:39:0)
[10:12:39.723] Build status: STARTED
[10:12:39.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:40:0) after 1m35s
[10:14:14.738] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:40:0)
[10:14:14.757] Build status: STARTED
[10:14:14.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:41:0) after 1m15s
[10:15:29.776] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:41:0)
[10:15:29.798] Build status: STARTED
[10:15:29.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:42:0) after 3m46s
[10:19:15.950] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:42:0)
[10:19:15.988] Build status: STARTED
[10:19:15.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:43:0) after 9m46s
[10:29:02.014] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:43:0)
[10:29:02.033] Build status: STARTED
[10:29:02.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:44:0) after 1m18s
[10:30:20.410] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:44:0)
[10:30:20.427] Build status: STARTED
[10:30:20.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:45:0) after 8m34s
[10:38:54.455] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:45:0)
[10:38:54.478] Build status: STARTED
[10:38:54.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:46:0) after 4m42s
[10:43:36.505] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:46:0)
[10:43:36.526] Build status: STARTED
[10:43:36.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:47:0) after 4m34s
[10:48:10.604] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:47:0)
[10:48:10.641] Build status: STARTED
[10:48:10.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:48:0) after 9m29s
[10:57:39.976] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:48:0)
[10:57:39.993] Build status: STARTED
[10:57:39.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:49:0) after 5m4s
[11:02:44.162] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:49:0)
[11:02:44.183] Build status: STARTED
[11:02:44.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:50:0) after 9m39s
[11:12:23.839] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:50:0)
[11:12:23.904] Build status: STARTED
[11:12:23.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:51:0) after 1m41s
[11:14:05.955] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:51:0)
[11:14:05.977] Build status: STARTED
[11:14:05.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:52:0) after 1m54s
[11:15:59.998] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:52:0)
[11:16:00.029] Build status: STARTED
[11:16:00.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:53:0) after 1m46s
[11:17:46.067] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:53:0)
[11:17:46.116] Build status: STARTED
[11:17:46.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:54:0) after 2m0s
[11:19:47.326] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:54:0)
[11:19:47.346] Build status: STARTED
[11:19:47.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:55:0) after 7m30s
[11:27:18.425] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:55:0)
[11:27:18.443] Build status: STARTED
[11:27:18.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:56:0) after 7m43s
[11:35:02.534] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:56:0)
[11:35:02.551] Build status: STARTED
[11:35:02.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:57:0) after 9m52s
[11:44:54.628] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:57:0)
[11:44:54.653] Build status: STARTED
[11:44:54.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:58:0) after 7m7s
[11:52:01.834] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:58:0)
[11:52:01.923] Build status: STARTED
[11:52:01.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:59:0) after 9m2s
[12:01:04.183] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:59:0)
[12:01:04.207] Build status: STARTED
[12:01:04.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:60:0) after 7m58s
[12:09:02.235] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:60:0)
[12:09:02.263] Build status: STARTED
[12:09:02.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:61:0) after 5m38s
[12:14:40.292] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:61:0)
[12:14:40.312] Build status: STARTED
[12:14:40.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:62:0) after 8m41s
[12:23:21.542] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:62:0)
[12:23:21.607] Build status: STARTED
[12:23:21.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:63:0) after 3m55s
[12:27:17.040] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:63:0)
[12:27:17.061] Build status: STARTED
[12:27:17.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:64:0) after 2m12s
[12:29:29.085] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:64:0)
[12:29:29.107] Build status: STARTED
[12:29:29.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:65:0) after 1m52s
[12:31:21.129] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:65:0)
[12:31:21.151] Build status: STARTED
[12:31:21.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:66:0) after 3m12s
[12:34:33.202] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:66:0)
[12:34:33.219] Build status: STARTED
[12:34:33.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:67:0) after 8m30s
[12:43:03.246] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:67:0)
[12:43:03.296] Build status: STARTED
[12:43:03.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:68:0) after 3m15s
[12:46:18.319] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:68:0)
[12:46:18.391] Build status: STARTED
[12:46:18.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:69:0) after 8m59s
[12:55:17.813] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:69:0)
[12:55:17.833] Build status: STARTED
[12:55:17.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:70:0) after 8m35s
[13:03:53.378] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:70:0)
[13:03:53.399] Build status: STARTED
[13:03:53.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:71:0) after 9m40s
[13:13:34.032] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:71:0)
[13:13:34.081] Build status: STARTED
[13:13:34.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:72:0) after 6m37s
[13:20:11.123] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:72:0)
[13:20:11.141] Build status: STARTED
[13:20:11.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:73:0) after 8m3s
[13:28:14.342] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:73:0)
[13:28:14.359] Build status: STARTED
[13:28:14.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:74:0) after 8m57s
[13:37:11.797] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:74:0)
[13:37:11.821] Build status: STARTED
[13:37:11.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:75:0) after 1m40s
[13:38:51.844] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:75:0)
[13:38:51.862] Build status: STARTED
[13:38:51.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:76:0) after 5m18s
[13:44:10.232] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:76:0)
[13:44:10.284] Build status: STARTED
[13:44:10.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:77:0) after 7m27s
[13:51:37.423] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:77:0)
[13:51:37.456] Build status: STARTED
[13:51:37.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:78:0) after 3m50s
[13:55:27.578] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:78:0)
[13:55:27.598] Build status: STARTED
[13:55:27.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:79:0) after 9m2s
[14:04:30.588] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:79:0)
[14:04:30.638] Build status: STARTED
[14:04:30.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:80:0) after 4m19s
[14:08:49.759] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:80:0)
[14:08:49.776] Build status: STARTED
[14:08:49.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:81:0) after 1m42s
[14:10:31.964] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:81:0)
[14:10:31.984] Build status: STARTED
[14:10:31.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:82:0) after 4m58s
[14:15:30.219] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:82:0)
[14:15:30.240] Build status: STARTED
[14:15:30.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:83:0) after 7m30s
[14:23:00.481] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:83:0)
[14:23:00.506] Build status: STARTED
[14:23:00.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:84:0) after 9m45s
[14:32:45.528] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:84:0)
[14:32:45.554] Build status: STARTED
[14:32:45.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:85:0) after 8m2s
[14:40:47.576] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:85:0)
[14:40:47.709] Build status: STARTED
[14:40:47.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:86:0) after 9m17s
[14:50:33.148] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:86:0)
[14:50:33.298] Build status: STARTED
[14:50:33.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:87:0) after 1m19s
[14:51:52.321] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:87:0)
[14:51:52.345] Build status: STARTED
[14:51:52.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:88:0) after 3m47s
[14:55:39.387] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:88:0)
[14:55:39.406] Build status: STARTED
[14:55:39.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:89:0) after 6m50s
[15:02:29.644] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:89:0)
[15:02:29.666] Build status: STARTED
[15:02:29.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:90:0) after 1m28s
[15:03:57.690] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:90:0)
[15:03:57.729] Build status: STARTED
[15:03:57.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:91:0) after 5m54s
[15:09:51.757] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:91:0)
[15:09:51.779] Build status: STARTED
[15:09:51.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:92:0) after 3m58s
[15:13:49.827] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:92:0)
[15:13:49.848] Build status: STARTED
[15:13:49.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:93:0) after 4m37s
[15:18:26.971] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:93:0)
[15:18:26.992] Build status: STARTED
[15:18:26.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:94:0) after 1m8s
[15:19:35.012] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:94:0)
[15:19:35.029] Build status: STARTED
[15:19:35.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:95:0) after 2m13s
[15:21:48.278] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:95:0)
[15:21:48.295] Build status: STARTED
[15:21:48.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:96:0) after 7m38s
[15:29:26.430] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:96:0)
[15:29:26.467] Build status: STARTED
[15:29:26.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:97:0) after 5m57s
[15:35:23.626] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:97:0)
[15:35:23.648] Build status: STARTED
[15:35:23.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:98:0) after 5m24s
[15:40:47.714] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:98:0)
[15:40:47.731] Build status: STARTED
[15:40:47.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:99:0) after 4m58s
[15:45:45.815] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:99:0)
[15:45:45.836] Build status: STARTED
[15:45:45.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:100:0) after 7m33s
[15:53:19.082] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:100:0)
[15:53:19.105] Build status: STARTED
[15:53:19.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:101:0) after 2m18s
[15:55:37.120] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:101:0)
[15:55:37.161] Build status: STARTED
[15:55:37.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:102:0) after 5m25s
[16:01:02.441] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:102:0)
[16:01:02.474] Build status: STARTED
[16:01:02.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:103:0) after 6m37s
[16:07:39.513] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:103:0)
[16:07:39.560] Build status: STARTED
[16:07:39.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:104:0) after 2m35s
[16:10:14.894] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:104:0)
[16:10:14.974] Build status: STARTED
[16:10:14.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:105:0) after 2m17s
[16:12:31.998] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:105:0)
[16:12:32.018] Build status: STARTED
[16:12:32.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:106:0) after 6m42s
[16:19:14.149] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:106:0)
[16:19:14.176] Build status: STARTED
[16:19:14.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:107:0) after 1m49s
[16:21:03.206] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:107:0)
[16:21:03.231] Build status: STARTED
[16:21:03.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:108:0) after 2m50s
[16:23:53.253] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:108:0)
[16:23:53.283] Build status: STARTED
[16:23:53.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:109:0) after 8m0s
[16:31:53.561] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:109:0)
[16:31:53.581] Build status: STARTED
[16:31:53.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:110:0) after 9m52s
[16:41:45.950] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:110:0)
[16:41:45.971] Build status: STARTED
[16:41:45.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:111:0) after 3m37s
[16:45:23.003] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:111:0)
[16:45:23.038] Build status: STARTED
[16:45:23.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:112:0) after 6m40s
[16:52:03.332] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:112:0)
[16:52:03.349] Build status: STARTED
[16:52:03.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:113:0) after 8m15s
[17:00:18.952] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:113:0)
[17:00:19.002] Build status: STARTED
[17:00:19.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:114:0) after 3m13s
[17:03:32.130] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:114:0)
[17:03:32.287] Build status: STARTED
[17:03:32.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:115:0) after 2m5s
[17:05:37.310] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:115:0)
[17:05:37.331] Build status: STARTED
[17:05:37.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:116:0) after 8m1s
[17:13:38.390] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:116:0)
[17:13:38.412] Build status: STARTED
[17:13:38.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:117:0) after 8m35s
[17:22:13.436] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:117:0)
[17:22:13.455] Build status: STARTED
[17:22:13.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:118:0) after 1m32s
[17:23:45.534] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:118:0)
[17:23:45.558] Build status: STARTED
[17:23:45.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:119:0) after 5m47s
[17:29:32.691] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:119:0)
[17:29:32.719] Build status: STARTED
[17:29:32.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:120:0) after 4m12s
[17:33:44.863] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:120:0)
[17:33:44.883] Build status: STARTED
[17:33:44.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:121:0) after 6m49s
[17:40:34.034] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:121:0)
[17:40:34.057] Build status: STARTED
[17:40:34.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946028763243817328:122:0) after 6m42s
[17:46:47.991] Received PubSub notification, asking Buildbucket for the build status
[17:46:48.012] Build:
{
"id": "8780598701276987601",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 19001,
"createdBy": "project:chromium",
"createTime": "2023-05-20T06:52:38.130970070Z",
"startTime": "2023-05-20T06:56:59.932012Z",
"endTime": "2023-05-20T17:46:47.698782136Z",
"updateTime": "2023-05-20T17:46:47.698782136Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "750874ebaf7e445887cd81746861703fea637cba",
"ref": "refs/heads/main"
}
}
}
[17:46:48.012] Invocation finished in 10h54m11.142507031s with status FAILED