[05:08:17.363] New invocation is queued and will start shortly
[05:08:18.457] Starting the invocation (attempt 1)
[05:08:18.496] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/96c1e6c96658332f9765ec4724a5e9b08fb0e8ce"
[05:08:18.496] Popped gitiles commit info from properties and tags
[05:08:18.496] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:08:18.496] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:08:18.496] Buildbucket request:
{
"requestId": "8953101890206024384",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "96c1e6c96658332f9765ec4724a5e9b08fb0e8ce",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8953101890206024384"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[05:08:19.095] Scheduled build:
{
"id": "8787671828200866225",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 18551,
"createdBy": "project:chromium",
"createTime": "2023-03-03T05:08:18.646958832Z",
"updateTime": "2023-03-03T05:08:18.646958832Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "96c1e6c96658332f9765ec4724a5e9b08fb0e8ce",
"ref": "refs/heads/main"
}
},
"canary": true
}
[05:08:19.095] Task URL: https://cr-buildbucket.appspot.com/build/8787671828200866225
[05:08:19.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:2:0) after 2m25s
[05:10:13.943] Received PubSub notification, asking Buildbucket for the build status
[05:10:13.967] Build status: STARTED
[05:10:44.293] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:2:0)
[05:10:44.318] Build status: STARTED
[05:10:44.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:4:0) after 6m52s
[05:17:36.499] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:4:0)
[05:17:36.526] Build status: STARTED
[05:17:36.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:5:0) after 6m24s
[05:24:00.648] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:5:0)
[05:24:00.760] Build status: STARTED
[05:24:00.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:6:0) after 7m43s
[05:31:43.792] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:6:0)
[05:31:43.813] Build status: STARTED
[05:31:43.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:7:0) after 4m48s
[05:36:31.838] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:7:0)
[05:36:31.862] Build status: STARTED
[05:36:31.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:8:0) after 3m20s
[05:39:51.889] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:8:0)
[05:39:51.937] Build status: STARTED
[05:39:51.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:9:0) after 6m16s
[05:46:08.103] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:9:0)
[05:46:08.122] Build status: STARTED
[05:46:08.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:10:0) after 8m3s
[05:54:11.157] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:10:0)
[05:54:11.182] Build status: STARTED
[05:54:11.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:11:0) after 2m39s
[05:56:50.215] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:11:0)
[05:56:50.246] Build status: STARTED
[05:56:50.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:12:0) after 3m39s
[06:00:29.292] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:12:0)
[06:00:29.315] Build status: STARTED
[06:00:29.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:13:0) after 9m28s
[06:09:57.491] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:13:0)
[06:09:57.538] Build status: STARTED
[06:09:57.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:14:0) after 2m51s
[06:12:48.596] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:14:0)
[06:12:48.619] Build status: STARTED
[06:12:48.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:15:0) after 5m0s
[06:17:48.829] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:15:0)
[06:17:48.851] Build status: STARTED
[06:17:48.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:16:0) after 1m44s
[06:19:32.881] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:16:0)
[06:19:32.900] Build status: STARTED
[06:19:32.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:17:0) after 1m16s
[06:20:49.008] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:17:0)
[06:20:49.027] Build status: STARTED
[06:20:49.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:18:0) after 9m20s
[06:30:09.087] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:18:0)
[06:30:09.110] Build status: STARTED
[06:30:09.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:19:0) after 7m0s
[06:37:09.144] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:19:0)
[06:37:09.191] Build status: STARTED
[06:37:09.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:20:0) after 8m16s
[06:45:25.327] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:20:0)
[06:45:25.346] Build status: STARTED
[06:45:25.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:21:0) after 8m32s
[06:53:57.390] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:21:0)
[06:53:57.497] Build status: STARTED
[06:53:57.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:22:0) after 8m5s
[07:02:02.533] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:22:0)
[07:02:02.557] Build status: STARTED
[07:02:02.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:23:0) after 7m57s
[07:09:59.570] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:23:0)
[07:09:59.847] Build status: STARTED
[07:09:59.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:24:0) after 4m39s
[07:14:38.928] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:24:0)
[07:14:38.946] Build status: STARTED
[07:14:38.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:25:0) after 3m32s
[07:18:11.121] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:25:0)
[07:18:11.142] Build status: STARTED
[07:18:11.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:26:0) after 8m5s
[07:26:16.262] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:26:0)
[07:26:16.284] Build status: STARTED
[07:26:16.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:27:0) after 9m45s
[07:36:01.354] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:27:0)
[07:36:01.499] Build status: STARTED
[07:36:01.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:28:0) after 6m47s
[07:42:48.645] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:28:0)
[07:42:48.666] Build status: STARTED
[07:42:48.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:29:0) after 8m22s
[07:51:10.695] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:29:0)
[07:51:10.720] Build status: STARTED
[07:51:10.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:30:0) after 9m47s
[08:00:57.756] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:30:0)
[08:00:57.775] Build status: STARTED
[08:00:57.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:31:0) after 8m29s
[08:09:26.971] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:31:0)
[08:09:26.993] Build status: STARTED
[08:09:26.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:32:0) after 3m35s
[08:13:02.029] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:32:0)
[08:13:02.056] Build status: STARTED
[08:13:02.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:33:0) after 3m12s
[08:16:14.119] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:33:0)
[08:16:14.181] Build status: STARTED
[08:16:14.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:34:0) after 7m13s
[08:23:27.204] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:34:0)
[08:23:27.237] Build status: STARTED
[08:23:27.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:35:0) after 6m11s
[08:29:38.338] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:35:0)
[08:29:38.362] Build status: STARTED
[08:29:38.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:36:0) after 3m47s
[08:33:25.385] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:36:0)
[08:33:25.404] Build status: STARTED
[08:33:25.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:37:0) after 9m35s
[08:43:00.449] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:37:0)
[08:43:00.472] Build status: STARTED
[08:43:00.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:38:0) after 3m35s
[08:46:35.506] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:38:0)
[08:46:35.537] Build status: STARTED
[08:46:35.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:39:0) after 2m7s
[08:48:42.625] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:39:0)
[08:48:42.646] Build status: STARTED
[08:48:42.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:40:0) after 5m33s
[08:54:15.681] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:40:0)
[08:54:15.707] Build status: STARTED
[08:54:15.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:41:0) after 5m37s
[08:59:52.742] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:41:0)
[08:59:52.761] Build status: STARTED
[08:59:52.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:42:0) after 2m19s
[09:02:11.792] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:42:0)
[09:02:11.812] Build status: STARTED
[09:02:11.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:43:0) after 6m7s
[09:08:18.941] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:43:0)
[09:08:19.044] Build status: STARTED
[09:08:19.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:44:0) after 1m42s
[09:10:01.181] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:44:0)
[09:10:01.218] Build status: STARTED
[09:10:01.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:45:0) after 1m44s
[09:11:45.343] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:45:0)
[09:11:45.366] Build status: STARTED
[09:11:45.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:46:0) after 5m9s
[09:16:54.426] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:46:0)
[09:16:54.477] Build status: STARTED
[09:16:54.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:47:0) after 9m24s
[09:26:18.595] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:47:0)
[09:26:18.617] Build status: STARTED
[09:26:18.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:48:0) after 3m57s
[09:30:15.744] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:48:0)
[09:30:15.784] Build status: STARTED
[09:30:15.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:49:0) after 8m4s
[09:38:19.827] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:49:0)
[09:38:19.850] Build status: STARTED
[09:38:19.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:50:0) after 3m5s
[09:41:24.974] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:50:0)
[09:41:24.999] Build status: STARTED
[09:41:24.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:51:0) after 5m9s
[09:46:34.294] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:51:0)
[09:46:34.331] Build status: STARTED
[09:46:34.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:52:0) after 3m12s
[09:49:46.364] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:52:0)
[09:49:46.387] Build status: STARTED
[09:49:46.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:53:0) after 5m17s
[09:55:03.592] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:53:0)
[09:55:03.612] Build status: STARTED
[09:55:03.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:54:0) after 2m48s
[09:57:51.635] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:54:0)
[09:57:51.655] Build status: STARTED
[09:57:51.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:55:0) after 2m32s
[10:00:23.697] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:55:0)
[10:00:23.780] Build status: STARTED
[10:00:23.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:56:0) after 5m15s
[10:05:38.912] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:56:0)
[10:05:38.974] Build status: STARTED
[10:05:38.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:57:0) after 5m54s
[10:11:33.071] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:57:0)
[10:11:33.093] Build status: STARTED
[10:11:33.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:58:0) after 1m59s
[10:13:32.292] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:58:0)
[10:13:32.313] Build status: STARTED
[10:13:32.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:59:0) after 8m54s
[10:22:26.438] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:59:0)
[10:22:26.480] Build status: STARTED
[10:22:26.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:60:0) after 2m35s
[10:25:01.637] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:60:0)
[10:25:01.677] Build status: STARTED
[10:25:01.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:61:0) after 8m1s
[10:33:02.834] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:61:0)
[10:33:02.858] Build status: STARTED
[10:33:02.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:62:0) after 9m14s
[10:42:17.202] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:62:0)
[10:42:17.230] Build status: STARTED
[10:42:17.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:63:0) after 7m27s
[10:49:44.468] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:63:0)
[10:49:44.490] Build status: STARTED
[10:49:44.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:64:0) after 2m1s
[10:51:45.693] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:64:0)
[10:51:45.713] Build status: STARTED
[10:51:45.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:65:0) after 7m47s
[10:59:32.801] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:65:0)
[10:59:32.825] Build status: STARTED
[10:59:32.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:66:0) after 5m56s
[11:05:28.913] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:66:0)
[11:05:28.932] Build status: STARTED
[11:05:28.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:67:0) after 9m41s
[11:15:09.990] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:67:0)
[11:15:10.021] Build status: STARTED
[11:15:10.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:68:0) after 1m14s
[11:16:24.199] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:68:0)
[11:16:24.226] Build status: STARTED
[11:16:24.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:69:0) after 7m19s
[11:23:43.446] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:69:0)
[11:23:43.467] Build status: STARTED
[11:23:43.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:70:0) after 2m50s
[11:26:33.562] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:70:0)
[11:26:33.587] Build status: STARTED
[11:26:33.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:71:0) after 1m38s
[11:28:11.665] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:71:0)
[11:28:11.684] Build status: STARTED
[11:28:11.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:72:0) after 8m0s
[11:36:12.144] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:72:0)
[11:36:12.169] Build status: STARTED
[11:36:12.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:73:0) after 6m17s
[11:42:29.208] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:73:0)
[11:42:29.230] Build status: STARTED
[11:42:29.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:74:0) after 8m3s
[11:50:32.471] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:74:0)
[11:50:32.495] Build status: STARTED
[11:50:32.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:75:0) after 1m14s
[11:51:46.536] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:75:0)
[11:51:46.577] Build status: STARTED
[11:51:46.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:76:0) after 2m56s
[11:54:42.612] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:76:0)
[11:54:42.635] Build status: STARTED
[11:54:42.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:77:0) after 4m19s
[11:59:01.662] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:77:0)
[11:59:01.684] Build status: STARTED
[11:59:01.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:78:0) after 3m21s
[12:02:22.720] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:78:0)
[12:02:22.750] Build status: STARTED
[12:02:22.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:79:0) after 7m6s
[12:09:28.942] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:79:0)
[12:09:28.981] Build status: STARTED
[12:09:28.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:80:0) after 2m24s
[12:11:53.109] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:80:0)
[12:11:53.154] Build status: STARTED
[12:11:53.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:81:0) after 7m56s
[12:19:49.301] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:81:0)
[12:19:49.324] Build status: STARTED
[12:19:49.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:82:0) after 2m52s
[12:22:41.400] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:82:0)
[12:22:41.420] Build status: STARTED
[12:22:41.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:83:0) after 1m24s
[12:24:05.516] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:83:0)
[12:24:05.535] Build status: STARTED
[12:24:05.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:84:0) after 5m3s
[12:29:08.769] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:84:0)
[12:29:08.793] Build status: STARTED
[12:29:08.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:85:0) after 3m56s
[12:33:04.925] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:85:0)
[12:33:04.945] Build status: STARTED
[12:33:04.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:86:0) after 2m8s
[12:35:12.969] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:86:0)
[12:35:12.993] Build status: STARTED
[12:35:12.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:87:0) after 3m27s
[12:38:39.979] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:87:0)
[12:38:40.003] Build status: STARTED
[12:38:40.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:88:0) after 3m47s
[12:42:27.253] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:88:0)
[12:42:27.279] Build status: STARTED
[12:42:27.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:89:0) after 5m12s
[12:47:39.316] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:89:0)
[12:47:39.343] Build status: STARTED
[12:47:39.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:90:0) after 5m48s
[12:53:27.457] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:90:0)
[12:53:27.478] Build status: STARTED
[12:53:27.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:91:0) after 4m28s
[12:57:55.757] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:91:0)
[12:57:55.783] Build status: STARTED
[12:57:55.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:92:0) after 1m35s
[12:59:30.999] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:92:0)
[12:59:31.025] Build status: STARTED
[12:59:31.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:93:0) after 9m41s
[13:09:12.153] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:93:0)
[13:09:12.173] Build status: STARTED
[13:09:12.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:94:0) after 6m45s
[13:15:57.283] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:94:0)
[13:15:57.302] Build status: STARTED
[13:15:57.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:95:0) after 4m38s
[13:20:35.285] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:95:0)
[13:20:35.316] Build status: STARTED
[13:20:35.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:96:0) after 3m13s
[13:23:48.695] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:96:0)
[13:23:48.719] Build status: STARTED
[13:23:48.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:97:0) after 1m57s
[13:25:45.763] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:97:0)
[13:25:45.790] Build status: STARTED
[13:25:45.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:98:0) after 7m33s
[13:33:18.835] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:98:0)
[13:33:18.857] Build status: STARTED
[13:33:18.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:99:0) after 5m12s
[13:38:31.165] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:99:0)
[13:38:31.208] Build status: STARTED
[13:38:31.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:100:0) after 6m19s
[13:44:50.558] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:100:0)
[13:44:50.576] Build status: STARTED
[13:44:50.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:101:0) after 5m4s
[13:49:54.935] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:101:0)
[13:49:54.953] Build status: STARTED
[13:49:54.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:102:0) after 9m44s
[13:59:39.019] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:102:0)
[13:59:39.043] Build status: STARTED
[13:59:39.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:103:0) after 2m39s
[14:02:18.184] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:103:0)
[14:02:18.232] Build status: STARTED
[14:02:18.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:104:0) after 5m4s
[14:07:22.278] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:104:0)
[14:07:22.305] Build status: STARTED
[14:07:22.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:105:0) after 2m10s
[14:09:32.418] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:105:0)
[14:09:32.450] Build status: STARTED
[14:09:32.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:106:0) after 7m52s
[14:17:24.811] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:106:0)
[14:17:24.864] Build status: STARTED
[14:17:24.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:107:0) after 4m54s
[14:22:18.962] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:107:0)
[14:22:18.990] Build status: STARTED
[14:22:18.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:108:0) after 5m0s
[14:27:19.455] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:108:0)
[14:27:19.519] Build status: STARTED
[14:27:19.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:109:0) after 4m36s
[14:31:55.957] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:109:0)
[14:31:55.980] Build status: STARTED
[14:31:55.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:110:0) after 9m5s
[14:41:01.025] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:110:0)
[14:41:01.096] Build status: STARTED
[14:41:01.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:111:0) after 9m39s
[14:50:40.179] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:111:0)
[14:50:40.206] Build status: STARTED
[14:50:40.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:112:0) after 2m46s
[14:53:26.338] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:112:0)
[14:53:26.358] Build status: STARTED
[14:53:26.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8953101890206024384:113:0) after 8m1s
[14:54:13.622] Received PubSub notification, asking Buildbucket for the build status
[14:54:13.641] Build:
{
"id": "8787671828200866225",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 18551,
"createdBy": "project:chromium",
"createTime": "2023-03-03T05:08:18.646958832Z",
"startTime": "2023-03-03T05:10:12.152052Z",
"endTime": "2023-03-03T14:54:12.322702397Z",
"updateTime": "2023-03-03T14:54:12.322702397Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "96c1e6c96658332f9765ec4724a5e9b08fb0e8ce",
"ref": "refs/heads/main"
}
},
"canary": true
}
[14:54:13.641] Invocation finished in 9h45m56.290606566s with status FAILED