[00:20:25.218] New invocation is queued and will start shortly
[00:20:26.447] Starting the invocation (attempt 1)
[00:20:26.480] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c58ecfad5130f37dfb8451b44d83db16fc72c6b1"
[00:20:26.480] Popped gitiles commit info from properties and tags
[00:20:26.480] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:20:26.480] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:20:26.481] Buildbucket request:
{
"requestId": "8973232527907592544",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c58ecfad5130f37dfb8451b44d83db16fc72c6b1",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8973232527907592544"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[00:20:27.192] Scheduled build:
{
"id": "8807802465843650113",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 16244,
"createdBy": "project:chromium",
"createTime": "2022-07-24T00:20:26.553625776Z",
"updateTime": "2022-07-24T00:20:26.553625776Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c58ecfad5130f37dfb8451b44d83db16fc72c6b1",
"ref": "refs/heads/main"
}
}
}
[00:20:27.192] Task URL: https://cr-buildbucket.appspot.com/build/8807802465843650113
[00:20:27.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:2:0) after 5m22s
[00:20:28.555] Received PubSub notification, asking Buildbucket for the build status
[00:20:28.573] Build status: STARTED
[00:25:49.946] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:2:0)
[00:25:49.972] Build status: STARTED
[00:25:49.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:4:0) after 3m14s
[00:29:03.989] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:4:0)
[00:29:04.006] Build status: STARTED
[00:29:04.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:5:0) after 8m45s
[00:37:49.525] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:5:0)
[00:37:49.558] Build status: STARTED
[00:37:49.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:6:0) after 5m10s
[00:42:59.665] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:6:0)
[00:42:59.709] Build status: STARTED
[00:42:59.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:7:0) after 2m6s
[00:45:05.924] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:7:0)
[00:45:05.947] Build status: STARTED
[00:45:05.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:8:0) after 6m7s
[00:51:13.364] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:8:0)
[00:51:13.392] Build status: STARTED
[00:51:13.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:9:0) after 9m13s
[01:00:26.411] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:9:0)
[01:00:26.433] Build status: STARTED
[01:00:26.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:10:0) after 8m40s
[01:09:06.451] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:10:0)
[01:09:06.478] Build status: STARTED
[01:09:06.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:11:0) after 1m24s
[01:10:30.494] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:11:0)
[01:10:30.515] Build status: STARTED
[01:10:30.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:12:0) after 3m22s
[01:13:53.009] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:12:0)
[01:13:53.030] Build status: STARTED
[01:13:53.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:13:0) after 2m8s
[01:16:01.772] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:13:0)
[01:16:01.816] Build status: STARTED
[01:16:01.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:14:0) after 4m47s
[01:20:48.831] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:14:0)
[01:20:48.863] Build status: STARTED
[01:20:48.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:15:0) after 4m32s
[01:25:20.882] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:15:0)
[01:25:20.904] Build status: STARTED
[01:25:20.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:16:0) after 4m41s
[01:30:01.922] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:16:0)
[01:30:01.973] Build status: STARTED
[01:30:01.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:17:0) after 9m9s
[01:39:11.453] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:17:0)
[01:39:11.476] Build status: STARTED
[01:39:11.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:18:0) after 4m15s
[01:43:26.492] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:18:0)
[01:43:26.522] Build status: STARTED
[01:43:26.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:19:0) after 1m28s
[01:44:54.540] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:19:0)
[01:44:54.560] Build status: STARTED
[01:44:54.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:20:0) after 2m17s
[01:47:11.578] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:20:0)
[01:47:11.603] Build status: STARTED
[01:47:11.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:21:0) after 6m7s
[01:53:18.691] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:21:0)
[01:53:18.710] Build status: STARTED
[01:53:18.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:22:0) after 6m36s
[01:59:54.729] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:22:0)
[01:59:54.754] Build status: STARTED
[01:59:54.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:23:0) after 3m53s
[02:03:47.799] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:23:0)
[02:03:47.822] Build status: STARTED
[02:03:47.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:24:0) after 4m56s
[02:08:44.882] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:24:0)
[02:08:45.019] Build status: STARTED
[02:08:45.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:25:0) after 8m32s
[02:17:17.321] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:25:0)
[02:17:17.342] Build status: STARTED
[02:17:17.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:26:0) after 5m3s
[02:22:20.363] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:26:0)
[02:22:20.386] Build status: STARTED
[02:22:20.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:27:0) after 8m43s
[02:31:03.663] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:27:0)
[02:31:03.750] Build status: STARTED
[02:31:03.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:28:0) after 8m4s
[02:39:07.901] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:28:0)
[02:39:08.011] Build status: STARTED
[02:39:08.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:29:0) after 8m21s
[02:47:29.084] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:29:0)
[02:47:29.118] Build status: STARTED
[02:47:29.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:30:0) after 3m12s
[02:50:41.606] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:30:0)
[02:50:41.632] Build status: STARTED
[02:50:41.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:31:0) after 2m11s
[02:52:52.721] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:31:0)
[02:52:52.834] Build status: STARTED
[02:52:52.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:32:0) after 4m4s
[02:56:57.310] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:32:0)
[02:56:57.343] Build status: STARTED
[02:56:57.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:33:0) after 6m44s
[03:03:41.615] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:33:0)
[03:03:41.658] Build status: STARTED
[03:03:41.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:34:0) after 5m43s
[03:09:24.677] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:34:0)
[03:09:24.696] Build status: STARTED
[03:09:24.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:35:0) after 8m13s
[03:17:37.853] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:35:0)
[03:17:37.978] Build status: STARTED
[03:17:37.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:36:0) after 3m42s
[03:21:20.250] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:36:0)
[03:21:20.272] Build status: STARTED
[03:21:20.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:37:0) after 6m28s
[03:27:48.361] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:37:0)
[03:27:48.383] Build status: STARTED
[03:27:48.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:38:0) after 2m53s
[03:30:42.149] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:38:0)
[03:30:42.240] Build status: STARTED
[03:30:42.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:39:0) after 1m34s
[03:32:16.369] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:39:0)
[03:32:16.392] Build status: STARTED
[03:32:16.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:40:0) after 7m47s
[03:40:03.648] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:40:0)
[03:40:03.669] Build status: STARTED
[03:40:03.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:41:0) after 4m20s
[03:44:23.769] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:41:0)
[03:44:23.793] Build status: STARTED
[03:44:23.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:42:0) after 3m28s
[03:47:52.810] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:42:0)
[03:47:52.838] Build status: STARTED
[03:47:52.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:43:0) after 4m29s
[03:52:23.273] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:43:0)
[03:52:23.328] Build status: STARTED
[03:52:23.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:44:0) after 8m3s
[04:00:26.369] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:44:0)
[04:00:26.391] Build status: STARTED
[04:00:26.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:45:0) after 4m28s
[04:04:54.862] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:45:0)
[04:04:54.885] Build status: STARTED
[04:04:54.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:46:0) after 3m34s
[04:08:29.586] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:46:0)
[04:08:29.617] Build status: STARTED
[04:08:29.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:47:0) after 2m39s
[04:11:08.638] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:47:0)
[04:11:08.660] Build status: STARTED
[04:11:08.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:48:0) after 6m18s
[04:17:26.679] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:48:0)
[04:17:26.710] Build status: STARTED
[04:17:26.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:49:0) after 1m13s
[04:18:40.093] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:49:0)
[04:18:40.226] Build status: STARTED
[04:18:40.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:50:0) after 3m12s
[04:21:52.298] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:50:0)
[04:21:52.320] Build status: STARTED
[04:21:52.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:51:0) after 9m4s
[04:30:56.343] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:51:0)
[04:30:56.373] Build status: STARTED
[04:30:56.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:52:0) after 4m17s
[04:35:13.392] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:52:0)
[04:35:13.419] Build status: STARTED
[04:35:13.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:53:0) after 7m17s
[04:42:30.850] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:53:0)
[04:42:30.876] Build status: STARTED
[04:42:30.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:54:0) after 5m21s
[04:47:51.900] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:54:0)
[04:47:51.922] Build status: STARTED
[04:47:51.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:55:0) after 2m30s
[04:50:21.940] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:55:0)
[04:50:21.961] Build status: STARTED
[04:50:21.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:56:0) after 2m19s
[04:52:41.885] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:56:0)
[04:52:41.907] Build status: STARTED
[04:52:41.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:57:0) after 4m37s
[04:57:19.053] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:57:0)
[04:57:19.077] Build status: STARTED
[04:57:19.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:58:0) after 8m43s
[05:06:02.098] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:58:0)
[05:06:02.121] Build status: STARTED
[05:06:02.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:59:0) after 2m23s
[05:08:25.146] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:59:0)
[05:08:25.184] Build status: STARTED
[05:08:25.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:60:0) after 7m41s
[05:16:06.540] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:60:0)
[05:16:06.565] Build status: STARTED
[05:16:06.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:61:0) after 9m3s
[05:25:09.547] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:61:0)
[05:25:09.584] Build status: STARTED
[05:25:09.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:62:0) after 3m45s
[05:28:54.954] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:62:0)
[05:28:54.996] Build status: STARTED
[05:28:54.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:63:0) after 5m18s
[05:34:13.283] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:63:0)
[05:34:13.304] Build status: STARTED
[05:34:13.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:64:0) after 1m31s
[05:35:44.286] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:64:0)
[05:35:44.307] Build status: STARTED
[05:35:44.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:65:0) after 3m49s
[05:39:33.365] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:65:0)
[05:39:33.398] Build status: STARTED
[05:39:33.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:66:0) after 5m6s
[05:44:39.417] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:66:0)
[05:44:39.438] Build status: STARTED
[05:44:39.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:67:0) after 8m48s
[05:53:27.459] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:67:0)
[05:53:27.490] Build status: STARTED
[05:53:27.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:68:0) after 4m16s
[05:57:43.841] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:68:0)
[05:57:44.018] Build status: STARTED
[05:57:44.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:69:0) after 9m53s
[06:07:37.440] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:69:0)
[06:07:37.473] Build status: STARTED
[06:07:37.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:70:0) after 6m21s
[06:13:58.494] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:70:0)
[06:13:58.517] Build status: STARTED
[06:13:58.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:71:0) after 7m42s
[06:21:40.785] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:71:0)
[06:21:40.820] Build status: STARTED
[06:21:40.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:72:0) after 7m23s
[06:29:03.882] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:72:0)
[06:29:03.905] Build status: STARTED
[06:29:03.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:73:0) after 1m11s
[06:30:14.985] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:73:0)
[06:30:15.009] Build status: STARTED
[06:30:15.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:74:0) after 7m57s
[06:38:12.051] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:74:0)
[06:38:12.083] Build status: STARTED
[06:38:12.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:75:0) after 4m18s
[06:42:30.257] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:75:0)
[06:42:30.280] Build status: STARTED
[06:42:30.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:76:0) after 3m44s
[06:46:14.299] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:76:0)
[06:46:14.363] Build status: STARTED
[06:46:14.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:77:0) after 1m36s
[06:47:51.059] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:77:0)
[06:47:51.169] Build status: STARTED
[06:47:51.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:78:0) after 9m50s
[06:57:41.258] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:78:0)
[06:57:41.332] Build status: STARTED
[06:57:41.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:79:0) after 4m5s
[07:01:46.379] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:79:0)
[07:01:46.479] Build status: STARTED
[07:01:46.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:80:0) after 6m23s
[07:08:09.496] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:80:0)
[07:08:09.811] Build status: STARTED
[07:08:09.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:81:0) after 2m14s
[07:10:24.442] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:81:0)
[07:10:24.465] Build status: STARTED
[07:10:24.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:82:0) after 9m30s
[07:19:55.656] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:82:0)
[07:19:55.678] Build status: STARTED
[07:19:55.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:83:0) after 3m8s
[07:23:03.659] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:83:0)
[07:23:03.737] Build status: STARTED
[07:23:03.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:84:0) after 5m36s
[07:28:39.758] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:84:0)
[07:28:39.790] Build status: STARTED
[07:28:39.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:85:0) after 3m41s
[07:32:20.825] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:85:0)
[07:32:20.856] Build status: STARTED
[07:32:20.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:86:0) after 4m10s
[07:36:31.381] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:86:0)
[07:36:31.405] Build status: STARTED
[07:36:31.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:87:0) after 7m14s
[07:43:45.641] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:87:0)
[07:43:45.661] Build status: STARTED
[07:43:45.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:88:0) after 1m17s
[07:45:02.686] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:88:0)
[07:45:02.710] Build status: STARTED
[07:45:02.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:89:0) after 2m2s
[07:47:04.933] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:89:0)
[07:47:05.042] Build status: STARTED
[07:47:05.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:90:0) after 2m2s
[07:49:07.062] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:90:0)
[07:49:07.097] Build status: STARTED
[07:49:07.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:91:0) after 1m56s
[07:51:03.118] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:91:0)
[07:51:03.162] Build status: STARTED
[07:51:03.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:92:0) after 5m34s
[07:56:37.380] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:92:0)
[07:56:37.403] Build status: STARTED
[07:56:37.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:93:0) after 4m8s
[08:00:45.625] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:93:0)
[08:00:45.670] Build status: STARTED
[08:00:45.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:94:0) after 4m34s
[08:05:19.798] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:94:0)
[08:05:19.884] Build status: STARTED
[08:05:19.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:95:0) after 7m30s
[08:12:50.248] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:95:0)
[08:12:50.279] Build status: STARTED
[08:12:50.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:96:0) after 5m17s
[08:18:07.894] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:96:0)
[08:18:07.933] Build status: STARTED
[08:18:07.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:97:0) after 3m48s
[08:21:55.956] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:97:0)
[08:21:55.979] Build status: STARTED
[08:21:55.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:98:0) after 4m36s
[08:26:32.082] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:98:0)
[08:26:32.103] Build status: STARTED
[08:26:32.103] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:99:0) after 2m4s
[08:28:36.444] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:99:0)
[08:28:36.466] Build status: STARTED
[08:28:36.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:100:0) after 6m43s
[08:35:19.545] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:100:0)
[08:35:19.567] Build status: STARTED
[08:35:19.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:101:0) after 3m33s
[08:38:52.918] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:101:0)
[08:38:52.943] Build status: STARTED
[08:38:52.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:102:0) after 2m12s
[08:41:05.237] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:102:0)
[08:41:05.271] Build status: STARTED
[08:41:05.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:103:0) after 2m28s
[08:43:33.292] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:103:0)
[08:43:33.313] Build status: STARTED
[08:43:33.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:104:0) after 8m48s
[08:52:21.304] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:104:0)
[08:52:21.338] Build status: STARTED
[08:52:21.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:105:0) after 5m1s
[08:57:22.357] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:105:0)
[08:57:22.378] Build status: STARTED
[08:57:22.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:106:0) after 6m49s
[09:04:11.510] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:106:0)
[09:04:11.536] Build status: STARTED
[09:04:11.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:107:0) after 3m43s
[09:07:54.705] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:107:0)
[09:07:54.751] Build status: STARTED
[09:07:54.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:108:0) after 9m5s
[09:17:00.106] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:108:0)
[09:17:00.126] Build status: STARTED
[09:17:00.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:109:0) after 8m42s
[09:25:42.148] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:109:0)
[09:25:42.205] Build status: STARTED
[09:25:42.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:110:0) after 5m2s
[09:30:44.279] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:110:0)
[09:30:44.329] Build status: STARTED
[09:30:44.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:111:0) after 8m48s
[09:39:32.435] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:111:0)
[09:39:32.457] Build status: STARTED
[09:39:32.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:112:0) after 6m56s
[09:46:29.521] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:112:0)
[09:46:29.559] Build status: STARTED
[09:46:29.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:113:0) after 6m47s
[09:53:16.581] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:113:0)
[09:53:16.619] Build status: STARTED
[09:53:16.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:114:0) after 8m15s
[10:01:31.646] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:114:0)
[10:01:31.670] Build status: STARTED
[10:01:31.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8973232527907592544:115:0) after 7m51s
[10:05:18.754] Received PubSub notification, asking Buildbucket for the build status
[10:05:18.777] Build:
{
"id": "8807802465843650113",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 16244,
"createdBy": "project:chromium",
"createTime": "2022-07-24T00:20:26.553625776Z",
"startTime": "2022-07-24T00:20:27.945924Z",
"endTime": "2022-07-24T10:05:18.439232564Z",
"updateTime": "2022-07-24T10:05:18.439232564Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c58ecfad5130f37dfb8451b44d83db16fc72c6b1",
"ref": "refs/heads/main"
}
}
}
[10:05:18.777] Invocation finished in 9h44m53.575821495s with status FAILED