[19:55:54.341] New invocation is queued and will start shortly
[19:55:55.389] Starting the invocation (attempt 1)
[19:55:55.424] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/7e4abc5c8532dc14354ae919829ddb76b3b8d2f9"
[19:55:55.424] Popped gitiles commit info from properties and tags
[19:55:55.424] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:55:55.424] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:55:55.424] Buildbucket request:
{
"requestId": "8963102309494220448",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7e4abc5c8532dc14354ae919829ddb76b3b8d2f9",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8963102309494220448"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:55:55.877] Scheduled build:
{
"id": "8797672247603115905",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 17359,
"createdBy": "project:chromium",
"createTime": "2022-11-12T19:55:55.508341660Z",
"updateTime": "2022-11-12T19:55:55.508341660Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7e4abc5c8532dc14354ae919829ddb76b3b8d2f9",
"ref": "refs/heads/main"
}
},
"canary": true
}
[19:55:55.877] Task URL: https://cr-buildbucket.appspot.com/build/8797672247603115905
[19:55:55.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:2:0) after 8m39s
[19:56:35.466] Received PubSub notification, asking Buildbucket for the build status
[19:56:35.489] Build status: STARTED
[20:04:34.994] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:2:0)
[20:04:35.031] Build status: STARTED
[20:04:35.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:4:0) after 3m54s
[20:08:29.088] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:4:0)
[20:08:29.120] Build status: STARTED
[20:08:29.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:5:0) after 7m7s
[20:15:36.143] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:5:0)
[20:15:36.166] Build status: STARTED
[20:15:36.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:6:0) after 8m10s
[20:23:46.160] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:6:0)
[20:23:46.189] Build status: STARTED
[20:23:46.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:7:0) after 5m33s
[20:29:19.227] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:7:0)
[20:29:19.250] Build status: STARTED
[20:29:19.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:8:0) after 3m33s
[20:32:52.270] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:8:0)
[20:32:52.304] Build status: STARTED
[20:32:52.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:9:0) after 4m41s
[20:37:33.329] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:9:0)
[20:37:33.365] Build status: STARTED
[20:37:33.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:10:0) after 4m11s
[20:41:44.392] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:10:0)
[20:41:44.416] Build status: STARTED
[20:41:44.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:11:0) after 4m10s
[20:45:54.439] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:11:0)
[20:45:54.461] Build status: STARTED
[20:45:54.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:12:0) after 6m54s
[20:52:48.540] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:12:0)
[20:52:48.571] Build status: STARTED
[20:52:48.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:13:0) after 5m45s
[20:58:33.592] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:13:0)
[20:58:33.652] Build status: STARTED
[20:58:33.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:14:0) after 1m6s
[20:59:39.675] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:14:0)
[20:59:39.701] Build status: STARTED
[20:59:39.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:15:0) after 2m14s
[21:01:53.741] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:15:0)
[21:01:53.762] Build status: STARTED
[21:01:53.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:16:0) after 9m10s
[21:11:03.796] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:16:0)
[21:11:03.818] Build status: STARTED
[21:11:03.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:17:0) after 4m30s
[21:15:33.947] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:17:0)
[21:15:33.970] Build status: STARTED
[21:15:33.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:18:0) after 3m36s
[21:19:10.035] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:18:0)
[21:19:10.080] Build status: STARTED
[21:19:10.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:19:0) after 1m51s
[21:21:01.262] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:19:0)
[21:21:01.309] Build status: STARTED
[21:21:01.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:20:0) after 7m7s
[21:28:08.469] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:20:0)
[21:28:08.493] Build status: STARTED
[21:28:08.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:21:0) after 2m30s
[21:30:38.602] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:21:0)
[21:30:38.630] Build status: STARTED
[21:30:38.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:22:0) after 7m12s
[21:37:50.713] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:22:0)
[21:37:50.739] Build status: STARTED
[21:37:50.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:23:0) after 1m50s
[21:39:40.961] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:23:0)
[21:39:40.984] Build status: STARTED
[21:39:40.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:24:0) after 8m52s
[21:48:33.037] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:24:0)
[21:48:33.059] Build status: STARTED
[21:48:33.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:25:0) after 7m40s
[21:56:13.222] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:25:0)
[21:56:13.257] Build status: STARTED
[21:56:13.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:26:0) after 9m1s
[22:05:14.275] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:26:0)
[22:05:14.298] Build status: STARTED
[22:05:14.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:27:0) after 5m40s
[22:10:54.398] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:27:0)
[22:10:54.423] Build status: STARTED
[22:10:54.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:28:0) after 1m10s
[22:12:04.647] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:28:0)
[22:12:04.669] Build status: STARTED
[22:12:04.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:29:0) after 1m42s
[22:13:46.841] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:29:0)
[22:13:46.868] Build status: STARTED
[22:13:46.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:30:0) after 3m26s
[22:17:12.905] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:30:0)
[22:17:12.927] Build status: STARTED
[22:17:12.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:31:0) after 8m55s
[22:26:07.932] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:31:0)
[22:26:07.960] Build status: STARTED
[22:26:07.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:32:0) after 8m55s
[22:35:02.990] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:32:0)
[22:35:03.015] Build status: STARTED
[22:35:03.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:33:0) after 5m36s
[22:40:39.065] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:33:0)
[22:40:39.092] Build status: STARTED
[22:40:39.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:34:0) after 8m29s
[22:49:08.116] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:34:0)
[22:49:08.144] Build status: STARTED
[22:49:08.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:35:0) after 8m1s
[22:57:09.165] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:35:0)
[22:57:09.195] Build status: STARTED
[22:57:09.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:36:0) after 6m10s
[23:03:19.331] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:36:0)
[23:03:19.358] Build status: STARTED
[23:03:19.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:37:0) after 7m55s
[23:11:14.726] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:37:0)
[23:11:14.746] Build status: STARTED
[23:11:14.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:38:0) after 8m44s
[23:19:59.541] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:38:0)
[23:19:59.569] Build status: STARTED
[23:19:59.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:39:0) after 1m45s
[23:21:44.594] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:39:0)
[23:21:44.628] Build status: STARTED
[23:21:44.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:40:0) after 5m39s
[23:27:23.722] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:40:0)
[23:27:23.752] Build status: STARTED
[23:27:23.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:41:0) after 8m27s
[23:35:50.943] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:41:0)
[23:35:50.976] Build status: STARTED
[23:35:50.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:42:0) after 2m21s
[23:38:12.269] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:42:0)
[23:38:12.307] Build status: STARTED
[23:38:12.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:43:0) after 6m3s
[23:44:15.329] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:43:0)
[23:44:15.355] Build status: STARTED
[23:44:15.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:44:0) after 6m0s
[23:50:15.381] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:44:0)
[23:50:15.404] Build status: STARTED
[23:50:15.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:45:0) after 3m23s
[23:53:38.420] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:45:0)
[23:53:38.438] Build status: STARTED
[23:53:38.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:46:0) after 7m45s
[00:01:23.480] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:46:0)
[00:01:23.508] Build status: STARTED
[00:01:23.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:47:0) after 7m41s
[00:09:04.503] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:47:0)
[00:09:04.535] Build status: STARTED
[00:09:04.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:48:0) after 2m29s
[00:11:33.616] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:48:0)
[00:11:33.636] Build status: STARTED
[00:11:33.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:49:0) after 7m7s
[00:18:41.226] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:49:0)
[00:18:41.252] Build status: STARTED
[00:18:41.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:50:0) after 4m34s
[00:23:15.765] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:50:0)
[00:23:15.789] Build status: STARTED
[00:23:15.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:51:0) after 9m57s
[00:33:14.033] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:51:0)
[00:33:14.056] Build status: STARTED
[00:33:14.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:52:0) after 5m42s
[00:38:56.118] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:52:0)
[00:38:56.146] Build status: STARTED
[00:38:56.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:53:0) after 5m7s
[00:44:03.270] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:53:0)
[00:44:03.297] Build status: STARTED
[00:44:03.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:54:0) after 2m26s
[00:46:29.342] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:54:0)
[00:46:29.366] Build status: STARTED
[00:46:29.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:55:0) after 7m37s
[00:54:06.507] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:55:0)
[00:54:06.528] Build status: STARTED
[00:54:06.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:56:0) after 4m33s
[00:58:39.627] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:56:0)
[00:58:39.648] Build status: STARTED
[00:58:39.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:57:0) after 4m44s
[01:03:23.871] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:57:0)
[01:03:23.897] Build status: STARTED
[01:03:23.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:58:0) after 6m43s
[01:10:06.961] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:58:0)
[01:10:06.986] Build status: STARTED
[01:10:06.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:59:0) after 9m24s
[01:19:31.010] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:59:0)
[01:19:31.033] Build status: STARTED
[01:19:31.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:60:0) after 9m58s
[01:29:29.058] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:60:0)
[01:29:29.093] Build status: STARTED
[01:29:29.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:61:0) after 6m18s
[01:35:47.117] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:61:0)
[01:35:47.142] Build status: STARTED
[01:35:47.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:62:0) after 8m38s
[01:44:26.730] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:62:0)
[01:44:26.755] Build status: STARTED
[01:44:26.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:63:0) after 7m20s
[01:51:46.921] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:63:0)
[01:51:46.946] Build status: STARTED
[01:51:46.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:64:0) after 2m39s
[01:54:25.998] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:64:0)
[01:54:26.021] Build status: STARTED
[01:54:26.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:65:0) after 6m33s
[02:00:59.041] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:65:0)
[02:00:59.069] Build status: STARTED
[02:00:59.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:66:0) after 4m36s
[02:05:35.103] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:66:0)
[02:05:35.143] Build status: STARTED
[02:05:35.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:67:0) after 1m36s
[02:07:11.169] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:67:0)
[02:07:11.196] Build status: STARTED
[02:07:11.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:68:0) after 2m29s
[02:09:40.219] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:68:0)
[02:09:40.239] Build status: STARTED
[02:09:40.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:69:0) after 3m54s
[02:13:34.306] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:69:0)
[02:13:34.331] Build status: STARTED
[02:13:34.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:70:0) after 9m33s
[02:23:07.359] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:70:0)
[02:23:07.384] Build status: STARTED
[02:23:07.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:71:0) after 9m24s
[02:32:31.469] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:71:0)
[02:32:31.496] Build status: STARTED
[02:32:31.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:72:0) after 6m15s
[02:38:46.641] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:72:0)
[02:38:46.668] Build status: STARTED
[02:38:46.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:73:0) after 9m26s
[02:48:12.691] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:73:0)
[02:48:12.716] Build status: STARTED
[02:48:12.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:74:0) after 4m18s
[02:52:30.810] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:74:0)
[02:52:30.836] Build status: STARTED
[02:52:30.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:75:0) after 2m38s
[02:55:08.902] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:75:0)
[02:55:08.926] Build status: STARTED
[02:55:08.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:76:0) after 4m48s
[02:59:57.259] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:76:0)
[02:59:57.285] Build status: STARTED
[02:59:57.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:77:0) after 3m12s
[03:03:09.520] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:77:0)
[03:03:09.543] Build status: STARTED
[03:03:09.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:78:0) after 3m59s
[03:07:08.628] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:78:0)
[03:07:08.657] Build status: STARTED
[03:07:08.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:79:0) after 9m51s
[03:16:59.719] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:79:0)
[03:16:59.740] Build status: STARTED
[03:16:59.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:80:0) after 9m14s
[03:26:13.791] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:80:0)
[03:26:13.861] Build status: STARTED
[03:26:13.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:81:0) after 1m3s
[03:27:16.999] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:81:0)
[03:27:17.030] Build status: STARTED
[03:27:17.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:82:0) after 7m56s
[03:35:13.067] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:82:0)
[03:35:13.098] Build status: STARTED
[03:35:13.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:83:0) after 9m51s
[03:45:04.154] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:83:0)
[03:45:04.186] Build status: STARTED
[03:45:04.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:84:0) after 1m55s
[03:46:59.217] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:84:0)
[03:46:59.239] Build status: STARTED
[03:46:59.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:85:0) after 1m53s
[03:48:52.276] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:85:0)
[03:48:52.306] Build status: STARTED
[03:48:52.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:86:0) after 8m17s
[03:57:09.407] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:86:0)
[03:57:09.451] Build status: STARTED
[03:57:09.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:87:0) after 3m54s
[04:01:03.503] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:87:0)
[04:01:03.581] Build status: STARTED
[04:01:03.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:88:0) after 4m55s
[04:05:58.611] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:88:0)
[04:05:58.635] Build status: STARTED
[04:05:58.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:89:0) after 9m29s
[04:15:27.752] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:89:0)
[04:15:27.783] Build status: STARTED
[04:15:27.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:90:0) after 3m27s
[04:18:54.806] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:90:0)
[04:18:54.827] Build status: STARTED
[04:18:54.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:91:0) after 2m36s
[04:21:30.931] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:91:0)
[04:21:30.957] Build status: STARTED
[04:21:30.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:92:0) after 5m42s
[04:27:13.008] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:92:0)
[04:27:13.032] Build status: STARTED
[04:27:13.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:93:0) after 7m51s
[04:35:04.196] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:93:0)
[04:35:04.222] Build status: STARTED
[04:35:04.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:94:0) after 7m49s
[04:42:53.274] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:94:0)
[04:42:53.297] Build status: STARTED
[04:42:53.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:95:0) after 9m19s
[04:52:12.328] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:95:0)
[04:52:12.356] Build status: STARTED
[04:52:12.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:96:0) after 7m37s
[04:59:49.449] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:96:0)
[04:59:49.480] Build status: STARTED
[04:59:49.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:97:0) after 6m1s
[05:05:50.558] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:97:0)
[05:05:50.583] Build status: STARTED
[05:05:50.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:98:0) after 5m25s
[05:11:15.608] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:98:0)
[05:11:15.634] Build status: STARTED
[05:11:15.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:99:0) after 3m17s
[05:14:32.658] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:99:0)
[05:14:32.683] Build status: STARTED
[05:14:32.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:100:0) after 2m23s
[05:16:55.951] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:100:0)
[05:16:55.982] Build status: STARTED
[05:16:55.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:101:0) after 8m27s
[05:25:23.074] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:101:0)
[05:25:23.097] Build status: STARTED
[05:25:23.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:102:0) after 1m49s
[05:27:12.122] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:102:0)
[05:27:12.177] Build status: STARTED
[05:27:12.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:103:0) after 7m36s
[05:34:48.182] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:103:0)
[05:34:48.208] Build status: STARTED
[05:34:48.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:104:0) after 1m34s
[05:36:22.370] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:104:0)
[05:36:22.424] Build status: STARTED
[05:36:22.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:105:0) after 9m21s
[05:45:43.450] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:105:0)
[05:45:43.480] Build status: STARTED
[05:45:43.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:106:0) after 3m0s
[05:48:43.524] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:106:0)
[05:48:43.718] Build status: STARTED
[05:48:43.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:107:0) after 7m51s
[05:56:34.771] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:107:0)
[05:56:34.793] Build status: STARTED
[05:56:34.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:108:0) after 6m29s
[06:03:03.818] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:108:0)
[06:03:03.851] Build status: STARTED
[06:03:03.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:109:0) after 1m54s
[06:04:57.879] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:109:0)
[06:04:57.902] Build status: STARTED
[06:04:57.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:110:0) after 1m3s
[06:06:00.929] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:110:0)
[06:06:00.956] Build status: STARTED
[06:06:00.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:111:0) after 4m29s
[06:10:29.966] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:111:0)
[06:10:29.991] Build status: STARTED
[06:10:29.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:112:0) after 1m44s
[06:12:14.043] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:112:0)
[06:12:14.074] Build status: STARTED
[06:12:14.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:113:0) after 2m18s
[06:14:32.137] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:113:0)
[06:14:32.159] Build status: STARTED
[06:14:32.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:114:0) after 8m18s
[06:22:50.230] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:114:0)
[06:22:50.258] Build status: STARTED
[06:22:50.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:115:0) after 3m57s
[06:26:48.116] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:115:0)
[06:26:48.151] Build status: STARTED
[06:26:48.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:116:0) after 6m58s
[06:33:46.175] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:116:0)
[06:33:46.199] Build status: STARTED
[06:33:46.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:117:0) after 2m37s
[06:36:23.229] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:117:0)
[06:36:23.253] Build status: STARTED
[06:36:23.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:118:0) after 2m49s
[06:39:12.637] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:118:0)
[06:39:12.661] Build status: STARTED
[06:39:12.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:119:0) after 6m27s
[06:45:39.686] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:119:0)
[06:45:39.709] Build status: STARTED
[06:45:39.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:120:0) after 3m0s
[06:48:39.977] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:120:0)
[06:48:40.000] Build status: STARTED
[06:48:40.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:121:0) after 1m7s
[06:49:47.178] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:121:0)
[06:49:47.218] Build status: STARTED
[06:49:47.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:122:0) after 2m34s
[06:52:21.252] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:122:0)
[06:52:21.281] Build status: STARTED
[06:52:21.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:123:0) after 7m50s
[07:00:11.294] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:123:0)
[07:00:11.318] Build status: STARTED
[07:00:11.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:124:0) after 8m11s
[07:08:22.369] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:124:0)
[07:08:22.396] Build status: STARTED
[07:08:22.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:125:0) after 4m7s
[07:12:29.520] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:125:0)
[07:12:29.547] Build status: STARTED
[07:12:29.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963102309494220448:126:0) after 8m5s
[07:18:36.065] Received PubSub notification, asking Buildbucket for the build status
[07:18:36.091] Build:
{
"id": "8797672247603115905",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 17359,
"createdBy": "project:chromium",
"createTime": "2022-11-12T19:55:55.508341660Z",
"startTime": "2022-11-12T19:56:34.806452Z",
"endTime": "2022-11-13T07:18:35.574848811Z",
"updateTime": "2022-11-13T07:18:35.574848811Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7e4abc5c8532dc14354ae919829ddb76b3b8d2f9",
"ref": "refs/heads/main"
}
},
"canary": true
}
[07:18:36.091] Invocation finished in 11h22m41.77045205s with status FAILED