[01:25:18.543] New invocation is queued and will start shortly
[01:25:19.625] Starting the invocation (attempt 1)
[01:25:19.670] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c67ba4617883712fc9574ab8532b1870b528322c"
[01:25:19.670] Popped gitiles commit info from properties and tags
[01:25:19.670] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:25:19.670] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:25:19.670] Buildbucket request:
{
"requestId": "8947589503959554432",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c67ba4617883712fc9574ab8532b1870b528322c",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8947589503959554432"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:25:20.096] Scheduled build:
{
"id": "8782159442028778353",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 18957,
"createdBy": "project:chromium",
"createTime": "2023-05-03T01:25:19.760547891Z",
"updateTime": "2023-05-03T01:25:19.760547891Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c67ba4617883712fc9574ab8532b1870b528322c",
"ref": "refs/heads/main"
}
}
}
[01:25:20.096] Task URL: https://cr-buildbucket.appspot.com/build/8782159442028778353
[01:25:20.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:2:0) after 4m5s
[01:27:03.556] Received PubSub notification, asking Buildbucket for the build status
[01:27:03.600] Build status: STARTED
[01:29:25.136] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:2:0)
[01:29:25.166] Build status: STARTED
[01:29:25.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:4:0) after 7m35s
[01:37:00.302] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:4:0)
[01:37:00.329] Build status: STARTED
[01:37:00.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:5:0) after 5m51s
[01:42:51.661] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:5:0)
[01:42:51.744] Build status: STARTED
[01:42:51.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:6:0) after 1m25s
[01:44:16.867] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:6:0)
[01:44:16.888] Build status: STARTED
[01:44:16.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:7:0) after 3m8s
[01:47:25.099] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:7:0)
[01:47:25.149] Build status: STARTED
[01:47:25.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:8:0) after 6m43s
[01:54:08.204] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:8:0)
[01:54:08.265] Build status: STARTED
[01:54:08.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:9:0) after 1m45s
[01:55:53.646] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:9:0)
[01:55:53.668] Build status: STARTED
[01:55:53.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:10:0) after 1m46s
[01:57:39.888] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:10:0)
[01:57:39.911] Build status: STARTED
[01:57:39.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:11:0) after 9m52s
[02:07:32.078] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:11:0)
[02:07:32.100] Build status: STARTED
[02:07:32.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:12:0) after 6m44s
[02:14:16.144] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:12:0)
[02:14:16.166] Build status: STARTED
[02:14:16.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:13:0) after 5m56s
[02:20:12.207] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:13:0)
[02:20:12.230] Build status: STARTED
[02:20:12.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:14:0) after 2m36s
[02:22:48.443] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:14:0)
[02:22:48.482] Build status: STARTED
[02:22:48.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:15:0) after 5m5s
[02:27:53.571] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:15:0)
[02:27:53.635] Build status: STARTED
[02:27:53.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:16:0) after 2m49s
[02:30:42.723] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:16:0)
[02:30:42.745] Build status: STARTED
[02:30:42.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:17:0) after 6m22s
[02:37:04.776] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:17:0)
[02:37:04.802] Build status: STARTED
[02:37:04.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:18:0) after 2m9s
[02:39:13.832] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:18:0)
[02:39:13.858] Build status: STARTED
[02:39:13.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:19:0) after 3m30s
[02:42:43.954] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:19:0)
[02:42:44.031] Build status: STARTED
[02:42:44.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:20:0) after 5m44s
[02:48:28.078] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:20:0)
[02:48:28.101] Build status: STARTED
[02:48:28.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:21:0) after 2m11s
[02:50:39.216] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:21:0)
[02:50:39.239] Build status: STARTED
[02:50:39.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:22:0) after 2m37s
[02:53:16.225] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:22:0)
[02:53:16.247] Build status: STARTED
[02:53:16.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:23:0) after 8m23s
[03:01:39.277] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:23:0)
[03:01:39.299] Build status: STARTED
[03:01:39.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:24:0) after 7m20s
[03:08:59.333] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:24:0)
[03:08:59.355] Build status: STARTED
[03:08:59.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:25:0) after 5m54s
[03:14:53.388] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:25:0)
[03:14:53.509] Build status: STARTED
[03:14:53.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:26:0) after 6m13s
[03:21:06.530] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:26:0)
[03:21:06.552] Build status: STARTED
[03:21:06.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:27:0) after 4m40s
[03:25:46.732] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:27:0)
[03:25:46.758] Build status: STARTED
[03:25:46.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:28:0) after 6m51s
[03:32:37.785] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:28:0)
[03:32:37.803] Build status: STARTED
[03:32:37.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:29:0) after 9m13s
[03:41:50.841] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:29:0)
[03:41:50.863] Build status: STARTED
[03:41:50.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:30:0) after 4m52s
[03:46:43.364] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:30:0)
[03:46:43.392] Build status: STARTED
[03:46:43.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:31:0) after 3m49s
[03:50:32.426] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:31:0)
[03:50:32.451] Build status: STARTED
[03:50:32.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:32:0) after 1m14s
[03:51:46.608] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:32:0)
[03:51:46.629] Build status: STARTED
[03:51:46.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:33:0) after 2m18s
[03:54:04.964] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:33:0)
[03:54:04.988] Build status: STARTED
[03:54:04.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:34:0) after 7m50s
[04:01:55.234] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:34:0)
[04:01:55.278] Build status: STARTED
[04:01:55.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:35:0) after 7m10s
[04:09:05.317] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:35:0)
[04:09:05.337] Build status: STARTED
[04:09:05.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:36:0) after 1m22s
[04:10:27.369] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:36:0)
[04:10:27.433] Build status: STARTED
[04:10:27.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:37:0) after 6m48s
[04:17:15.466] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:37:0)
[04:17:15.488] Build status: STARTED
[04:17:15.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:38:0) after 8m30s
[04:25:45.519] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:38:0)
[04:25:45.538] Build status: STARTED
[04:25:45.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:39:0) after 7m14s
[04:32:59.567] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:39:0)
[04:32:59.596] Build status: STARTED
[04:32:59.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:40:0) after 5m53s
[04:38:52.768] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:40:0)
[04:38:52.794] Build status: STARTED
[04:38:52.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:41:0) after 4m56s
[04:43:49.060] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:41:0)
[04:43:49.094] Build status: STARTED
[04:43:49.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:42:0) after 4m59s
[04:48:48.123] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:42:0)
[04:48:48.143] Build status: STARTED
[04:48:48.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:43:0) after 2m24s
[04:51:12.298] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:43:0)
[04:51:12.321] Build status: STARTED
[04:51:12.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:44:0) after 5m35s
[04:56:47.351] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:44:0)
[04:56:47.372] Build status: STARTED
[04:56:47.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:45:0) after 6m8s
[05:02:55.854] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:45:0)
[05:02:55.876] Build status: STARTED
[05:02:55.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:46:0) after 5m34s
[05:08:30.094] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:46:0)
[05:08:30.184] Build status: STARTED
[05:08:30.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:47:0) after 8m48s
[05:17:18.212] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:47:0)
[05:17:18.240] Build status: STARTED
[05:17:18.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:48:0) after 9m48s
[05:27:06.326] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:48:0)
[05:27:06.346] Build status: STARTED
[05:27:06.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:49:0) after 3m1s
[05:30:07.486] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:49:0)
[05:30:07.508] Build status: STARTED
[05:30:07.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:50:0) after 5m21s
[05:35:28.539] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:50:0)
[05:35:28.560] Build status: STARTED
[05:35:28.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:51:0) after 2m51s
[05:38:19.652] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:51:0)
[05:38:19.727] Build status: STARTED
[05:38:19.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:52:0) after 9m48s
[05:48:07.768] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:52:0)
[05:48:07.931] Build status: STARTED
[05:48:07.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:53:0) after 6m49s
[05:54:56.967] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:53:0)
[05:54:56.984] Build status: STARTED
[05:54:56.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:54:0) after 1m59s
[05:56:56.189] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:54:0)
[05:56:56.282] Build status: STARTED
[05:56:56.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:55:0) after 4m43s
[06:01:39.390] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:55:0)
[06:01:39.411] Build status: STARTED
[06:01:39.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:56:0) after 3m10s
[06:04:49.602] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:56:0)
[06:04:49.628] Build status: STARTED
[06:04:49.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:57:0) after 1m1s
[06:05:50.657] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:57:0)
[06:05:50.676] Build status: STARTED
[06:05:50.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:58:0) after 3m26s
[06:09:16.712] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:58:0)
[06:09:16.736] Build status: STARTED
[06:09:16.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:59:0) after 5m20s
[06:14:36.877] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:59:0)
[06:14:36.904] Build status: STARTED
[06:14:36.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:60:0) after 1m50s
[06:16:26.940] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:60:0)
[06:16:26.969] Build status: STARTED
[06:16:26.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:61:0) after 7m22s
[06:23:48.999] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:61:0)
[06:23:49.018] Build status: STARTED
[06:23:49.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:62:0) after 9m33s
[06:33:22.350] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:62:0)
[06:33:22.393] Build status: STARTED
[06:33:22.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:63:0) after 5m27s
[06:38:49.633] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:63:0)
[06:38:49.657] Build status: STARTED
[06:38:49.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:64:0) after 9m59s
[06:48:48.776] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:64:0)
[06:48:48.808] Build status: STARTED
[06:48:48.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:65:0) after 7m29s
[06:56:17.841] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:65:0)
[06:56:17.925] Build status: STARTED
[06:56:17.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:66:0) after 6m36s
[07:02:53.961] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:66:0)
[07:02:53.982] Build status: STARTED
[07:02:53.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:67:0) after 4m45s
[07:07:39.019] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:67:0)
[07:07:39.042] Build status: STARTED
[07:07:39.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:68:0) after 7m37s
[07:15:16.100] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:68:0)
[07:15:16.121] Build status: STARTED
[07:15:16.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:69:0) after 6m57s
[07:22:13.228] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:69:0)
[07:22:13.247] Build status: STARTED
[07:22:13.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:70:0) after 2m15s
[07:24:28.287] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:70:0)
[07:24:28.308] Build status: STARTED
[07:24:28.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:71:0) after 3m24s
[07:27:52.386] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:71:0)
[07:27:52.407] Build status: STARTED
[07:27:52.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:72:0) after 1m17s
[07:29:09.540] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:72:0)
[07:29:09.564] Build status: STARTED
[07:29:09.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:73:0) after 1m3s
[07:30:12.631] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:73:0)
[07:30:12.702] Build status: STARTED
[07:30:12.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:74:0) after 6m43s
[07:36:55.995] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:74:0)
[07:36:56.019] Build status: STARTED
[07:36:56.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:75:0) after 3m38s
[07:40:34.101] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:75:0)
[07:40:34.122] Build status: STARTED
[07:40:34.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:76:0) after 6m49s
[07:47:23.153] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:76:0)
[07:47:23.213] Build status: STARTED
[07:47:23.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:77:0) after 8m18s
[07:55:41.243] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:77:0)
[07:55:41.266] Build status: STARTED
[07:55:41.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:78:0) after 6m17s
[08:01:58.307] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:78:0)
[08:01:58.324] Build status: STARTED
[08:01:58.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:79:0) after 3m53s
[08:05:51.488] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:79:0)
[08:05:51.509] Build status: STARTED
[08:05:51.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:80:0) after 8m49s
[08:14:40.867] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:80:0)
[08:14:40.899] Build status: STARTED
[08:14:40.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:81:0) after 8m51s
[08:23:31.974] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:81:0)
[08:23:31.994] Build status: STARTED
[08:23:31.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:82:0) after 5m33s
[08:29:05.024] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:82:0)
[08:29:05.048] Build status: STARTED
[08:29:05.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:83:0) after 6m51s
[08:35:56.079] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:83:0)
[08:35:56.096] Build status: STARTED
[08:35:56.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:84:0) after 9m48s
[08:45:44.288] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:84:0)
[08:45:44.309] Build status: STARTED
[08:45:44.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:85:0) after 2m47s
[08:48:31.579] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:85:0)
[08:48:31.632] Build status: STARTED
[08:48:31.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:86:0) after 5m17s
[08:53:48.671] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:86:0)
[08:53:48.698] Build status: STARTED
[08:53:48.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:87:0) after 9m13s
[09:03:02.143] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:87:0)
[09:03:02.201] Build status: STARTED
[09:03:02.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:88:0) after 1m45s
[09:04:47.290] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:88:0)
[09:04:47.312] Build status: STARTED
[09:04:47.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:89:0) after 4m19s
[09:09:06.381] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:89:0)
[09:09:06.412] Build status: STARTED
[09:09:06.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:90:0) after 9m28s
[09:18:34.445] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:90:0)
[09:18:34.509] Build status: STARTED
[09:18:34.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:91:0) after 9m8s
[09:27:42.748] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:91:0)
[09:27:42.772] Build status: STARTED
[09:27:42.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:92:0) after 3m54s
[09:31:37.038] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:92:0)
[09:31:37.061] Build status: STARTED
[09:31:37.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:93:0) after 8m28s
[09:40:05.137] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:93:0)
[09:40:05.189] Build status: STARTED
[09:40:05.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:94:0) after 9m1s
[09:49:06.259] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:94:0)
[09:49:06.278] Build status: STARTED
[09:49:06.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:95:0) after 5m27s
[09:54:33.310] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:95:0)
[09:54:33.334] Build status: STARTED
[09:54:33.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:96:0) after 1m56s
[09:56:29.452] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:96:0)
[09:56:29.487] Build status: STARTED
[09:56:29.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:97:0) after 3m36s
[10:00:05.515] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:97:0)
[10:00:05.549] Build status: STARTED
[10:00:05.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:98:0) after 4m16s
[10:04:21.617] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:98:0)
[10:04:21.638] Build status: STARTED
[10:04:21.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:99:0) after 4m53s
[10:09:14.671] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:99:0)
[10:09:14.691] Build status: STARTED
[10:09:14.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:100:0) after 2m34s
[10:11:48.899] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:100:0)
[10:11:48.928] Build status: STARTED
[10:11:48.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:101:0) after 5m43s
[10:17:32.179] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:101:0)
[10:17:32.204] Build status: STARTED
[10:17:32.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:102:0) after 6m23s
[10:23:55.235] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:102:0)
[10:23:55.253] Build status: STARTED
[10:23:55.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:103:0) after 2m38s
[10:26:33.285] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:103:0)
[10:26:33.311] Build status: STARTED
[10:26:33.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:104:0) after 3m56s
[10:30:29.338] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:104:0)
[10:30:29.382] Build status: STARTED
[10:30:29.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:105:0) after 5m26s
[10:35:55.421] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:105:0)
[10:35:55.450] Build status: STARTED
[10:35:55.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:106:0) after 3m31s
[10:39:26.643] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:106:0)
[10:39:26.661] Build status: STARTED
[10:39:26.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:107:0) after 6m29s
[10:45:56.044] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:107:0)
[10:45:56.064] Build status: STARTED
[10:45:56.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:108:0) after 8m56s
[10:54:52.199] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:108:0)
[10:54:52.223] Build status: STARTED
[10:54:52.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:109:0) after 7m7s
[11:01:59.354] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:109:0)
[11:01:59.372] Build status: STARTED
[11:01:59.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:110:0) after 5m22s
[11:07:21.571] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:110:0)
[11:07:21.593] Build status: STARTED
[11:07:21.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:111:0) after 2m20s
[11:09:41.634] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:111:0)
[11:09:41.653] Build status: STARTED
[11:09:41.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:112:0) after 5m52s
[11:15:33.948] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:112:0)
[11:15:33.975] Build status: STARTED
[11:15:33.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:113:0) after 7m45s
[11:23:19.117] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:113:0)
[11:23:19.141] Build status: STARTED
[11:23:19.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:114:0) after 2m38s
[11:25:57.225] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:114:0)
[11:25:57.243] Build status: STARTED
[11:25:57.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:115:0) after 1m2s
[11:26:59.275] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:115:0)
[11:26:59.297] Build status: STARTED
[11:26:59.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:116:0) after 8m32s
[11:35:31.525] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:116:0)
[11:35:31.544] Build status: STARTED
[11:35:31.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:117:0) after 4m31s
[11:40:02.584] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:117:0)
[11:40:02.623] Build status: STARTED
[11:40:02.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:118:0) after 7m51s
[11:47:53.751] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:118:0)
[11:47:53.772] Build status: STARTED
[11:47:53.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:119:0) after 6m17s
[11:54:10.818] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:119:0)
[11:54:10.854] Build status: STARTED
[11:54:10.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:120:0) after 6m56s
[12:01:06.982] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:120:0)
[12:01:07.003] Build status: STARTED
[12:01:07.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947589503959554432:121:0) after 8m35s
[12:05:37.260] Received PubSub notification, asking Buildbucket for the build status
[12:05:37.279] Build:
{
"id": "8782159442028778353",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 18957,
"createdBy": "project:chromium",
"createTime": "2023-05-03T01:25:19.760547891Z",
"startTime": "2023-05-03T01:27:02.740336Z",
"endTime": "2023-05-03T12:05:36.611627161Z",
"updateTime": "2023-05-03T12:05:36.611627161Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c67ba4617883712fc9574ab8532b1870b528322c",
"ref": "refs/heads/main"
}
}
}
[12:05:37.279] Invocation finished in 10h40m18.744504114s with status FAILED