[23:02:02.364] New invocation is queued and will start shortly
[23:02:03.493] Starting the invocation (attempt 1)
[23:02:03.521] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/7be8eed7d82211f721df4a2168b9173878c85bc4"
[23:02:03.521] Popped gitiles commit info from properties and tags
[23:02:03.521] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:02:03.521] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:02:03.522] Buildbucket request:
{
"requestId": "8962365823239125056",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7be8eed7d82211f721df4a2168b9173878c85bc4",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8962365823239125056"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:02:03.969] Scheduled build:
{
"id": "8796935761285220689",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 17377,
"createdBy": "project:chromium",
"createTime": "2022-11-20T23:02:03.594020859Z",
"updateTime": "2022-11-20T23:02:03.594020859Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7be8eed7d82211f721df4a2168b9173878c85bc4",
"ref": "refs/heads/main"
}
}
}
[23:02:03.970] Task URL: https://cr-buildbucket.appspot.com/build/8796935761285220689
[23:02:03.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:2:0) after 2m55s
[23:04:59.144] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:2:0)
[23:04:59.180] Build status: SCHEDULED
[23:04:59.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:3:0) after 8m33s
[23:05:39.522] Received PubSub notification, asking Buildbucket for the build status
[23:05:39.586] Build status: STARTED
[23:13:32.223] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:3:0)
[23:13:32.242] Build status: STARTED
[23:13:32.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:5:0) after 1m21s
[23:14:53.228] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:5:0)
[23:14:53.249] Build status: STARTED
[23:14:53.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:6:0) after 3m1s
[23:17:54.269] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:6:0)
[23:17:54.296] Build status: STARTED
[23:17:54.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:7:0) after 5m23s
[23:23:17.322] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:7:0)
[23:23:17.346] Build status: STARTED
[23:23:17.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:8:0) after 1m11s
[23:24:28.424] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:8:0)
[23:24:28.446] Build status: STARTED
[23:24:28.446] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:9:0) after 4m48s
[23:29:16.463] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:9:0)
[23:29:16.485] Build status: STARTED
[23:29:16.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:10:0) after 3m54s
[23:33:10.507] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:10:0)
[23:33:10.529] Build status: STARTED
[23:33:10.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:11:0) after 5m22s
[23:38:32.547] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:11:0)
[23:38:32.573] Build status: STARTED
[23:38:32.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:12:0) after 5m4s
[23:43:36.642] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:12:0)
[23:43:36.665] Build status: STARTED
[23:43:36.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:13:0) after 6m29s
[23:50:05.725] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:13:0)
[23:50:05.746] Build status: STARTED
[23:50:05.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:14:0) after 9m49s
[23:59:54.770] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:14:0)
[23:59:54.793] Build status: STARTED
[23:59:54.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:15:0) after 7m8s
[00:07:02.817] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:15:0)
[00:07:02.845] Build status: STARTED
[00:07:02.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:16:0) after 9m8s
[00:16:10.864] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:16:0)
[00:16:10.897] Build status: STARTED
[00:16:10.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:17:0) after 2m9s
[00:18:19.949] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:17:0)
[00:18:19.976] Build status: STARTED
[00:18:19.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:18:0) after 5m5s
[00:23:25.103] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:18:0)
[00:23:25.133] Build status: STARTED
[00:23:25.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:19:0) after 2m28s
[00:25:53.265] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:19:0)
[00:25:53.286] Build status: STARTED
[00:25:53.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:20:0) after 5m54s
[00:31:47.357] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:20:0)
[00:31:47.392] Build status: STARTED
[00:31:47.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:21:0) after 6m24s
[00:38:11.420] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:21:0)
[00:38:11.441] Build status: STARTED
[00:38:11.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:22:0) after 7m10s
[00:45:21.460] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:22:0)
[00:45:21.559] Build status: STARTED
[00:45:21.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:23:0) after 4m17s
[00:49:38.586] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:23:0)
[00:49:38.607] Build status: STARTED
[00:49:38.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:24:0) after 7m15s
[00:56:53.637] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:24:0)
[00:56:53.658] Build status: STARTED
[00:56:53.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:25:0) after 2m21s
[00:59:14.752] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:25:0)
[00:59:14.819] Build status: STARTED
[00:59:14.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:26:0) after 4m25s
[01:03:40.109] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:26:0)
[01:03:40.140] Build status: STARTED
[01:03:40.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:27:0) after 8m6s
[01:11:46.265] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:27:0)
[01:11:46.287] Build status: STARTED
[01:11:46.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:28:0) after 8m16s
[01:20:02.410] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:28:0)
[01:20:02.437] Build status: STARTED
[01:20:02.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:29:0) after 5m7s
[01:25:09.458] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:29:0)
[01:25:09.481] Build status: STARTED
[01:25:09.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:30:0) after 6m44s
[01:31:53.499] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:30:0)
[01:31:53.521] Build status: STARTED
[01:31:53.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:31:0) after 9m2s
[01:40:55.728] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:31:0)
[01:40:55.750] Build status: STARTED
[01:40:55.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:32:0) after 6m17s
[01:47:13.248] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:32:0)
[01:47:13.275] Build status: STARTED
[01:47:13.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:33:0) after 8m16s
[01:55:29.310] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:33:0)
[01:55:29.346] Build status: STARTED
[01:55:29.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:34:0) after 3m52s
[01:59:21.683] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:34:0)
[01:59:21.705] Build status: STARTED
[01:59:21.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:35:0) after 8m38s
[02:07:59.779] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:35:0)
[02:07:59.813] Build status: STARTED
[02:07:59.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:36:0) after 6m34s
[02:14:33.933] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:36:0)
[02:14:33.965] Build status: STARTED
[02:14:33.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:37:0) after 7m47s
[02:22:21.173] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:37:0)
[02:22:21.192] Build status: STARTED
[02:22:21.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:38:0) after 6m33s
[02:28:54.321] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:38:0)
[02:28:54.347] Build status: STARTED
[02:28:54.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:39:0) after 6m9s
[02:35:03.347] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:39:0)
[02:35:03.369] Build status: STARTED
[02:35:03.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:40:0) after 4m50s
[02:39:53.549] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:40:0)
[02:39:53.571] Build status: STARTED
[02:39:53.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:41:0) after 9m16s
[02:49:09.593] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:41:0)
[02:49:09.616] Build status: STARTED
[02:49:09.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:42:0) after 5m27s
[02:54:36.639] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:42:0)
[02:54:36.663] Build status: STARTED
[02:54:36.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:43:0) after 6m2s
[03:00:38.700] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:43:0)
[03:00:38.727] Build status: STARTED
[03:00:38.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:44:0) after 2m20s
[03:02:58.864] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:44:0)
[03:02:58.940] Build status: STARTED
[03:02:58.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:45:0) after 8m19s
[03:11:18.102] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:45:0)
[03:11:18.135] Build status: STARTED
[03:11:18.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:46:0) after 7m50s
[03:19:08.347] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:46:0)
[03:19:08.366] Build status: STARTED
[03:19:08.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:47:0) after 3m14s
[03:22:22.389] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:47:0)
[03:22:22.409] Build status: STARTED
[03:22:22.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:48:0) after 2m30s
[03:24:52.538] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:48:0)
[03:24:52.917] Build status: STARTED
[03:24:52.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:49:0) after 1m23s
[03:26:15.940] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:49:0)
[03:26:15.988] Build status: STARTED
[03:26:15.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:50:0) after 9m21s
[03:35:37.104] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:50:0)
[03:35:37.139] Build status: STARTED
[03:35:37.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:51:0) after 7m56s
[03:43:33.162] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:51:0)
[03:43:33.188] Build status: STARTED
[03:43:33.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:52:0) after 6m33s
[03:50:06.214] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:52:0)
[03:50:06.532] Build status: STARTED
[03:50:06.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:53:0) after 9m46s
[03:59:52.635] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:53:0)
[03:59:52.657] Build status: STARTED
[03:59:52.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:54:0) after 2m53s
[04:02:45.678] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:54:0)
[04:02:45.706] Build status: STARTED
[04:02:45.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:55:0) after 8m4s
[04:10:49.855] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:55:0)
[04:10:49.877] Build status: STARTED
[04:10:49.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:56:0) after 7m0s
[04:17:49.937] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:56:0)
[04:17:49.965] Build status: STARTED
[04:17:49.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:57:0) after 6m35s
[04:24:25.049] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:57:0)
[04:24:25.073] Build status: STARTED
[04:24:25.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:58:0) after 4m15s
[04:28:40.101] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:58:0)
[04:28:40.128] Build status: STARTED
[04:28:40.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:59:0) after 7m9s
[04:35:49.145] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:59:0)
[04:35:49.180] Build status: STARTED
[04:35:49.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:60:0) after 8m8s
[04:43:57.890] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:60:0)
[04:43:57.954] Build status: STARTED
[04:43:57.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:61:0) after 5m10s
[04:49:07.973] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:61:0)
[04:49:07.993] Build status: STARTED
[04:49:07.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:62:0) after 3m29s
[04:52:37.101] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:62:0)
[04:52:37.126] Build status: STARTED
[04:52:37.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:63:0) after 7m23s
[05:00:00.137] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:63:0)
[05:00:00.160] Build status: STARTED
[05:00:00.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:64:0) after 7m41s
[05:07:41.245] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:64:0)
[05:07:41.273] Build status: STARTED
[05:07:41.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:65:0) after 7m58s
[05:15:39.323] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:65:0)
[05:15:39.392] Build status: STARTED
[05:15:39.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:66:0) after 8m37s
[05:24:16.824] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:66:0)
[05:24:16.861] Build status: STARTED
[05:24:16.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:67:0) after 1m17s
[05:25:33.892] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:67:0)
[05:25:33.917] Build status: STARTED
[05:25:33.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:68:0) after 8m26s
[05:33:59.940] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:68:0)
[05:33:59.959] Build status: STARTED
[05:33:59.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:69:0) after 5m52s
[05:39:52.075] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:69:0)
[05:39:52.098] Build status: STARTED
[05:39:52.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:70:0) after 3m33s
[05:43:25.333] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:70:0)
[05:43:25.357] Build status: STARTED
[05:43:25.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:71:0) after 9m1s
[05:52:26.386] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:71:0)
[05:52:26.420] Build status: STARTED
[05:52:26.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:72:0) after 9m36s
[06:02:02.531] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:72:0)
[06:02:02.554] Build status: STARTED
[06:02:02.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:73:0) after 9m45s
[06:11:47.905] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:73:0)
[06:11:47.930] Build status: STARTED
[06:11:47.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:74:0) after 5m30s
[06:17:18.236] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:74:0)
[06:17:18.259] Build status: STARTED
[06:17:18.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:75:0) after 2m9s
[06:19:27.391] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:75:0)
[06:19:27.582] Build status: STARTED
[06:19:27.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:76:0) after 9m40s
[06:29:07.670] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:76:0)
[06:29:07.696] Build status: STARTED
[06:29:07.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:77:0) after 2m8s
[06:31:15.730] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:77:0)
[06:31:15.757] Build status: STARTED
[06:31:15.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:78:0) after 5m51s
[06:37:06.801] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:78:0)
[06:37:06.824] Build status: STARTED
[06:37:06.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:79:0) after 4m37s
[06:41:43.845] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:79:0)
[06:41:43.869] Build status: STARTED
[06:41:43.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:80:0) after 4m8s
[06:45:51.961] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:80:0)
[06:45:51.988] Build status: STARTED
[06:45:51.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:81:0) after 8m31s
[06:54:23.219] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:81:0)
[06:54:23.284] Build status: STARTED
[06:54:23.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:82:0) after 6m42s
[07:01:05.471] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:82:0)
[07:01:05.495] Build status: STARTED
[07:01:05.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:83:0) after 6m3s
[07:07:08.623] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:83:0)
[07:07:08.644] Build status: STARTED
[07:07:08.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:84:0) after 2m8s
[07:09:16.678] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:84:0)
[07:09:16.703] Build status: STARTED
[07:09:16.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:85:0) after 1m34s
[07:10:50.902] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:85:0)
[07:10:50.925] Build status: STARTED
[07:10:50.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:86:0) after 5m26s
[07:16:16.959] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:86:0)
[07:16:16.996] Build status: STARTED
[07:16:16.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:87:0) after 8m6s
[07:24:23.176] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:87:0)
[07:24:23.198] Build status: STARTED
[07:24:23.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:88:0) after 3m15s
[07:27:38.217] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:88:0)
[07:27:38.237] Build status: STARTED
[07:27:38.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:89:0) after 6m36s
[07:34:14.274] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:89:0)
[07:34:14.329] Build status: STARTED
[07:34:14.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:90:0) after 4m40s
[07:38:54.570] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:90:0)
[07:38:54.603] Build status: STARTED
[07:38:54.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:91:0) after 1m57s
[07:40:51.626] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:91:0)
[07:40:51.651] Build status: STARTED
[07:40:51.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:92:0) after 9m41s
[07:50:32.778] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:92:0)
[07:50:32.811] Build status: STARTED
[07:50:32.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:93:0) after 5m27s
[07:55:59.909] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:93:0)
[07:55:59.944] Build status: STARTED
[07:55:59.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:94:0) after 6m25s
[08:02:24.959] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:94:0)
[08:02:24.993] Build status: STARTED
[08:02:24.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:95:0) after 4m40s
[08:07:05.295] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:95:0)
[08:07:05.326] Build status: STARTED
[08:07:05.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:96:0) after 5m19s
[08:12:24.490] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:96:0)
[08:12:24.522] Build status: STARTED
[08:12:24.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:97:0) after 4m36s
[08:17:00.542] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:97:0)
[08:17:00.571] Build status: STARTED
[08:17:00.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:98:0) after 4m9s
[08:21:09.736] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:98:0)
[08:21:09.797] Build status: STARTED
[08:21:09.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:99:0) after 1m28s
[08:22:38.279] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:99:0)
[08:22:38.302] Build status: STARTED
[08:22:38.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:100:0) after 6m56s
[08:29:34.321] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:100:0)
[08:29:34.344] Build status: STARTED
[08:29:34.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:101:0) after 7m24s
[08:36:58.380] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:101:0)
[08:36:58.401] Build status: STARTED
[08:36:58.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:102:0) after 3m33s
[08:40:31.432] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:102:0)
[08:40:31.457] Build status: STARTED
[08:40:31.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:103:0) after 6m42s
[08:47:13.569] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:103:0)
[08:47:13.595] Build status: STARTED
[08:47:13.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:104:0) after 6m9s
[08:53:22.614] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:104:0)
[08:53:22.638] Build status: STARTED
[08:53:22.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:105:0) after 1m2s
[08:54:24.663] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:105:0)
[08:54:24.686] Build status: STARTED
[08:54:24.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:106:0) after 6m44s
[09:01:08.723] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:106:0)
[09:01:08.774] Build status: STARTED
[09:01:08.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:107:0) after 4m31s
[09:05:39.812] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:107:0)
[09:05:39.840] Build status: STARTED
[09:05:39.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:108:0) after 8m9s
[09:13:48.899] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:108:0)
[09:13:48.922] Build status: STARTED
[09:13:48.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:109:0) after 6m19s
[09:20:07.931] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:109:0)
[09:20:07.955] Build status: STARTED
[09:20:07.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:110:0) after 7m39s
[09:27:47.065] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:110:0)
[09:27:47.098] Build status: STARTED
[09:27:47.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:111:0) after 4m45s
[09:32:32.120] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:111:0)
[09:32:32.149] Build status: STARTED
[09:32:32.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:112:0) after 1m4s
[09:33:36.263] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:112:0)
[09:33:36.286] Build status: STARTED
[09:33:36.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:113:0) after 2m43s
[09:36:19.397] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:113:0)
[09:36:19.429] Build status: STARTED
[09:36:19.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:114:0) after 6m34s
[09:42:53.457] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:114:0)
[09:42:53.484] Build status: STARTED
[09:42:53.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:115:0) after 9m40s
[09:52:33.603] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:115:0)
[09:52:33.633] Build status: STARTED
[09:52:33.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:116:0) after 7m42s
[10:00:15.755] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:116:0)
[10:00:15.778] Build status: STARTED
[10:00:15.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:117:0) after 4m58s
[10:05:14.142] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:117:0)
[10:05:14.169] Build status: STARTED
[10:05:14.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:118:0) after 3m38s
[10:08:52.294] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:118:0)
[10:08:52.322] Build status: STARTED
[10:08:52.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:119:0) after 7m4s
[10:15:56.333] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:119:0)
[10:15:56.483] Build status: STARTED
[10:15:56.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:120:0) after 4m20s
[10:20:16.596] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:120:0)
[10:20:16.640] Build status: STARTED
[10:20:16.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962365823239125056:121:0) after 6m48s
[10:21:44.825] Received PubSub notification, asking Buildbucket for the build status
[10:21:44.845] Build:
{
"id": "8796935761285220689",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 17377,
"createdBy": "project:chromium",
"createTime": "2022-11-20T23:02:03.594020859Z",
"startTime": "2022-11-20T23:05:38.598859Z",
"endTime": "2022-11-21T10:21:44.601276190Z",
"updateTime": "2022-11-21T10:21:44.601276190Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7be8eed7d82211f721df4a2168b9173878c85bc4",
"ref": "refs/heads/main"
}
}
}
[10:21:44.845] Invocation finished in 11h19m42.497782922s with status FAILED