[14:00:30.910] New invocation is queued and will start shortly
[14:00:32.225] Starting the invocation (attempt 1)
[14:00:32.265] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/142394024b430e81e623e8af92efbcbe97445699"
[14:00:32.265] Popped gitiles commit info from properties and tags
[14:00:32.265] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:00:32.265] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:00:32.265] Buildbucket request:
{
"requestId": "8962762280856237184",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "142394024b430e81e623e8af92efbcbe97445699",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8962762280856237184"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:00:32.757] Scheduled build:
{
"id": "8797332218693183233",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 17367,
"createdBy": "project:chromium",
"createTime": "2022-11-16T14:00:32.347454018Z",
"updateTime": "2022-11-16T14:00:32.347454018Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "142394024b430e81e623e8af92efbcbe97445699",
"ref": "refs/heads/main"
}
}
}
[14:00:32.757] Task URL: https://cr-buildbucket.appspot.com/build/8797332218693183233
[14:00:32.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:2:0) after 4m53s
[14:04:50.455] Received PubSub notification, asking Buildbucket for the build status
[14:04:50.484] Build status: STARTED
[14:05:25.900] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:2:0)
[14:05:26.293] Build status: STARTED
[14:05:26.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:4:0) after 2m28s
[14:07:54.316] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:4:0)
[14:07:54.344] Build status: STARTED
[14:07:54.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:5:0) after 1m56s
[14:09:50.581] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:5:0)
[14:09:51.072] Build status: STARTED
[14:09:51.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:6:0) after 6m31s
[14:16:22.244] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:6:0)
[14:16:22.313] Build status: STARTED
[14:16:22.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:7:0) after 3m1s
[14:19:23.339] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:7:0)
[14:19:23.359] Build status: STARTED
[14:19:23.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:8:0) after 7m46s
[14:27:09.564] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:8:0)
[14:27:09.594] Build status: STARTED
[14:27:09.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:9:0) after 5m13s
[14:32:22.910] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:9:0)
[14:32:22.935] Build status: STARTED
[14:32:22.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:10:0) after 3m40s
[14:36:02.999] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:10:0)
[14:36:03.024] Build status: STARTED
[14:36:03.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:11:0) after 4m8s
[14:40:11.118] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:11:0)
[14:40:11.141] Build status: STARTED
[14:40:11.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:12:0) after 9m12s
[14:49:23.273] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:12:0)
[14:49:23.297] Build status: STARTED
[14:49:23.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:13:0) after 2m17s
[14:51:40.542] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:13:0)
[14:51:40.587] Build status: STARTED
[14:51:40.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:14:0) after 8m28s
[15:00:08.620] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:14:0)
[15:00:08.649] Build status: STARTED
[15:00:08.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:15:0) after 8m50s
[15:08:58.848] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:15:0)
[15:08:58.932] Build status: STARTED
[15:08:58.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:16:0) after 6m18s
[15:15:16.987] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:16:0)
[15:15:17.008] Build status: STARTED
[15:15:17.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:17:0) after 3m38s
[15:18:55.033] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:17:0)
[15:18:55.095] Build status: STARTED
[15:18:55.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:18:0) after 7m0s
[15:25:55.123] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:18:0)
[15:25:55.148] Build status: STARTED
[15:25:55.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:19:0) after 2m4s
[15:27:59.460] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:19:0)
[15:27:59.499] Build status: STARTED
[15:27:59.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:20:0) after 9m24s
[15:37:23.531] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:20:0)
[15:37:23.558] Build status: STARTED
[15:37:23.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:21:0) after 8m35s
[15:45:58.871] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:21:0)
[15:45:59.024] Build status: STARTED
[15:45:59.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:22:0) after 2m41s
[15:48:40.287] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:22:0)
[15:48:40.311] Build status: STARTED
[15:48:40.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:23:0) after 3m47s
[15:52:27.348] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:23:0)
[15:52:27.369] Build status: STARTED
[15:52:27.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:24:0) after 4m42s
[15:57:09.905] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:24:0)
[15:57:09.930] Build status: STARTED
[15:57:09.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:25:0) after 3m1s
[16:00:10.966] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:25:0)
[16:00:10.988] Build status: STARTED
[16:00:10.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:26:0) after 9m45s
[16:09:56.231] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:26:0)
[16:09:56.256] Build status: STARTED
[16:09:56.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:27:0) after 7m39s
[16:17:35.670] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:27:0)
[16:17:35.712] Build status: STARTED
[16:17:35.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:28:0) after 8m28s
[16:26:03.810] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:28:0)
[16:26:03.841] Build status: STARTED
[16:26:03.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:29:0) after 8m20s
[16:34:24.231] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:29:0)
[16:34:24.259] Build status: STARTED
[16:34:24.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:30:0) after 5m49s
[16:40:13.302] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:30:0)
[16:40:13.590] Build status: STARTED
[16:40:13.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:31:0) after 6m49s
[16:47:02.714] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:31:0)
[16:47:02.746] Build status: STARTED
[16:47:02.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:32:0) after 2m50s
[16:49:52.779] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:32:0)
[16:49:52.848] Build status: STARTED
[16:49:52.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:33:0) after 3m42s
[16:53:34.965] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:33:0)
[16:53:35.168] Build status: STARTED
[16:53:35.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:34:0) after 5m10s
[16:58:45.180] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:34:0)
[16:58:45.205] Build status: STARTED
[16:58:45.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:35:0) after 2m29s
[17:01:14.339] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:35:0)
[17:01:14.446] Build status: STARTED
[17:01:14.446] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:36:0) after 1m47s
[17:03:01.860] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:36:0)
[17:03:01.888] Build status: STARTED
[17:03:01.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:37:0) after 9m5s
[17:12:07.090] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:37:0)
[17:12:07.165] Build status: STARTED
[17:12:07.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:38:0) after 4m47s
[17:16:54.569] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:38:0)
[17:16:54.664] Build status: STARTED
[17:16:54.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:39:0) after 3m21s
[17:20:16.561] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:39:0)
[17:20:16.583] Build status: STARTED
[17:20:16.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:40:0) after 6m53s
[17:27:09.674] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:40:0)
[17:27:09.756] Build status: STARTED
[17:27:09.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:41:0) after 3m46s
[17:30:56.173] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:41:0)
[17:30:56.199] Build status: STARTED
[17:30:56.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:42:0) after 8m51s
[17:39:47.225] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:42:0)
[17:39:47.245] Build status: STARTED
[17:39:47.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:43:0) after 2m14s
[17:42:01.297] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:43:0)
[17:42:01.323] Build status: STARTED
[17:42:01.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:44:0) after 2m48s
[17:44:49.670] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:44:0)
[17:44:49.709] Build status: STARTED
[17:44:49.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:45:0) after 8m51s
[17:53:40.870] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:45:0)
[17:53:40.894] Build status: STARTED
[17:53:40.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:46:0) after 6m59s
[18:00:40.368] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:46:0)
[18:00:40.395] Build status: STARTED
[18:00:40.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:47:0) after 5m40s
[18:06:20.506] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:47:0)
[18:06:20.529] Build status: STARTED
[18:06:20.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:48:0) after 1m33s
[18:07:53.554] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:48:0)
[18:07:53.592] Build status: STARTED
[18:07:53.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:49:0) after 6m48s
[18:14:42.048] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:49:0)
[18:14:42.076] Build status: STARTED
[18:14:42.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:50:0) after 6m29s
[18:21:11.146] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:50:0)
[18:21:11.176] Build status: STARTED
[18:21:11.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:51:0) after 4m17s
[18:25:28.267] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:51:0)
[18:25:28.317] Build status: STARTED
[18:25:28.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:52:0) after 3m57s
[18:29:25.459] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:52:0)
[18:29:25.501] Build status: STARTED
[18:29:25.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:53:0) after 3m17s
[18:32:42.761] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:53:0)
[18:32:42.785] Build status: STARTED
[18:32:42.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:54:0) after 6m46s
[18:39:28.919] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:54:0)
[18:39:28.941] Build status: STARTED
[18:39:28.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:55:0) after 6m12s
[18:45:41.291] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:55:0)
[18:45:41.346] Build status: STARTED
[18:45:41.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:56:0) after 8m10s
[18:53:51.732] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:56:0)
[18:53:51.762] Build status: STARTED
[18:53:51.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:57:0) after 9m23s
[19:03:14.903] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:57:0)
[19:03:15.052] Build status: STARTED
[19:03:15.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:58:0) after 9m14s
[19:12:29.173] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:58:0)
[19:12:29.196] Build status: STARTED
[19:12:29.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:59:0) after 5m58s
[19:18:27.393] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:59:0)
[19:18:27.431] Build status: STARTED
[19:18:27.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:60:0) after 9m28s
[19:27:55.543] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:60:0)
[19:27:55.567] Build status: STARTED
[19:27:55.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:61:0) after 2m54s
[19:30:49.592] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:61:0)
[19:30:49.622] Build status: STARTED
[19:30:49.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:62:0) after 7m50s
[19:38:39.890] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:62:0)
[19:38:39.995] Build status: STARTED
[19:38:39.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:63:0) after 7m0s
[19:45:39.981] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:63:0)
[19:45:40.012] Build status: STARTED
[19:45:40.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:64:0) after 7m37s
[19:53:18.034] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:64:0)
[19:53:18.059] Build status: STARTED
[19:53:18.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:65:0) after 8m46s
[20:02:04.088] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:65:0)
[20:02:04.113] Build status: STARTED
[20:02:04.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:66:0) after 3m6s
[20:05:10.140] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:66:0)
[20:05:10.172] Build status: STARTED
[20:05:10.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:67:0) after 1m56s
[20:07:06.211] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:67:0)
[20:07:06.240] Build status: STARTED
[20:07:06.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:68:0) after 6m8s
[20:13:14.884] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:68:0)
[20:13:15.074] Build status: STARTED
[20:13:15.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:69:0) after 4m3s
[20:17:18.093] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:69:0)
[20:17:18.119] Build status: STARTED
[20:17:18.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:70:0) after 5m40s
[20:22:58.161] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:70:0)
[20:22:58.184] Build status: STARTED
[20:22:58.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:71:0) after 2m26s
[20:25:24.212] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:71:0)
[20:25:24.234] Build status: STARTED
[20:25:24.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:72:0) after 7m33s
[20:32:57.359] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:72:0)
[20:32:57.383] Build status: STARTED
[20:32:57.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:73:0) after 5m13s
[20:38:10.377] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:73:0)
[20:38:10.399] Build status: STARTED
[20:38:10.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:74:0) after 1m32s
[20:39:44.023] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:74:0)
[20:39:44.045] Build status: STARTED
[20:39:44.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:75:0) after 8m54s
[20:48:38.653] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:75:0)
[20:48:38.968] Build status: STARTED
[20:48:38.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:76:0) after 3m44s
[20:52:23.067] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:76:0)
[20:52:23.096] Build status: STARTED
[20:52:23.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:77:0) after 5m56s
[20:58:19.079] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:77:0)
[20:58:19.101] Build status: STARTED
[20:58:19.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:78:0) after 4m46s
[21:03:05.130] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:78:0)
[21:03:05.154] Build status: STARTED
[21:03:05.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:79:0) after 9m14s
[21:12:19.221] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:79:0)
[21:12:19.243] Build status: STARTED
[21:12:19.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:80:0) after 2m6s
[21:14:25.310] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:80:0)
[21:14:25.335] Build status: STARTED
[21:14:25.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:81:0) after 2m46s
[21:17:11.444] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:81:0)
[21:17:11.471] Build status: STARTED
[21:17:11.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:82:0) after 6m15s
[21:23:26.485] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:82:0)
[21:23:26.505] Build status: STARTED
[21:23:26.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:83:0) after 4m25s
[21:27:52.028] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:83:0)
[21:27:52.091] Build status: STARTED
[21:27:52.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:84:0) after 1m28s
[21:29:20.162] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:84:0)
[21:29:20.193] Build status: STARTED
[21:29:20.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:85:0) after 4m56s
[21:34:16.254] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:85:0)
[21:34:16.275] Build status: STARTED
[21:34:16.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:86:0) after 7m33s
[21:41:49.418] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:86:0)
[21:41:49.445] Build status: STARTED
[21:41:49.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:87:0) after 1m28s
[21:43:17.504] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:87:0)
[21:43:17.527] Build status: STARTED
[21:43:17.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:88:0) after 7m12s
[21:50:29.565] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:88:0)
[21:50:29.586] Build status: STARTED
[21:50:29.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:89:0) after 5m42s
[21:56:11.612] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:89:0)
[21:56:11.638] Build status: STARTED
[21:56:11.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:90:0) after 9m15s
[22:05:26.668] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:90:0)
[22:05:26.727] Build status: STARTED
[22:05:26.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:91:0) after 2m42s
[22:08:08.799] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:91:0)
[22:08:08.829] Build status: STARTED
[22:08:08.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:92:0) after 5m19s
[22:13:27.854] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:92:0)
[22:13:27.899] Build status: STARTED
[22:13:27.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:93:0) after 9m48s
[22:23:16.186] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:93:0)
[22:23:16.206] Build status: STARTED
[22:23:16.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:94:0) after 5m25s
[22:28:41.237] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:94:0)
[22:28:41.258] Build status: STARTED
[22:28:41.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:95:0) after 1m42s
[22:30:23.289] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:95:0)
[22:30:23.321] Build status: STARTED
[22:30:23.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:96:0) after 8m26s
[22:38:49.395] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:96:0)
[22:38:49.445] Build status: STARTED
[22:38:49.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:97:0) after 6m20s
[22:45:09.472] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:97:0)
[22:45:09.490] Build status: STARTED
[22:45:09.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:98:0) after 6m37s
[22:51:46.534] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:98:0)
[22:51:46.562] Build status: STARTED
[22:51:46.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:99:0) after 8m16s
[23:00:02.694] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:99:0)
[23:00:02.719] Build status: STARTED
[23:00:02.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:100:0) after 4m11s
[23:04:14.198] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:100:0)
[23:04:14.225] Build status: STARTED
[23:04:14.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:101:0) after 1m3s
[23:05:17.442] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:101:0)
[23:05:17.464] Build status: STARTED
[23:05:17.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:102:0) after 1m59s
[23:07:17.019] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:102:0)
[23:07:17.041] Build status: STARTED
[23:07:17.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:103:0) after 6m38s
[23:13:55.103] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:103:0)
[23:13:55.181] Build status: STARTED
[23:13:55.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:104:0) after 4m17s
[23:18:12.286] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:104:0)
[23:18:12.308] Build status: STARTED
[23:18:12.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:105:0) after 5m10s
[23:23:22.453] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:105:0)
[23:23:22.477] Build status: STARTED
[23:23:22.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:106:0) after 1m21s
[23:24:44.211] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:106:0)
[23:24:44.235] Build status: STARTED
[23:24:44.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:107:0) after 4m26s
[23:29:10.549] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:107:0)
[23:29:10.578] Build status: STARTED
[23:29:10.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:108:0) after 6m1s
[23:35:11.641] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:108:0)
[23:35:11.664] Build status: STARTED
[23:35:11.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:109:0) after 1m33s
[23:36:44.718] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:109:0)
[23:36:44.746] Build status: STARTED
[23:36:44.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:110:0) after 7m21s
[23:44:05.720] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:110:0)
[23:44:05.742] Build status: STARTED
[23:44:05.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:111:0) after 4m35s
[23:48:41.003] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:111:0)
[23:48:41.027] Build status: STARTED
[23:48:41.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:112:0) after 8m42s
[23:57:23.281] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:112:0)
[23:57:23.382] Build status: STARTED
[23:57:23.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:113:0) after 5m3s
[00:02:26.810] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:113:0)
[00:02:26.844] Build status: STARTED
[00:02:26.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:114:0) after 6m9s
[00:08:35.998] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:114:0)
[00:08:36.029] Build status: STARTED
[00:08:36.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:115:0) after 1m37s
[00:10:13.196] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:115:0)
[00:10:13.224] Build status: STARTED
[00:10:13.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:116:0) after 3m46s
[00:13:59.446] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:116:0)
[00:13:59.468] Build status: STARTED
[00:13:59.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:117:0) after 9m42s
[00:23:41.604] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:117:0)
[00:23:41.624] Build status: STARTED
[00:23:41.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:118:0) after 1m32s
[00:25:13.748] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:118:0)
[00:25:13.970] Build status: STARTED
[00:25:13.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:119:0) after 9m19s
[00:34:33.215] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:119:0)
[00:34:33.237] Build status: STARTED
[00:34:33.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:120:0) after 4m21s
[00:38:54.276] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:120:0)
[00:38:54.315] Build status: STARTED
[00:38:54.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8962762280856237184:121:0) after 4m18s
[00:41:49.790] Received PubSub notification, asking Buildbucket for the build status
[00:41:49.811] Build:
{
"id": "8797332218693183233",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 17367,
"createdBy": "project:chromium",
"createTime": "2022-11-16T14:00:32.347454018Z",
"startTime": "2022-11-16T14:04:50.008086206Z",
"endTime": "2022-11-17T00:41:49.463618413Z",
"updateTime": "2022-11-17T00:41:49.463618413Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "142394024b430e81e623e8af92efbcbe97445699",
"ref": "refs/heads/main"
}
}
}
[00:41:49.811] Invocation finished in 10h41m18.911228398s with status FAILED