[04:10:44.558] New invocation is queued and will start shortly
[04:10:45.743] Starting the invocation (attempt 1)
[04:10:45.776] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/6d3eeccc3053cda3c37d3a1f56db798cf95fba9a"
[04:10:45.776] Popped gitiles commit info from properties and tags
[04:10:45.776] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:10:45.776] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:10:45.776] Buildbucket request:
{
"requestId": "8945404768583184096",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6d3eeccc3053cda3c37d3a1f56db798cf95fba9a",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8945404768583184096"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:10:46.331] Scheduled build:
{
"id": "8779974706501219361",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 19030,
"createdBy": "project:chromium",
"createTime": "2023-05-27T04:10:45.921179868Z",
"updateTime": "2023-05-27T04:10:45.921179868Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6d3eeccc3053cda3c37d3a1f56db798cf95fba9a",
"ref": "refs/heads/main"
}
}
}
[04:10:46.331] Task URL: https://cr-buildbucket.appspot.com/build/8779974706501219361
[04:10:46.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:2:0) after 9m59s
[04:12:52.974] Received PubSub notification, asking Buildbucket for the build status
[04:12:52.990] Build status: STARTED
[04:20:45.363] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:2:0)
[04:20:45.384] Build status: STARTED
[04:20:45.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:4:0) after 1m36s
[04:22:21.414] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:4:0)
[04:22:21.431] Build status: STARTED
[04:22:21.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:5:0) after 5m49s
[04:28:10.470] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:5:0)
[04:28:10.491] Build status: STARTED
[04:28:10.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:6:0) after 6m32s
[04:34:42.529] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:6:0)
[04:34:42.548] Build status: STARTED
[04:34:42.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:7:0) after 4m19s
[04:39:01.602] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:7:0)
[04:39:01.622] Build status: STARTED
[04:39:01.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:8:0) after 1m30s
[04:40:31.659] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:8:0)
[04:40:31.679] Build status: STARTED
[04:40:31.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:9:0) after 7m27s
[04:47:58.683] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:9:0)
[04:47:58.735] Build status: STARTED
[04:47:58.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:10:0) after 8m30s
[04:56:28.761] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:10:0)
[04:56:28.783] Build status: STARTED
[04:56:28.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:11:0) after 5m39s
[05:02:07.862] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:11:0)
[05:02:07.912] Build status: STARTED
[05:02:07.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:12:0) after 3m4s
[05:05:11.957] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:12:0)
[05:05:11.982] Build status: STARTED
[05:05:11.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:13:0) after 5m49s
[05:11:01.337] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:13:0)
[05:11:01.364] Build status: STARTED
[05:11:01.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:14:0) after 3m34s
[05:14:35.386] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:14:0)
[05:14:35.405] Build status: STARTED
[05:14:35.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:15:0) after 3m52s
[05:18:27.437] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:15:0)
[05:18:27.478] Build status: STARTED
[05:18:27.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:16:0) after 1m13s
[05:19:40.579] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:16:0)
[05:19:40.599] Build status: STARTED
[05:19:40.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:17:0) after 5m1s
[05:24:41.657] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:17:0)
[05:24:41.674] Build status: STARTED
[05:24:41.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:18:0) after 3m52s
[05:28:33.694] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:18:0)
[05:28:33.713] Build status: STARTED
[05:28:33.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:19:0) after 1m25s
[05:29:58.780] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:19:0)
[05:29:58.807] Build status: STARTED
[05:29:58.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:20:0) after 5m26s
[05:35:24.985] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:20:0)
[05:35:25.010] Build status: STARTED
[05:35:25.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:21:0) after 9m10s
[05:44:35.142] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:21:0)
[05:44:35.163] Build status: STARTED
[05:44:35.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:22:0) after 8m50s
[05:53:25.189] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:22:0)
[05:53:25.207] Build status: STARTED
[05:53:25.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:23:0) after 9m46s
[06:03:11.414] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:23:0)
[06:03:11.443] Build status: STARTED
[06:03:11.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:24:0) after 7m33s
[06:10:44.561] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:24:0)
[06:10:44.630] Build status: STARTED
[06:10:44.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:25:0) after 5m50s
[06:16:34.695] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:25:0)
[06:16:34.866] Build status: STARTED
[06:16:34.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:26:0) after 4m0s
[06:20:34.891] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:26:0)
[06:20:34.910] Build status: STARTED
[06:20:34.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:27:0) after 1m48s
[06:22:22.940] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:27:0)
[06:22:23.004] Build status: STARTED
[06:22:23.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:28:0) after 5m46s
[06:28:09.130] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:28:0)
[06:28:09.150] Build status: STARTED
[06:28:09.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:29:0) after 1m55s
[06:30:04.173] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:29:0)
[06:30:04.209] Build status: STARTED
[06:30:04.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:30:0) after 1m17s
[06:31:21.245] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:30:0)
[06:31:21.264] Build status: STARTED
[06:31:21.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:31:0) after 8m36s
[06:39:57.474] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:31:0)
[06:39:57.492] Build status: STARTED
[06:39:57.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:32:0) after 6m21s
[06:46:18.516] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:32:0)
[06:46:18.539] Build status: STARTED
[06:46:18.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:33:0) after 3m44s
[06:50:02.572] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:33:0)
[06:50:02.589] Build status: STARTED
[06:50:02.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:34:0) after 8m51s
[06:58:53.672] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:34:0)
[06:58:53.689] Build status: STARTED
[06:58:53.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:35:0) after 6m46s
[07:05:39.771] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:35:0)
[07:05:39.792] Build status: STARTED
[07:05:39.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:36:0) after 6m34s
[07:12:13.863] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:36:0)
[07:12:13.881] Build status: STARTED
[07:12:13.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:37:0) after 6m19s
[07:18:32.902] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:37:0)
[07:18:32.939] Build status: STARTED
[07:18:32.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:38:0) after 1m3s
[07:19:35.971] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:38:0)
[07:19:35.990] Build status: STARTED
[07:19:35.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:39:0) after 1m45s
[07:21:21.244] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:39:0)
[07:21:21.268] Build status: STARTED
[07:21:21.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:40:0) after 2m12s
[07:23:33.399] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:40:0)
[07:23:33.416] Build status: STARTED
[07:23:33.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:41:0) after 2m8s
[07:25:41.538] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:41:0)
[07:25:41.568] Build status: STARTED
[07:25:41.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:42:0) after 8m3s
[07:33:44.729] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:42:0)
[07:33:44.746] Build status: STARTED
[07:33:44.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:43:0) after 2m34s
[07:36:18.768] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:43:0)
[07:36:18.787] Build status: STARTED
[07:36:18.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:44:0) after 3m44s
[07:40:02.844] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:44:0)
[07:40:02.887] Build status: STARTED
[07:40:02.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:45:0) after 6m8s
[07:46:10.914] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:45:0)
[07:46:10.935] Build status: STARTED
[07:46:10.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:46:0) after 7m1s
[07:53:12.113] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:46:0)
[07:53:12.135] Build status: STARTED
[07:53:12.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:47:0) after 2m7s
[07:55:19.262] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:47:0)
[07:55:19.285] Build status: STARTED
[07:55:19.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:48:0) after 2m23s
[07:57:42.404] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:48:0)
[07:57:42.480] Build status: STARTED
[07:57:42.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:49:0) after 9m13s
[08:06:55.502] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:49:0)
[08:06:55.519] Build status: STARTED
[08:06:55.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:50:0) after 5m24s
[08:12:19.649] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:50:0)
[08:12:19.694] Build status: STARTED
[08:12:19.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:51:0) after 8m21s
[08:20:40.766] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:51:0)
[08:20:40.785] Build status: STARTED
[08:20:40.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:52:0) after 7m55s
[08:28:35.810] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:52:0)
[08:28:35.830] Build status: STARTED
[08:28:35.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:53:0) after 8m36s
[08:37:11.910] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:53:0)
[08:37:11.993] Build status: STARTED
[08:37:11.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:54:0) after 3m21s
[08:40:33.191] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:54:0)
[08:40:33.218] Build status: STARTED
[08:40:33.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:55:0) after 5m14s
[08:45:47.240] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:55:0)
[08:45:47.256] Build status: STARTED
[08:45:47.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:56:0) after 2m40s
[08:48:27.279] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:56:0)
[08:48:27.298] Build status: STARTED
[08:48:27.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:57:0) after 5m40s
[08:54:07.340] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:57:0)
[08:54:07.360] Build status: STARTED
[08:54:07.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:58:0) after 2m45s
[08:56:52.454] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:58:0)
[08:56:52.478] Build status: STARTED
[08:56:52.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:59:0) after 6m13s
[09:03:05.550] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:59:0)
[09:03:05.604] Build status: STARTED
[09:03:05.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:60:0) after 2m16s
[09:05:21.626] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:60:0)
[09:05:21.709] Build status: STARTED
[09:05:21.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:61:0) after 6m42s
[09:12:03.768] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:61:0)
[09:12:03.790] Build status: STARTED
[09:12:03.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:62:0) after 8m15s
[09:20:18.830] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:62:0)
[09:20:18.851] Build status: STARTED
[09:20:18.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:63:0) after 5m28s
[09:25:46.978] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:63:0)
[09:25:46.996] Build status: STARTED
[09:25:46.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:64:0) after 3m51s
[09:29:38.105] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:64:0)
[09:29:38.131] Build status: STARTED
[09:29:38.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:65:0) after 7m44s
[09:37:22.173] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:65:0)
[09:37:22.231] Build status: STARTED
[09:37:22.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:66:0) after 3m27s
[09:40:49.357] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:66:0)
[09:40:49.378] Build status: STARTED
[09:40:49.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:67:0) after 2m27s
[09:43:16.405] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:67:0)
[09:43:16.441] Build status: STARTED
[09:43:16.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:68:0) after 9m30s
[09:52:46.469] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:68:0)
[09:52:46.528] Build status: STARTED
[09:52:46.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:69:0) after 1m50s
[09:54:36.515] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:69:0)
[09:54:36.532] Build status: STARTED
[09:54:36.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:70:0) after 6m53s
[10:01:29.594] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:70:0)
[10:01:29.616] Build status: STARTED
[10:01:29.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:71:0) after 4m10s
[10:05:39.641] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:71:0)
[10:05:39.660] Build status: STARTED
[10:05:39.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:72:0) after 6m53s
[10:12:32.685] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:72:0)
[10:12:32.704] Build status: STARTED
[10:12:32.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:73:0) after 5m6s
[10:17:38.828] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:73:0)
[10:17:38.855] Build status: STARTED
[10:17:38.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:74:0) after 2m41s
[10:20:20.045] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:74:0)
[10:20:20.065] Build status: STARTED
[10:20:20.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:75:0) after 7m22s
[10:27:42.186] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:75:0)
[10:27:42.216] Build status: STARTED
[10:27:42.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:76:0) after 4m40s
[10:32:22.216] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:76:0)
[10:32:22.238] Build status: STARTED
[10:32:22.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:77:0) after 5m14s
[10:37:36.262] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:77:0)
[10:37:36.282] Build status: STARTED
[10:37:36.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:78:0) after 6m50s
[10:44:26.414] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:78:0)
[10:44:26.441] Build status: STARTED
[10:44:26.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:79:0) after 8m31s
[10:52:57.467] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:79:0)
[10:52:57.484] Build status: STARTED
[10:52:57.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:80:0) after 5m55s
[10:58:52.661] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:80:0)
[10:58:52.706] Build status: STARTED
[10:58:52.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:81:0) after 8m31s
[11:07:24.473] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:81:0)
[11:07:24.497] Build status: STARTED
[11:07:24.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:82:0) after 1m55s
[11:09:19.700] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:82:0)
[11:09:19.718] Build status: STARTED
[11:09:19.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:83:0) after 8m47s
[11:18:06.750] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:83:0)
[11:18:06.768] Build status: STARTED
[11:18:06.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:84:0) after 2m54s
[11:21:00.824] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:84:0)
[11:21:00.841] Build status: STARTED
[11:21:00.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:85:0) after 1m27s
[11:22:27.878] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:85:0)
[11:22:27.898] Build status: STARTED
[11:22:27.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:86:0) after 6m21s
[11:28:49.133] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:86:0)
[11:28:49.149] Build status: STARTED
[11:28:49.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:87:0) after 8m11s
[11:37:00.480] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:87:0)
[11:37:00.497] Build status: STARTED
[11:37:00.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:88:0) after 6m25s
[11:43:26.045] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:88:0)
[11:43:26.067] Build status: STARTED
[11:43:26.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:89:0) after 5m0s
[11:48:26.108] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:89:0)
[11:48:26.165] Build status: STARTED
[11:48:26.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:90:0) after 7m46s
[11:56:12.194] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:90:0)
[11:56:12.213] Build status: STARTED
[11:56:12.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:91:0) after 4m24s
[12:00:36.273] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:91:0)
[12:00:36.295] Build status: STARTED
[12:00:36.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:92:0) after 4m35s
[12:05:12.322] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:92:0)
[12:05:12.341] Build status: STARTED
[12:05:12.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:93:0) after 9m11s
[12:14:23.478] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:93:0)
[12:14:23.498] Build status: STARTED
[12:14:23.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:94:0) after 6m9s
[12:20:32.542] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:94:0)
[12:20:32.560] Build status: STARTED
[12:20:32.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:95:0) after 6m7s
[12:26:39.624] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:95:0)
[12:26:39.644] Build status: STARTED
[12:26:39.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:96:0) after 1m10s
[12:27:49.672] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:96:0)
[12:27:49.694] Build status: STARTED
[12:27:49.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:97:0) after 1m44s
[12:29:33.725] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:97:0)
[12:29:33.753] Build status: STARTED
[12:29:33.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:98:0) after 7m41s
[12:37:14.778] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:98:0)
[12:37:14.799] Build status: STARTED
[12:37:14.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:99:0) after 9m36s
[12:46:50.818] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:99:0)
[12:46:50.838] Build status: STARTED
[12:46:50.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:100:0) after 8m36s
[12:55:26.872] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:100:0)
[12:55:26.898] Build status: STARTED
[12:55:26.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:101:0) after 1m19s
[12:56:46.239] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:101:0)
[12:56:46.283] Build status: STARTED
[12:56:46.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:102:0) after 5m17s
[13:02:03.616] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:102:0)
[13:02:03.667] Build status: STARTED
[13:02:03.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:103:0) after 3m7s
[13:05:10.691] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:103:0)
[13:05:10.713] Build status: STARTED
[13:05:10.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:104:0) after 5m32s
[13:10:42.747] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:104:0)
[13:10:42.765] Build status: STARTED
[13:10:42.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:105:0) after 3m49s
[13:14:31.822] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:105:0)
[13:14:31.846] Build status: STARTED
[13:14:31.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:106:0) after 1m35s
[13:16:06.876] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:106:0)
[13:16:06.894] Build status: STARTED
[13:16:06.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:107:0) after 8m4s
[13:24:11.079] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:107:0)
[13:24:11.102] Build status: STARTED
[13:24:11.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:108:0) after 2m38s
[13:26:49.126] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:108:0)
[13:26:49.146] Build status: STARTED
[13:26:49.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:109:0) after 7m42s
[13:34:31.127] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:109:0)
[13:34:31.148] Build status: STARTED
[13:34:31.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:110:0) after 5m16s
[13:39:47.173] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:110:0)
[13:39:47.194] Build status: STARTED
[13:39:47.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:111:0) after 8m34s
[13:48:21.281] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:111:0)
[13:48:21.304] Build status: STARTED
[13:48:21.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:112:0) after 3m19s
[13:51:40.399] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:112:0)
[13:51:40.420] Build status: STARTED
[13:51:40.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:113:0) after 6m3s
[13:57:43.585] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:113:0)
[13:57:43.607] Build status: STARTED
[13:57:43.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:114:0) after 1m28s
[13:59:11.632] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:114:0)
[13:59:11.652] Build status: STARTED
[13:59:11.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:115:0) after 4m12s
[14:03:23.689] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:115:0)
[14:03:23.743] Build status: STARTED
[14:03:23.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:116:0) after 9m1s
[14:12:24.849] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:116:0)
[14:12:24.869] Build status: STARTED
[14:12:24.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:117:0) after 1m31s
[14:13:55.900] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:117:0)
[14:13:55.920] Build status: STARTED
[14:13:55.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:118:0) after 2m59s
[14:16:54.952] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:118:0)
[14:16:54.973] Build status: STARTED
[14:16:54.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:119:0) after 1m33s
[14:18:28.012] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:119:0)
[14:18:28.032] Build status: STARTED
[14:18:28.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:120:0) after 4m37s
[14:23:05.130] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:120:0)
[14:23:05.151] Build status: STARTED
[14:23:05.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:121:0) after 4m15s
[14:27:20.267] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:121:0)
[14:27:20.284] Build status: STARTED
[14:27:20.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:122:0) after 7m29s
[14:34:49.390] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:122:0)
[14:34:49.408] Build status: STARTED
[14:34:49.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:123:0) after 9m52s
[14:44:41.531] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:123:0)
[14:44:41.550] Build status: STARTED
[14:44:41.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:124:0) after 9m10s
[14:53:51.583] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:124:0)
[14:53:51.604] Build status: STARTED
[14:53:51.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:125:0) after 6m32s
[15:00:23.635] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:125:0)
[15:00:23.679] Build status: STARTED
[15:00:23.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945404768583184096:126:0) after 2m0s
[15:00:25.350] Received PubSub notification, asking Buildbucket for the build status
[15:00:25.372] Build:
{
"id": "8779974706501219361",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 19030,
"createdBy": "project:chromium",
"createTime": "2023-05-27T04:10:45.921179868Z",
"startTime": "2023-05-27T04:12:49.022361Z",
"endTime": "2023-05-27T15:00:23.871860376Z",
"updateTime": "2023-05-27T15:00:23.871860376Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6d3eeccc3053cda3c37d3a1f56db798cf95fba9a",
"ref": "refs/heads/main"
}
}
}
[15:00:25.372] Invocation finished in 10h49m40.82040227s with status FAILED