[04:16:04.548] New invocation is queued and will start shortly
[04:16:05.907] Starting the invocation (attempt 1)
[04:16:05.946] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/cc9d0a3b35775e259bc571cea14251f0dd6c4ef0"
[04:16:05.946] Popped gitiles commit info from properties and tags
[04:16:05.946] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:16:05.946] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:16:05.946] Buildbucket request:
{
"requestId": "8950115475313389360",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cc9d0a3b35775e259bc571cea14251f0dd6c4ef0",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8950115475313389360"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:16:06.451] Scheduled build:
{
"id": "8784685413056839073",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 18667,
"createdBy": "project:chromium",
"createTime": "2023-04-05T04:16:06.067515511Z",
"updateTime": "2023-04-05T04:16:06.067515511Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cc9d0a3b35775e259bc571cea14251f0dd6c4ef0",
"ref": "refs/heads/main"
}
}
}
[04:16:06.451] Task URL: https://cr-buildbucket.appspot.com/build/8784685413056839073
[04:16:06.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:2:0) after 4m55s
[04:19:32.933] Received PubSub notification, asking Buildbucket for the build status
[04:19:33.281] Build status: STARTED
[04:21:01.481] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:2:0)
[04:21:01.520] Build status: STARTED
[04:21:01.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:4:0) after 4m0s
[04:25:02.040] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:4:0)
[04:25:02.062] Build status: STARTED
[04:25:02.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:5:0) after 9m36s
[04:34:38.205] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:5:0)
[04:34:38.281] Build status: STARTED
[04:34:38.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:6:0) after 4m39s
[04:39:17.481] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:6:0)
[04:39:17.508] Build status: STARTED
[04:39:17.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:7:0) after 9m54s
[04:49:11.561] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:7:0)
[04:49:11.583] Build status: STARTED
[04:49:11.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:8:0) after 8m50s
[04:58:01.672] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:8:0)
[04:58:01.691] Build status: STARTED
[04:58:01.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:9:0) after 7m23s
[05:05:24.731] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:9:0)
[05:05:24.753] Build status: STARTED
[05:05:24.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:10:0) after 6m23s
[05:11:47.788] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:10:0)
[05:11:47.813] Build status: STARTED
[05:11:47.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:11:0) after 6m38s
[05:18:25.834] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:11:0)
[05:18:25.915] Build status: STARTED
[05:18:25.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:12:0) after 7m12s
[05:25:37.904] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:12:0)
[05:25:37.981] Build status: STARTED
[05:25:37.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:13:0) after 7m21s
[05:32:59.015] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:13:0)
[05:32:59.068] Build status: STARTED
[05:32:59.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:14:0) after 3m7s
[05:36:06.336] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:14:0)
[05:36:06.356] Build status: STARTED
[05:36:06.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:15:0) after 1m32s
[05:37:38.588] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:15:0)
[05:37:38.609] Build status: STARTED
[05:37:38.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:16:0) after 4m30s
[05:42:08.637] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:16:0)
[05:42:08.656] Build status: STARTED
[05:42:08.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:17:0) after 9m42s
[05:51:50.754] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:17:0)
[05:51:50.795] Build status: STARTED
[05:51:50.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:18:0) after 9m38s
[06:01:28.842] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:18:0)
[06:01:28.864] Build status: STARTED
[06:01:28.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:19:0) after 2m6s
[06:03:34.873] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:19:0)
[06:03:34.896] Build status: STARTED
[06:03:34.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:20:0) after 4m17s
[06:07:52.287] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:20:0)
[06:07:52.311] Build status: STARTED
[06:07:52.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:21:0) after 6m8s
[06:14:00.339] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:21:0)
[06:14:00.360] Build status: STARTED
[06:14:00.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:22:0) after 8m37s
[06:22:37.593] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:22:0)
[06:22:37.619] Build status: STARTED
[06:22:37.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:23:0) after 8m55s
[06:31:32.651] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:23:0)
[06:31:32.678] Build status: STARTED
[06:31:32.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:24:0) after 1m16s
[06:32:48.751] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:24:0)
[06:32:48.776] Build status: STARTED
[06:32:48.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:25:0) after 1m35s
[06:34:24.125] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:25:0)
[06:34:24.157] Build status: STARTED
[06:34:24.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:26:0) after 2m22s
[06:36:46.184] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:26:0)
[06:36:46.211] Build status: STARTED
[06:36:46.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:27:0) after 9m0s
[06:45:46.240] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:27:0)
[06:45:46.263] Build status: STARTED
[06:45:46.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:28:0) after 4m3s
[06:49:49.410] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:28:0)
[06:49:49.470] Build status: STARTED
[06:49:49.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:29:0) after 5m29s
[06:55:18.538] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:29:0)
[06:55:18.562] Build status: STARTED
[06:55:18.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:30:0) after 6m16s
[07:01:34.971] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:30:0)
[07:01:34.998] Build status: STARTED
[07:01:34.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:31:0) after 5m24s
[07:06:59.134] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:31:0)
[07:06:59.156] Build status: STARTED
[07:06:59.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:32:0) after 8m50s
[07:15:49.235] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:32:0)
[07:15:49.258] Build status: STARTED
[07:15:49.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:33:0) after 6m23s
[07:22:12.271] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:33:0)
[07:22:12.300] Build status: STARTED
[07:22:12.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:34:0) after 6m27s
[07:28:39.437] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:34:0)
[07:28:39.463] Build status: STARTED
[07:28:39.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:35:0) after 9m32s
[07:38:11.495] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:35:0)
[07:38:11.517] Build status: STARTED
[07:38:11.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:36:0) after 5m55s
[07:44:06.615] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:36:0)
[07:44:06.635] Build status: STARTED
[07:44:06.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:37:0) after 9m54s
[07:54:00.661] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:37:0)
[07:54:00.684] Build status: STARTED
[07:54:00.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:38:0) after 8m26s
[08:02:26.711] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:38:0)
[08:02:26.734] Build status: STARTED
[08:02:26.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:39:0) after 1m29s
[08:03:56.007] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:39:0)
[08:03:56.026] Build status: STARTED
[08:03:56.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:40:0) after 2m57s
[08:06:53.173] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:40:0)
[08:06:53.191] Build status: STARTED
[08:06:53.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:41:0) after 7m35s
[08:14:28.221] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:41:0)
[08:14:28.243] Build status: STARTED
[08:14:28.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:42:0) after 9m48s
[08:24:16.411] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:42:0)
[08:24:16.483] Build status: STARTED
[08:24:16.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:43:0) after 4m34s
[08:28:50.596] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:43:0)
[08:28:50.620] Build status: STARTED
[08:28:50.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:44:0) after 3m13s
[08:32:03.787] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:44:0)
[08:32:03.812] Build status: STARTED
[08:32:03.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:45:0) after 2m37s
[08:34:41.184] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:45:0)
[08:34:41.204] Build status: STARTED
[08:34:41.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:46:0) after 5m38s
[08:40:19.234] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:46:0)
[08:40:19.264] Build status: STARTED
[08:40:19.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:47:0) after 8m53s
[08:49:12.370] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:47:0)
[08:49:12.429] Build status: STARTED
[08:49:12.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:48:0) after 6m49s
[08:56:01.455] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:48:0)
[08:56:01.485] Build status: STARTED
[08:56:01.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:49:0) after 2m22s
[08:58:23.512] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:49:0)
[08:58:23.543] Build status: STARTED
[08:58:23.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:50:0) after 4m11s
[09:02:34.570] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:50:0)
[09:02:34.592] Build status: STARTED
[09:02:34.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:51:0) after 2m19s
[09:04:53.628] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:51:0)
[09:04:53.650] Build status: STARTED
[09:04:53.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:52:0) after 8m59s
[09:13:52.841] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:52:0)
[09:13:52.863] Build status: STARTED
[09:13:52.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:53:0) after 8m58s
[09:22:50.949] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:53:0)
[09:22:50.971] Build status: STARTED
[09:22:50.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:54:0) after 8m52s
[09:31:43.019] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:54:0)
[09:31:43.045] Build status: STARTED
[09:31:43.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:55:0) after 3m29s
[09:35:12.073] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:55:0)
[09:35:12.095] Build status: STARTED
[09:35:12.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:56:0) after 6m13s
[09:41:25.131] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:56:0)
[09:41:25.156] Build status: STARTED
[09:41:25.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:57:0) after 3m40s
[09:45:05.519] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:57:0)
[09:45:05.583] Build status: STARTED
[09:45:05.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:58:0) after 5m21s
[09:50:26.630] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:58:0)
[09:50:26.682] Build status: STARTED
[09:50:26.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:59:0) after 4m31s
[09:54:57.663] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:59:0)
[09:54:57.707] Build status: STARTED
[09:54:57.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:60:0) after 2m18s
[09:57:15.835] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:60:0)
[09:57:15.859] Build status: STARTED
[09:57:15.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:61:0) after 5m20s
[10:02:35.932] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:61:0)
[10:02:35.953] Build status: STARTED
[10:02:35.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:62:0) after 6m52s
[10:09:28.092] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:62:0)
[10:09:28.116] Build status: STARTED
[10:09:28.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:63:0) after 2m52s
[10:12:20.274] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:63:0)
[10:12:20.297] Build status: STARTED
[10:12:20.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:64:0) after 4m30s
[10:16:50.417] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:64:0)
[10:16:50.441] Build status: STARTED
[10:16:50.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:65:0) after 3m17s
[10:20:07.721] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:65:0)
[10:20:07.746] Build status: STARTED
[10:20:07.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:66:0) after 6m15s
[10:26:22.802] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:66:0)
[10:26:22.833] Build status: STARTED
[10:26:22.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:67:0) after 6m20s
[10:32:42.870] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:67:0)
[10:32:42.892] Build status: STARTED
[10:32:42.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:68:0) after 9m49s
[10:42:31.921] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:68:0)
[10:42:31.944] Build status: STARTED
[10:42:31.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:69:0) after 2m3s
[10:44:35.007] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:69:0)
[10:44:35.033] Build status: STARTED
[10:44:35.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:70:0) after 2m32s
[10:47:07.141] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:70:0)
[10:47:07.162] Build status: STARTED
[10:47:07.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:71:0) after 9m39s
[10:56:46.162] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:71:0)
[10:56:46.187] Build status: STARTED
[10:56:46.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:72:0) after 6m9s
[11:02:55.216] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:72:0)
[11:02:55.238] Build status: STARTED
[11:02:55.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:73:0) after 9m4s
[11:11:59.274] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:73:0)
[11:11:59.408] Build status: STARTED
[11:11:59.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:74:0) after 6m15s
[11:18:14.443] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:74:0)
[11:18:14.465] Build status: STARTED
[11:18:14.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:75:0) after 2m40s
[11:20:54.547] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:75:0)
[11:20:54.570] Build status: STARTED
[11:20:54.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:76:0) after 2m28s
[11:23:22.603] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:76:0)
[11:23:22.626] Build status: STARTED
[11:23:22.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:77:0) after 1m8s
[11:24:30.626] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:77:0)
[11:24:30.704] Build status: STARTED
[11:24:30.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:78:0) after 1m37s
[11:26:07.929] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:78:0)
[11:26:07.951] Build status: STARTED
[11:26:07.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:79:0) after 6m20s
[11:32:27.988] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:79:0)
[11:32:28.010] Build status: STARTED
[11:32:28.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:80:0) after 5m2s
[11:37:30.063] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:80:0)
[11:37:30.152] Build status: STARTED
[11:37:30.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:81:0) after 6m32s
[11:44:02.339] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:81:0)
[11:44:02.362] Build status: STARTED
[11:44:02.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:82:0) after 3m3s
[11:47:05.551] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:82:0)
[11:47:05.587] Build status: STARTED
[11:47:05.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:83:0) after 9m20s
[11:56:25.804] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:83:0)
[11:56:25.827] Build status: STARTED
[11:56:25.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:84:0) after 9m13s
[12:05:38.879] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:84:0)
[12:05:38.899] Build status: STARTED
[12:05:38.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:85:0) after 7m8s
[12:12:46.926] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:85:0)
[12:12:46.950] Build status: STARTED
[12:12:46.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:86:0) after 1m6s
[12:13:53.355] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:86:0)
[12:13:53.377] Build status: STARTED
[12:13:53.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:87:0) after 7m56s
[12:21:49.455] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:87:0)
[12:21:49.487] Build status: STARTED
[12:21:49.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:88:0) after 8m8s
[12:29:57.604] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:88:0)
[12:29:57.628] Build status: STARTED
[12:29:57.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:89:0) after 9m56s
[12:39:53.654] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:89:0)
[12:39:53.676] Build status: STARTED
[12:39:53.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:90:0) after 6m29s
[12:46:22.822] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:90:0)
[12:46:22.842] Build status: STARTED
[12:46:22.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:91:0) after 6m47s
[12:53:09.979] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:91:0)
[12:53:10.004] Build status: STARTED
[12:53:10.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:92:0) after 7m23s
[13:00:33.034] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:92:0)
[13:00:33.062] Build status: STARTED
[13:00:33.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:93:0) after 7m32s
[13:08:05.168] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:93:0)
[13:08:05.193] Build status: STARTED
[13:08:05.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:94:0) after 9m7s
[13:17:12.224] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:94:0)
[13:17:12.245] Build status: STARTED
[13:17:12.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:95:0) after 4m8s
[13:21:20.281] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:95:0)
[13:21:20.328] Build status: STARTED
[13:21:20.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:96:0) after 3m35s
[13:24:55.420] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:96:0)
[13:24:55.459] Build status: STARTED
[13:24:55.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:97:0) after 2m9s
[13:27:04.734] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:97:0)
[13:27:04.769] Build status: STARTED
[13:27:04.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:98:0) after 6m33s
[13:33:37.896] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:98:0)
[13:33:37.919] Build status: STARTED
[13:33:37.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:99:0) after 9m5s
[13:42:42.957] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:99:0)
[13:42:43.015] Build status: STARTED
[13:42:43.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:100:0) after 5m39s
[13:48:22.067] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:100:0)
[13:48:22.087] Build status: STARTED
[13:48:22.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:101:0) after 5m3s
[13:53:25.128] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:101:0)
[13:53:25.146] Build status: STARTED
[13:53:25.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:102:0) after 4m16s
[13:57:41.566] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:102:0)
[13:57:41.628] Build status: STARTED
[13:57:41.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:103:0) after 2m21s
[14:00:02.675] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:103:0)
[14:00:02.736] Build status: STARTED
[14:00:02.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:104:0) after 8m59s
[14:09:01.782] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:104:0)
[14:09:01.823] Build status: STARTED
[14:09:01.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:105:0) after 8m8s
[14:17:10.125] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:105:0)
[14:17:10.154] Build status: STARTED
[14:17:10.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:106:0) after 8m17s
[14:25:27.473] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:106:0)
[14:25:27.516] Build status: STARTED
[14:25:27.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:107:0) after 1m59s
[14:27:26.549] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:107:0)
[14:27:26.570] Build status: STARTED
[14:27:26.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:108:0) after 1m25s
[14:28:51.615] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:108:0)
[14:28:51.658] Build status: STARTED
[14:28:51.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8950115475313389360:109:0) after 9m1s
[14:37:33.279] Received PubSub notification, asking Buildbucket for the build status
[14:37:33.303] Build:
{
"id": "8784685413056839073",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 18667,
"createdBy": "project:chromium",
"createTime": "2023-04-05T04:16:06.067515511Z",
"startTime": "2023-04-05T04:19:32.293940Z",
"endTime": "2023-04-05T14:37:32.568153482Z",
"updateTime": "2023-04-05T14:37:32.568153482Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cc9d0a3b35775e259bc571cea14251f0dd6c4ef0",
"ref": "refs/heads/main"
}
}
}
[14:37:33.303] Invocation finished in 10h21m28.77245097s with status FAILED