[11:23:36.951] New invocation is queued and will start shortly
[11:23:38.063] Starting the invocation (attempt 1)
[11:23:38.099] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/81347175bff564c0d556b87a010037936ae6a519"
[11:23:38.099] Popped gitiles commit info from properties and tags
[11:23:38.099] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[11:23:38.099] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[11:23:38.099] Buildbucket request:
{
"requestId": "8961232003676207152",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "81347175bff564c0d556b87a010037936ae6a519",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8961232003676207152"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[11:23:38.623] Scheduled build:
{
"id": "8795801941697215169",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 17455,
"createdBy": "project:chromium",
"createTime": "2022-12-03T11:23:38.215581032Z",
"updateTime": "2022-12-03T11:23:38.215581032Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "81347175bff564c0d556b87a010037936ae6a519",
"ref": "refs/heads/main"
}
}
}
[11:23:38.623] Task URL: https://cr-buildbucket.appspot.com/build/8795801941697215169
[11:23:38.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:2:0) after 4m12s
[11:27:50.742] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:2:0)
[11:27:50.764] Build status: SCHEDULED
[11:27:50.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:3:0) after 2m48s
[11:30:38.790] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:3:0)
[11:30:38.856] Build status: SCHEDULED
[11:30:38.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:4:0) after 9m10s
[11:35:42.230] Received PubSub notification, asking Buildbucket for the build status
[11:35:42.260] Build status: STARTED
[11:39:48.977] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:4:0)
[11:39:48.999] Build status: STARTED
[11:39:48.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:6:0) after 5m32s
[11:45:21.016] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:6:0)
[11:45:21.049] Build status: STARTED
[11:45:21.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:7:0) after 2m33s
[11:47:54.160] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:7:0)
[11:47:54.194] Build status: STARTED
[11:47:54.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:8:0) after 1m15s
[11:49:09.211] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:8:0)
[11:49:09.245] Build status: STARTED
[11:49:09.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:9:0) after 4m35s
[11:53:44.265] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:9:0)
[11:53:44.287] Build status: STARTED
[11:53:44.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:10:0) after 1m36s
[11:55:20.305] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:10:0)
[11:55:20.324] Build status: STARTED
[11:55:20.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:11:0) after 4m49s
[12:00:09.405] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:11:0)
[12:00:09.443] Build status: STARTED
[12:00:09.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:12:0) after 3m12s
[12:03:21.531] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:12:0)
[12:03:21.559] Build status: STARTED
[12:03:21.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:13:0) after 2m31s
[12:05:52.587] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:13:0)
[12:05:52.614] Build status: STARTED
[12:05:52.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:14:0) after 7m33s
[12:13:25.647] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:14:0)
[12:13:25.672] Build status: STARTED
[12:13:25.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:15:0) after 6m10s
[12:19:36.613] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:15:0)
[12:19:36.634] Build status: STARTED
[12:19:36.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:16:0) after 8m32s
[12:28:08.862] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:16:0)
[12:28:08.887] Build status: STARTED
[12:28:08.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:17:0) after 1m8s
[12:29:17.020] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:17:0)
[12:29:17.049] Build status: STARTED
[12:29:17.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:18:0) after 8m25s
[12:37:42.078] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:18:0)
[12:37:42.101] Build status: STARTED
[12:37:42.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:19:0) after 2m6s
[12:39:48.117] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:19:0)
[12:39:48.141] Build status: STARTED
[12:39:48.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:20:0) after 8m25s
[12:48:13.167] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:20:0)
[12:48:13.190] Build status: STARTED
[12:48:13.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:21:0) after 9m33s
[12:57:46.409] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:21:0)
[12:57:46.431] Build status: STARTED
[12:57:46.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:22:0) after 1m46s
[12:59:32.416] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:22:0)
[12:59:32.447] Build status: STARTED
[12:59:32.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:23:0) after 3m23s
[13:02:56.005] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:23:0)
[13:02:56.030] Build status: STARTED
[13:02:56.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:24:0) after 5m30s
[13:08:26.214] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:24:0)
[13:08:26.237] Build status: STARTED
[13:08:26.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:25:0) after 8m5s
[13:16:31.563] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:25:0)
[13:16:31.671] Build status: STARTED
[13:16:31.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:26:0) after 4m30s
[13:21:01.690] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:26:0)
[13:21:01.726] Build status: STARTED
[13:21:01.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:27:0) after 1m34s
[13:22:35.750] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:27:0)
[13:22:35.775] Build status: STARTED
[13:22:35.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:28:0) after 7m0s
[13:29:35.794] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:28:0)
[13:29:35.819] Build status: STARTED
[13:29:35.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:29:0) after 3m2s
[13:32:37.882] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:29:0)
[13:32:37.904] Build status: STARTED
[13:32:37.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:30:0) after 4m18s
[13:36:55.921] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:30:0)
[13:36:55.941] Build status: STARTED
[13:36:55.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:31:0) after 6m8s
[13:43:03.956] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:31:0)
[13:43:03.984] Build status: STARTED
[13:43:03.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:32:0) after 8m1s
[13:51:05.002] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:32:0)
[13:51:05.029] Build status: STARTED
[13:51:05.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:33:0) after 3m28s
[13:54:33.138] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:33:0)
[13:54:33.164] Build status: STARTED
[13:54:33.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:34:0) after 5m55s
[14:00:28.182] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:34:0)
[14:00:28.204] Build status: STARTED
[14:00:28.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:35:0) after 7m42s
[14:08:10.432] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:35:0)
[14:08:10.460] Build status: STARTED
[14:08:10.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:36:0) after 1m23s
[14:09:33.682] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:36:0)
[14:09:33.702] Build status: STARTED
[14:09:33.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:37:0) after 8m59s
[14:18:32.819] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:37:0)
[14:18:32.846] Build status: STARTED
[14:18:32.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:38:0) after 5m9s
[14:23:41.864] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:38:0)
[14:23:41.890] Build status: STARTED
[14:23:41.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:39:0) after 4m15s
[14:27:56.922] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:39:0)
[14:27:56.956] Build status: STARTED
[14:27:56.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:40:0) after 4m44s
[14:32:40.995] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:40:0)
[14:32:41.080] Build status: STARTED
[14:32:41.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:41:0) after 6m18s
[14:38:59.286] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:41:0)
[14:38:59.307] Build status: STARTED
[14:38:59.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:42:0) after 9m18s
[14:48:17.397] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:42:0)
[14:48:17.486] Build status: STARTED
[14:48:17.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:43:0) after 2m40s
[14:50:57.812] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:43:0)
[14:50:57.888] Build status: STARTED
[14:50:57.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:44:0) after 5m23s
[14:56:21.021] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:44:0)
[14:56:21.045] Build status: STARTED
[14:56:21.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:45:0) after 3m3s
[14:59:24.173] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:45:0)
[14:59:24.204] Build status: STARTED
[14:59:24.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:46:0) after 6m5s
[15:05:29.283] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:46:0)
[15:05:29.329] Build status: STARTED
[15:05:29.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:47:0) after 6m54s
[15:12:23.382] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:47:0)
[15:12:23.466] Build status: STARTED
[15:12:23.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:48:0) after 5m7s
[15:17:30.679] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:48:0)
[15:17:30.700] Build status: STARTED
[15:17:30.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:49:0) after 4m24s
[15:21:54.714] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:49:0)
[15:21:54.737] Build status: STARTED
[15:21:54.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:50:0) after 4m59s
[15:26:53.806] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:50:0)
[15:26:53.827] Build status: STARTED
[15:26:53.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:51:0) after 7m6s
[15:33:59.931] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:51:0)
[15:33:59.958] Build status: STARTED
[15:33:59.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:52:0) after 9m27s
[15:43:27.006] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:52:0)
[15:43:27.033] Build status: STARTED
[15:43:27.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:53:0) after 9m16s
[15:52:43.053] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:53:0)
[15:52:43.075] Build status: STARTED
[15:52:43.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:54:0) after 3m1s
[15:55:44.103] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:54:0)
[15:55:44.128] Build status: STARTED
[15:55:44.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:55:0) after 2m19s
[15:58:03.328] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:55:0)
[15:58:03.365] Build status: STARTED
[15:58:03.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:56:0) after 5m53s
[16:03:56.484] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:56:0)
[16:03:56.536] Build status: STARTED
[16:03:56.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:57:0) after 6m10s
[16:10:06.567] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:57:0)
[16:10:06.591] Build status: STARTED
[16:10:06.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:58:0) after 2m59s
[16:13:05.635] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:58:0)
[16:13:05.664] Build status: STARTED
[16:13:05.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:59:0) after 8m44s
[16:21:49.658] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:59:0)
[16:21:49.682] Build status: STARTED
[16:21:49.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:60:0) after 8m36s
[16:30:25.739] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:60:0)
[16:30:25.793] Build status: STARTED
[16:30:25.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:61:0) after 5m48s
[16:36:13.875] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:61:0)
[16:36:13.903] Build status: STARTED
[16:36:13.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:62:0) after 6m32s
[16:42:46.074] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:62:0)
[16:42:46.099] Build status: STARTED
[16:42:46.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:63:0) after 3m36s
[16:46:22.126] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:63:0)
[16:46:22.199] Build status: STARTED
[16:46:22.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:64:0) after 5m53s
[16:52:15.229] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:64:0)
[16:52:15.250] Build status: STARTED
[16:52:15.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:65:0) after 6m40s
[16:58:55.268] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:65:0)
[16:58:55.303] Build status: STARTED
[16:58:55.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:66:0) after 1m29s
[17:00:24.332] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:66:0)
[17:00:24.367] Build status: STARTED
[17:00:24.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:67:0) after 7m51s
[17:08:15.400] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:67:0)
[17:08:15.427] Build status: STARTED
[17:08:15.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:68:0) after 6m38s
[17:14:53.519] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:68:0)
[17:14:53.548] Build status: STARTED
[17:14:53.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:69:0) after 2m18s
[17:17:11.566] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:69:0)
[17:17:11.595] Build status: STARTED
[17:17:11.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:70:0) after 6m21s
[17:23:32.846] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:70:0)
[17:23:32.914] Build status: STARTED
[17:23:32.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:71:0) after 9m5s
[17:32:37.931] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:71:0)
[17:32:37.957] Build status: STARTED
[17:32:37.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:72:0) after 5m9s
[17:37:46.998] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:72:0)
[17:37:47.021] Build status: STARTED
[17:37:47.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:73:0) after 5m38s
[17:43:25.041] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:73:0)
[17:43:25.134] Build status: STARTED
[17:43:25.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:74:0) after 2m26s
[17:45:51.160] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:74:0)
[17:45:51.186] Build status: STARTED
[17:45:51.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:75:0) after 2m41s
[17:48:32.214] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:75:0)
[17:48:32.244] Build status: STARTED
[17:48:32.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:76:0) after 4m26s
[17:52:58.265] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:76:0)
[17:52:58.288] Build status: STARTED
[17:52:58.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:77:0) after 4m40s
[17:57:38.312] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:77:0)
[17:57:38.334] Build status: STARTED
[17:57:38.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:78:0) after 9m40s
[18:07:18.385] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:78:0)
[18:07:18.411] Build status: STARTED
[18:07:18.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:79:0) after 9m31s
[18:16:49.440] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:79:0)
[18:16:49.471] Build status: STARTED
[18:16:49.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:80:0) after 7m8s
[18:23:57.451] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:80:0)
[18:23:57.471] Build status: STARTED
[18:23:57.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:81:0) after 1m51s
[18:25:48.513] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:81:0)
[18:25:48.545] Build status: STARTED
[18:25:48.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:82:0) after 2m6s
[18:27:54.572] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:82:0)
[18:27:54.598] Build status: STARTED
[18:27:54.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:83:0) after 6m11s
[18:34:05.716] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:83:0)
[18:34:05.747] Build status: STARTED
[18:34:05.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:84:0) after 2m8s
[18:36:13.817] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:84:0)
[18:36:13.920] Build status: STARTED
[18:36:13.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:85:0) after 6m40s
[18:42:53.943] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:85:0)
[18:42:53.965] Build status: STARTED
[18:42:53.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:86:0) after 1m19s
[18:44:12.995] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:86:0)
[18:44:13.024] Build status: STARTED
[18:44:13.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:87:0) after 3m55s
[18:48:08.044] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:87:0)
[18:48:08.068] Build status: STARTED
[18:48:08.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:88:0) after 8m29s
[18:56:37.289] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:88:0)
[18:56:37.313] Build status: STARTED
[18:56:37.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:89:0) after 7m28s
[19:04:05.442] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:89:0)
[19:04:05.480] Build status: STARTED
[19:04:05.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:90:0) after 5m58s
[19:10:03.649] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:90:0)
[19:10:03.721] Build status: STARTED
[19:10:03.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:91:0) after 9m47s
[19:19:50.792] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:91:0)
[19:19:50.822] Build status: STARTED
[19:19:50.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:92:0) after 7m0s
[19:26:50.854] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:92:0)
[19:26:50.874] Build status: STARTED
[19:26:50.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:93:0) after 4m31s
[19:31:22.047] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:93:0)
[19:31:22.069] Build status: STARTED
[19:31:22.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:94:0) after 8m11s
[19:39:33.110] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:94:0)
[19:39:33.136] Build status: STARTED
[19:39:33.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:95:0) after 1m37s
[19:41:10.349] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:95:0)
[19:41:10.370] Build status: STARTED
[19:41:10.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:96:0) after 1m3s
[19:42:13.395] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:96:0)
[19:42:13.419] Build status: STARTED
[19:42:13.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:97:0) after 4m50s
[19:47:03.439] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:97:0)
[19:47:03.462] Build status: STARTED
[19:47:03.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:98:0) after 5m51s
[19:52:54.466] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:98:0)
[19:52:54.524] Build status: STARTED
[19:52:54.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:99:0) after 6m34s
[19:59:28.546] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:99:0)
[19:59:28.568] Build status: STARTED
[19:59:28.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:100:0) after 2m8s
[20:01:36.593] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:100:0)
[20:01:36.614] Build status: STARTED
[20:01:36.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:101:0) after 4m46s
[20:06:22.703] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:101:0)
[20:06:22.727] Build status: STARTED
[20:06:22.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:102:0) after 8m11s
[20:14:33.764] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:102:0)
[20:14:33.842] Build status: STARTED
[20:14:33.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:103:0) after 4m19s
[20:18:52.860] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:103:0)
[20:18:52.887] Build status: STARTED
[20:18:52.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:104:0) after 1m58s
[20:20:50.912] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:104:0)
[20:20:50.976] Build status: STARTED
[20:20:50.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:105:0) after 8m51s
[20:29:42.166] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:105:0)
[20:29:42.191] Build status: STARTED
[20:29:42.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:106:0) after 2m53s
[20:32:35.209] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:106:0)
[20:32:35.237] Build status: STARTED
[20:32:35.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:107:0) after 1m0s
[20:33:35.365] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:107:0)
[20:33:35.387] Build status: STARTED
[20:33:35.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:108:0) after 2m59s
[20:36:34.618] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:108:0)
[20:36:34.679] Build status: STARTED
[20:36:34.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:109:0) after 8m42s
[20:45:16.804] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:109:0)
[20:45:16.828] Build status: STARTED
[20:45:16.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:110:0) after 9m27s
[20:54:43.857] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:110:0)
[20:54:43.970] Build status: STARTED
[20:54:43.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:111:0) after 9m48s
[21:04:32.097] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:111:0)
[21:04:32.124] Build status: STARTED
[21:04:32.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:112:0) after 9m12s
[21:13:44.151] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:112:0)
[21:13:44.179] Build status: STARTED
[21:13:44.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:113:0) after 3m35s
[21:17:19.201] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:113:0)
[21:17:19.223] Build status: STARTED
[21:17:19.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:114:0) after 8m28s
[21:25:47.352] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:114:0)
[21:25:47.374] Build status: STARTED
[21:25:47.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:115:0) after 9m52s
[21:35:39.405] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:115:0)
[21:35:39.430] Build status: STARTED
[21:35:39.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:116:0) after 2m37s
[21:38:16.461] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:116:0)
[21:38:16.520] Build status: STARTED
[21:38:16.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:117:0) after 4m18s
[21:42:34.578] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:117:0)
[21:42:34.601] Build status: STARTED
[21:42:34.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:118:0) after 8m8s
[21:50:42.622] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:118:0)
[21:50:42.656] Build status: STARTED
[21:50:42.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:119:0) after 7m14s
[21:57:56.676] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:119:0)
[21:57:56.699] Build status: STARTED
[21:57:56.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:120:0) after 3m47s
[22:01:44.018] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:120:0)
[22:01:44.064] Build status: STARTED
[22:01:44.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:121:0) after 3m19s
[22:05:03.088] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:121:0)
[22:05:03.114] Build status: STARTED
[22:05:03.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:122:0) after 5m4s
[22:10:07.193] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:122:0)
[22:10:07.244] Build status: STARTED
[22:10:07.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:123:0) after 7m49s
[22:17:56.335] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:123:0)
[22:17:56.361] Build status: STARTED
[22:17:56.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:124:0) after 6m18s
[22:24:14.416] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:124:0)
[22:24:14.449] Build status: STARTED
[22:24:14.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:125:0) after 8m32s
[22:32:46.473] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:125:0)
[22:32:46.500] Build status: STARTED
[22:32:46.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:126:0) after 4m26s
[22:37:12.515] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:126:0)
[22:37:12.539] Build status: STARTED
[22:37:12.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:127:0) after 2m28s
[22:39:40.557] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:127:0)
[22:39:40.583] Build status: STARTED
[22:39:40.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:128:0) after 3m2s
[22:42:42.629] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:128:0)
[22:42:42.656] Build status: STARTED
[22:42:42.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:129:0) after 2m50s
[22:45:32.783] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:129:0)
[22:45:32.809] Build status: STARTED
[22:45:32.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:130:0) after 4m6s
[22:49:39.236] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:130:0)
[22:49:39.259] Build status: STARTED
[22:49:39.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:131:0) after 6m36s
[22:56:16.987] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:131:0)
[22:56:17.012] Build status: STARTED
[22:56:17.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:132:0) after 5m14s
[23:01:31.049] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:132:0)
[23:01:31.072] Build status: STARTED
[23:01:31.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961232003676207152:133:0) after 8m27s
[23:03:33.619] Received PubSub notification, asking Buildbucket for the build status
[23:03:33.644] Build:
{
"id": "8795801941697215169",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 17455,
"createdBy": "project:chromium",
"createTime": "2022-12-03T11:23:38.215581032Z",
"startTime": "2022-12-03T11:35:41.187206Z",
"endTime": "2022-12-03T23:03:33.020229433Z",
"updateTime": "2022-12-03T23:03:33.020229433Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "81347175bff564c0d556b87a010037936ae6a519",
"ref": "refs/heads/main"
}
}
}
[23:03:33.644] Invocation finished in 11h39m56.69989692s with status FAILED