[00:27:33.283] New invocation is queued and will start shortly
[00:27:34.528] Starting the invocation (attempt 1)
[00:27:34.581] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9fba59a5a13a3c1699cfc4180210f1c33af91bf2"
[00:27:34.581] Popped gitiles commit info from properties and tags
[00:27:34.581] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:27:34.581] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:27:34.581] Buildbucket request:
{
"requestId": "8946324780023714464",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9fba59a5a13a3c1699cfc4180210f1c33af91bf2",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8946324780023714464"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[00:27:35.182] Scheduled build:
{
"id": "8780894717924375313",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 18990,
"createdBy": "project:chromium",
"createTime": "2023-05-17T00:27:34.656617737Z",
"updateTime": "2023-05-17T00:27:34.656617737Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9fba59a5a13a3c1699cfc4180210f1c33af91bf2",
"ref": "refs/heads/main"
}
}
}
[00:27:35.182] Task URL: https://cr-buildbucket.appspot.com/build/8780894717924375313
[00:27:35.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:2:0) after 5m6s
[00:31:42.801] Received PubSub notification, asking Buildbucket for the build status
[00:31:42.816] Build status: STARTED
[00:32:41.309] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:2:0)
[00:32:41.327] Build status: STARTED
[00:32:41.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:4:0) after 5m35s
[00:38:16.420] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:4:0)
[00:38:16.443] Build status: STARTED
[00:38:16.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:5:0) after 2m57s
[00:41:13.448] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:5:0)
[00:41:13.464] Build status: STARTED
[00:41:13.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:6:0) after 5m54s
[00:47:07.491] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:6:0)
[00:47:07.547] Build status: STARTED
[00:47:07.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:7:0) after 1m50s
[00:48:57.604] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:7:0)
[00:48:57.621] Build status: STARTED
[00:48:57.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:8:0) after 8m1s
[00:56:58.705] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:8:0)
[00:56:58.735] Build status: STARTED
[00:56:58.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:9:0) after 1m5s
[00:58:03.842] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:9:0)
[00:58:03.862] Build status: STARTED
[00:58:03.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:10:0) after 8m4s
[01:06:08.133] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:10:0)
[01:06:08.186] Build status: STARTED
[01:06:08.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:11:0) after 2m39s
[01:08:47.304] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:11:0)
[01:08:47.323] Build status: STARTED
[01:08:47.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:12:0) after 6m3s
[01:14:50.370] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:12:0)
[01:14:50.428] Build status: STARTED
[01:14:50.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:13:0) after 4m4s
[01:18:54.589] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:13:0)
[01:18:54.607] Build status: STARTED
[01:18:54.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:14:0) after 8m46s
[01:27:40.640] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:14:0)
[01:27:40.715] Build status: STARTED
[01:27:40.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:15:0) after 3m23s
[01:31:03.848] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:15:0)
[01:31:03.928] Build status: STARTED
[01:31:03.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:16:0) after 6m34s
[01:37:38.199] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:16:0)
[01:37:38.224] Build status: STARTED
[01:37:38.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:17:0) after 3m4s
[01:40:42.283] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:17:0)
[01:40:42.302] Build status: STARTED
[01:40:42.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:18:0) after 2m1s
[01:42:43.485] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:18:0)
[01:42:43.503] Build status: STARTED
[01:42:43.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:19:0) after 2m27s
[01:45:10.856] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:19:0)
[01:45:10.875] Build status: STARTED
[01:45:10.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:20:0) after 4m6s
[01:49:16.903] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:20:0)
[01:49:16.937] Build status: STARTED
[01:49:16.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:21:0) after 8m32s
[01:57:48.962] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:21:0)
[01:57:49.005] Build status: STARTED
[01:57:49.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:22:0) after 4m44s
[02:02:33.109] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:22:0)
[02:02:33.131] Build status: STARTED
[02:02:33.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:23:0) after 1m27s
[02:04:00.190] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:23:0)
[02:04:00.244] Build status: STARTED
[02:04:00.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:24:0) after 4m34s
[02:08:34.341] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:24:0)
[02:08:34.361] Build status: STARTED
[02:08:34.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:25:0) after 3m2s
[02:11:36.538] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:25:0)
[02:11:36.560] Build status: STARTED
[02:11:36.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:26:0) after 8m35s
[02:20:11.946] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:26:0)
[02:20:12.001] Build status: STARTED
[02:20:12.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:27:0) after 3m7s
[02:23:19.039] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:27:0)
[02:23:19.062] Build status: STARTED
[02:23:19.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:28:0) after 1m21s
[02:24:40.109] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:28:0)
[02:24:40.195] Build status: STARTED
[02:24:40.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:29:0) after 1m10s
[02:25:50.320] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:29:0)
[02:25:50.338] Build status: STARTED
[02:25:50.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:30:0) after 7m29s
[02:33:19.429] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:30:0)
[02:33:19.450] Build status: STARTED
[02:33:19.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:31:0) after 7m0s
[02:40:20.057] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:31:0)
[02:40:20.078] Build status: STARTED
[02:40:20.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:32:0) after 8m6s
[02:48:26.412] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:32:0)
[02:48:26.430] Build status: STARTED
[02:48:26.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:33:0) after 5m42s
[02:54:08.768] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:33:0)
[02:54:08.790] Build status: STARTED
[02:54:08.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:34:0) after 6m12s
[03:00:21.122] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:34:0)
[03:00:21.143] Build status: STARTED
[03:00:21.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:35:0) after 1m3s
[03:01:24.401] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:35:0)
[03:01:24.424] Build status: STARTED
[03:01:24.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:36:0) after 7m20s
[03:08:44.702] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:36:0)
[03:08:44.720] Build status: STARTED
[03:08:44.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:37:0) after 3m29s
[03:12:13.761] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:37:0)
[03:12:13.782] Build status: STARTED
[03:12:13.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:38:0) after 1m23s
[03:13:36.909] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:38:0)
[03:13:36.928] Build status: STARTED
[03:13:36.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:39:0) after 3m52s
[03:17:28.971] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:39:0)
[03:17:28.993] Build status: STARTED
[03:17:28.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:40:0) after 9m19s
[03:26:48.209] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:40:0)
[03:26:48.325] Build status: STARTED
[03:26:48.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:41:0) after 5m38s
[03:32:26.869] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:41:0)
[03:32:26.889] Build status: STARTED
[03:32:26.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:42:0) after 7m55s
[03:40:22.021] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:42:0)
[03:40:22.041] Build status: STARTED
[03:40:22.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:43:0) after 6m29s
[03:46:51.349] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:43:0)
[03:46:51.367] Build status: STARTED
[03:46:51.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:44:0) after 5m30s
[03:52:21.578] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:44:0)
[03:52:21.604] Build status: STARTED
[03:52:21.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:45:0) after 6m1s
[03:58:22.952] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:45:0)
[03:58:22.971] Build status: STARTED
[03:58:22.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:46:0) after 9m13s
[04:07:36.093] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:46:0)
[04:07:36.128] Build status: STARTED
[04:07:36.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:47:0) after 3m42s
[04:11:18.151] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:47:0)
[04:11:18.171] Build status: STARTED
[04:11:18.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:48:0) after 1m13s
[04:12:31.349] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:48:0)
[04:12:31.370] Build status: STARTED
[04:12:31.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:49:0) after 5m39s
[04:18:10.392] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:49:0)
[04:18:10.414] Build status: STARTED
[04:18:10.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:50:0) after 1m37s
[04:19:47.631] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:50:0)
[04:19:47.653] Build status: STARTED
[04:19:47.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:51:0) after 5m11s
[04:24:58.819] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:51:0)
[04:24:58.841] Build status: STARTED
[04:24:58.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:52:0) after 8m25s
[04:33:23.869] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:52:0)
[04:33:23.947] Build status: STARTED
[04:33:23.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:53:0) after 4m34s
[04:37:57.946] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:53:0)
[04:37:57.971] Build status: STARTED
[04:37:57.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:54:0) after 8m34s
[04:46:32.034] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:54:0)
[04:46:32.052] Build status: STARTED
[04:46:32.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:55:0) after 6m39s
[04:53:11.100] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:55:0)
[04:53:11.161] Build status: STARTED
[04:53:11.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:56:0) after 9m45s
[05:02:56.198] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:56:0)
[05:02:56.236] Build status: STARTED
[05:02:56.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:57:0) after 5m28s
[05:08:24.382] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:57:0)
[05:08:24.400] Build status: STARTED
[05:08:24.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:58:0) after 4m46s
[05:13:10.430] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:58:0)
[05:13:10.511] Build status: STARTED
[05:13:10.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:59:0) after 3m52s
[05:17:02.612] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:59:0)
[05:17:02.635] Build status: STARTED
[05:17:02.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:60:0) after 8m16s
[05:25:18.673] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:60:0)
[05:25:18.753] Build status: STARTED
[05:25:18.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:61:0) after 9m25s
[05:34:43.877] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:61:0)
[05:34:43.898] Build status: STARTED
[05:34:43.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:62:0) after 1m13s
[05:35:57.269] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:62:0)
[05:35:57.354] Build status: STARTED
[05:35:57.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:63:0) after 1m16s
[05:37:13.397] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:63:0)
[05:37:13.476] Build status: STARTED
[05:37:13.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:64:0) after 9m48s
[05:47:01.567] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:64:0)
[05:47:01.606] Build status: STARTED
[05:47:01.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:65:0) after 5m46s
[05:52:47.637] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:65:0)
[05:52:47.657] Build status: STARTED
[05:52:47.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:66:0) after 8m9s
[06:00:56.686] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:66:0)
[06:00:56.712] Build status: STARTED
[06:00:56.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:67:0) after 1m0s
[06:01:56.785] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:67:0)
[06:01:56.801] Build status: STARTED
[06:01:56.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:68:0) after 9m23s
[06:11:19.838] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:68:0)
[06:11:19.861] Build status: STARTED
[06:11:19.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:69:0) after 5m20s
[06:16:39.892] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:69:0)
[06:16:39.909] Build status: STARTED
[06:16:39.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:70:0) after 2m14s
[06:18:53.991] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:70:0)
[06:18:54.010] Build status: STARTED
[06:18:54.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:71:0) after 4m56s
[06:23:50.245] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:71:0)
[06:23:50.266] Build status: STARTED
[06:23:50.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:72:0) after 8m21s
[06:32:11.327] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:72:0)
[06:32:11.346] Build status: STARTED
[06:32:11.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:73:0) after 8m29s
[06:40:40.377] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:73:0)
[06:40:40.404] Build status: STARTED
[06:40:40.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:74:0) after 3m54s
[06:44:34.520] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:74:0)
[06:44:34.543] Build status: STARTED
[06:44:34.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:75:0) after 1m21s
[06:45:55.875] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:75:0)
[06:45:55.896] Build status: STARTED
[06:45:55.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:76:0) after 2m14s
[06:48:09.993] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:76:0)
[06:48:10.011] Build status: STARTED
[06:48:10.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:77:0) after 3m4s
[06:51:14.538] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:77:0)
[06:51:14.617] Build status: STARTED
[06:51:14.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:78:0) after 6m28s
[06:57:42.717] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:78:0)
[06:57:42.760] Build status: STARTED
[06:57:42.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:79:0) after 5m17s
[07:02:59.880] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:79:0)
[07:02:59.901] Build status: STARTED
[07:02:59.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:80:0) after 6m20s
[07:09:19.945] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:80:0)
[07:09:19.965] Build status: STARTED
[07:09:19.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:81:0) after 7m15s
[07:16:35.126] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:81:0)
[07:16:35.146] Build status: STARTED
[07:16:35.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:82:0) after 8m26s
[07:25:01.285] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:82:0)
[07:25:01.302] Build status: STARTED
[07:25:01.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:83:0) after 9m39s
[07:34:40.342] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:83:0)
[07:34:40.363] Build status: STARTED
[07:34:40.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:84:0) after 3m36s
[07:38:16.469] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:84:0)
[07:38:16.489] Build status: STARTED
[07:38:16.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:85:0) after 4m49s
[07:43:05.926] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:85:0)
[07:43:05.943] Build status: STARTED
[07:43:05.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:86:0) after 4m58s
[07:48:04.030] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:86:0)
[07:48:04.054] Build status: STARTED
[07:48:04.054] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:87:0) after 3m29s
[07:51:33.246] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:87:0)
[07:51:33.271] Build status: STARTED
[07:51:33.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:88:0) after 8m34s
[08:00:07.297] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:88:0)
[08:00:07.320] Build status: STARTED
[08:00:07.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:89:0) after 3m54s
[08:04:01.449] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:89:0)
[08:04:01.481] Build status: STARTED
[08:04:01.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:90:0) after 1m59s
[08:06:00.803] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:90:0)
[08:06:00.824] Build status: STARTED
[08:06:00.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:91:0) after 7m6s
[08:13:07.008] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:91:0)
[08:13:07.026] Build status: STARTED
[08:13:07.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:92:0) after 7m21s
[08:20:28.147] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:92:0)
[08:20:28.190] Build status: STARTED
[08:20:28.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:93:0) after 5m14s
[08:25:42.226] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:93:0)
[08:25:42.249] Build status: STARTED
[08:25:42.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:94:0) after 7m6s
[08:32:48.550] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:94:0)
[08:32:48.577] Build status: STARTED
[08:32:48.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:95:0) after 5m36s
[08:38:24.615] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:95:0)
[08:38:24.639] Build status: STARTED
[08:38:24.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:96:0) after 4m26s
[08:42:51.052] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:96:0)
[08:42:51.071] Build status: STARTED
[08:42:51.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:97:0) after 8m46s
[08:51:37.309] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:97:0)
[08:51:37.328] Build status: STARTED
[08:51:37.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:98:0) after 1m21s
[08:52:58.356] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:98:0)
[08:52:58.372] Build status: STARTED
[08:52:58.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:99:0) after 7m59s
[09:00:57.806] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:99:0)
[09:00:57.826] Build status: STARTED
[09:00:57.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:100:0) after 8m18s
[09:09:16.196] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:100:0)
[09:09:16.213] Build status: STARTED
[09:09:16.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:101:0) after 2m18s
[09:11:34.334] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:101:0)
[09:11:34.358] Build status: STARTED
[09:11:34.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:102:0) after 6m20s
[09:17:54.444] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:102:0)
[09:17:54.463] Build status: STARTED
[09:17:54.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:103:0) after 8m23s
[09:26:17.492] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:103:0)
[09:26:17.528] Build status: STARTED
[09:26:17.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:104:0) after 1m56s
[09:28:13.841] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:104:0)
[09:28:13.865] Build status: STARTED
[09:28:13.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:105:0) after 3m18s
[09:31:32.157] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:105:0)
[09:31:32.182] Build status: STARTED
[09:31:32.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:106:0) after 1m4s
[09:32:36.912] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:106:0)
[09:32:36.930] Build status: STARTED
[09:32:36.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:107:0) after 4m24s
[09:37:01.029] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:107:0)
[09:37:01.109] Build status: STARTED
[09:37:01.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:108:0) after 7m59s
[09:45:00.438] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:108:0)
[09:45:00.454] Build status: STARTED
[09:45:00.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:109:0) after 4m4s
[09:49:04.535] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:109:0)
[09:49:04.558] Build status: STARTED
[09:49:04.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:110:0) after 9m54s
[09:58:58.701] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:110:0)
[09:58:58.730] Build status: STARTED
[09:58:58.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:111:0) after 2m34s
[10:01:33.432] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:111:0)
[10:01:33.473] Build status: STARTED
[10:01:33.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:112:0) after 3m12s
[10:04:45.590] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:112:0)
[10:04:45.610] Build status: STARTED
[10:04:45.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:113:0) after 8m23s
[10:13:08.720] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:113:0)
[10:13:08.743] Build status: STARTED
[10:13:08.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:114:0) after 6m17s
[10:19:25.826] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:114:0)
[10:19:25.843] Build status: STARTED
[10:19:25.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:115:0) after 9m48s
[10:29:13.878] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:115:0)
[10:29:13.905] Build status: STARTED
[10:29:13.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:116:0) after 7m42s
[10:36:56.112] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:116:0)
[10:36:56.131] Build status: STARTED
[10:36:56.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:117:0) after 6m52s
[10:43:48.296] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:117:0)
[10:43:48.328] Build status: STARTED
[10:43:48.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:118:0) after 3m1s
[10:46:49.680] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:118:0)
[10:46:49.696] Build status: STARTED
[10:46:49.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:119:0) after 6m17s
[10:53:06.961] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:119:0)
[10:53:06.977] Build status: STARTED
[10:53:06.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:120:0) after 7m49s
[11:00:56.166] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:120:0)
[11:00:56.182] Build status: STARTED
[11:00:56.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:121:0) after 7m24s
[11:08:20.218] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:121:0)
[11:08:20.242] Build status: STARTED
[11:08:20.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:122:0) after 6m3s
[11:14:23.462] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:122:0)
[11:14:23.485] Build status: STARTED
[11:14:23.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:123:0) after 3m18s
[11:17:41.541] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:123:0)
[11:17:41.771] Build status: STARTED
[11:17:41.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:124:0) after 1m16s
[11:18:57.810] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:124:0)
[11:18:57.838] Build status: STARTED
[11:18:57.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:125:0) after 8m15s
[11:27:12.864] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:125:0)
[11:27:12.881] Build status: STARTED
[11:27:12.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:126:0) after 1m38s
[11:28:50.904] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:126:0)
[11:28:50.924] Build status: STARTED
[11:28:50.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946324780023714464:127:0) after 9m49s
[11:29:50.027] Received PubSub notification, asking Buildbucket for the build status
[11:29:50.043] Build:
{
"id": "8780894717924375313",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 18990,
"createdBy": "project:chromium",
"createTime": "2023-05-17T00:27:34.656617737Z",
"startTime": "2023-05-17T00:31:42.113755Z",
"endTime": "2023-05-17T11:29:49.672966078Z",
"updateTime": "2023-05-17T11:29:49.672966078Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9fba59a5a13a3c1699cfc4180210f1c33af91bf2",
"ref": "refs/heads/main"
}
}
}
[11:29:50.043] Invocation finished in 11h2m16.772873408s with status FAILED