[22:14:52.147] New invocation is queued and will start shortly
[22:14:53.254] Starting the invocation (attempt 1)
[22:14:53.287] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/192543140f6bdf04cbe909e8cc080a0ee6a1ace6"
[22:14:53.287] Popped gitiles commit info from properties and tags
[22:14:53.287] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:14:53.288] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:14:53.288] Buildbucket request:
{
"requestId": "8946151933948539136",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "192543140f6bdf04cbe909e8cc080a0ee6a1ace6",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8946151933948539136"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:14:53.987] Scheduled build:
{
"id": "8780721872007290225",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 18998,
"createdBy": "project:chromium",
"createTime": "2023-05-18T22:14:53.368337871Z",
"updateTime": "2023-05-18T22:14:53.368337871Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "192543140f6bdf04cbe909e8cc080a0ee6a1ace6",
"ref": "refs/heads/main"
}
}
}
[22:14:53.987] Task URL: https://cr-buildbucket.appspot.com/build/8780721872007290225
[22:14:53.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:2:0) after 4m47s
[22:16:57.699] Received PubSub notification, asking Buildbucket for the build status
[22:16:57.722] Build status: STARTED
[22:19:41.104] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:2:0)
[22:19:41.128] Build status: STARTED
[22:19:41.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:4:0) after 2m0s
[22:21:41.178] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:4:0)
[22:21:41.197] Build status: STARTED
[22:21:41.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:5:0) after 5m6s
[22:26:47.234] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:5:0)
[22:26:47.265] Build status: STARTED
[22:26:47.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:6:0) after 1m59s
[22:28:46.399] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:6:0)
[22:28:46.428] Build status: STARTED
[22:28:46.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:7:0) after 5m6s
[22:33:52.491] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:7:0)
[22:33:52.537] Build status: STARTED
[22:33:52.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:8:0) after 5m44s
[22:39:36.611] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:8:0)
[22:39:36.632] Build status: STARTED
[22:39:36.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:9:0) after 4m50s
[22:44:26.687] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:9:0)
[22:44:26.720] Build status: STARTED
[22:44:26.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:10:0) after 9m6s
[22:53:32.703] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:10:0)
[22:53:32.725] Build status: STARTED
[22:53:32.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:11:0) after 8m56s
[23:02:28.721] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:11:0)
[23:02:28.744] Build status: STARTED
[23:02:28.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:12:0) after 8m32s
[23:11:00.889] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:12:0)
[23:11:00.907] Build status: STARTED
[23:11:00.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:13:0) after 1m9s
[23:12:10.219] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:13:0)
[23:12:10.257] Build status: STARTED
[23:12:10.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:14:0) after 7m37s
[23:19:47.371] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:14:0)
[23:19:47.392] Build status: STARTED
[23:19:47.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:15:0) after 9m44s
[23:29:31.451] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:15:0)
[23:29:31.470] Build status: STARTED
[23:29:31.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:16:0) after 9m48s
[23:39:19.577] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:16:0)
[23:39:19.595] Build status: STARTED
[23:39:19.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:17:0) after 5m44s
[23:45:03.821] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:17:0)
[23:45:03.875] Build status: STARTED
[23:45:03.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:18:0) after 4m3s
[23:49:06.905] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:18:0)
[23:49:06.920] Build status: STARTED
[23:49:06.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:19:0) after 5m45s
[23:54:51.950] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:19:0)
[23:54:52.033] Build status: STARTED
[23:54:52.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:20:0) after 5m55s
[00:00:47.061] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:20:0)
[00:00:47.085] Build status: STARTED
[00:00:47.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:21:0) after 5m58s
[00:06:45.131] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:21:0)
[00:06:45.148] Build status: STARTED
[00:06:45.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:22:0) after 5m5s
[00:11:50.269] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:22:0)
[00:11:50.296] Build status: STARTED
[00:11:50.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:23:0) after 6m54s
[00:18:44.993] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:23:0)
[00:18:45.012] Build status: STARTED
[00:18:45.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:24:0) after 5m58s
[00:24:43.049] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:24:0)
[00:24:43.069] Build status: STARTED
[00:24:43.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:25:0) after 7m0s
[00:31:43.299] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:25:0)
[00:31:43.326] Build status: STARTED
[00:31:43.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:26:0) after 1m58s
[00:33:41.468] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:26:0)
[00:33:41.495] Build status: STARTED
[00:33:41.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:27:0) after 2m22s
[00:36:03.999] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:27:0)
[00:36:04.018] Build status: STARTED
[00:36:04.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:28:0) after 9m34s
[00:45:38.060] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:28:0)
[00:45:38.083] Build status: STARTED
[00:45:38.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:29:0) after 1m36s
[00:47:14.128] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:29:0)
[00:47:14.151] Build status: STARTED
[00:47:14.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:30:0) after 5m42s
[00:52:56.342] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:30:0)
[00:52:56.364] Build status: STARTED
[00:52:56.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:31:0) after 4m34s
[00:57:30.596] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:31:0)
[00:57:30.619] Build status: STARTED
[00:57:30.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:32:0) after 2m43s
[01:00:13.707] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:32:0)
[01:00:13.728] Build status: STARTED
[01:00:13.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:33:0) after 7m47s
[01:08:01.020] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:33:0)
[01:08:01.045] Build status: STARTED
[01:08:01.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:34:0) after 7m21s
[01:15:22.052] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:34:0)
[01:15:22.107] Build status: STARTED
[01:15:22.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:35:0) after 3m29s
[01:18:51.142] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:35:0)
[01:18:51.166] Build status: STARTED
[01:18:51.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:36:0) after 1m17s
[01:20:08.194] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:36:0)
[01:20:08.214] Build status: STARTED
[01:20:08.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:37:0) after 5m31s
[01:25:39.244] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:37:0)
[01:25:39.264] Build status: STARTED
[01:25:39.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:38:0) after 3m15s
[01:28:54.353] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:38:0)
[01:28:54.372] Build status: STARTED
[01:28:54.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:39:0) after 3m55s
[01:32:49.626] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:39:0)
[01:32:49.649] Build status: STARTED
[01:32:49.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:40:0) after 4m24s
[01:37:13.674] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:40:0)
[01:37:13.699] Build status: STARTED
[01:37:13.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:41:0) after 6m12s
[01:43:26.052] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:41:0)
[01:43:26.071] Build status: STARTED
[01:43:26.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:42:0) after 5m13s
[01:48:39.395] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:42:0)
[01:48:39.421] Build status: STARTED
[01:48:39.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:43:0) after 1m13s
[01:49:52.619] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:43:0)
[01:49:52.638] Build status: STARTED
[01:49:52.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:44:0) after 7m53s
[01:57:46.022] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:44:0)
[01:57:46.043] Build status: STARTED
[01:57:46.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:45:0) after 1m1s
[01:58:47.131] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:45:0)
[01:58:47.151] Build status: STARTED
[01:58:47.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:46:0) after 3m2s
[02:01:49.641] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:46:0)
[02:01:49.669] Build status: STARTED
[02:01:49.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:47:0) after 7m50s
[02:09:39.933] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:47:0)
[02:09:39.967] Build status: STARTED
[02:09:39.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:48:0) after 2m58s
[02:12:38.167] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:48:0)
[02:12:38.187] Build status: STARTED
[02:12:38.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:49:0) after 8m45s
[02:21:23.841] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:49:0)
[02:21:23.909] Build status: STARTED
[02:21:23.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:50:0) after 7m47s
[02:29:11.061] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:50:0)
[02:29:11.077] Build status: STARTED
[02:29:11.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:51:0) after 9m30s
[02:38:41.213] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:51:0)
[02:38:41.269] Build status: STARTED
[02:38:41.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:52:0) after 2m58s
[02:41:39.595] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:52:0)
[02:41:39.631] Build status: STARTED
[02:41:39.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:53:0) after 9m49s
[02:51:28.906] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:53:0)
[02:51:28.930] Build status: STARTED
[02:51:28.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:54:0) after 2m41s
[02:54:09.984] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:54:0)
[02:54:10.002] Build status: STARTED
[02:54:10.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:55:0) after 5m0s
[02:59:10.164] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:55:0)
[02:59:10.233] Build status: STARTED
[02:59:10.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:56:0) after 8m51s
[03:08:01.262] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:56:0)
[03:08:01.287] Build status: STARTED
[03:08:01.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:57:0) after 9m40s
[03:17:41.340] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:57:0)
[03:17:41.360] Build status: STARTED
[03:17:41.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:58:0) after 4m15s
[03:21:56.393] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:58:0)
[03:21:56.412] Build status: STARTED
[03:21:56.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:59:0) after 2m6s
[03:24:02.437] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:59:0)
[03:24:02.455] Build status: STARTED
[03:24:02.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:60:0) after 8m51s
[03:32:53.528] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:60:0)
[03:32:53.550] Build status: STARTED
[03:32:53.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:61:0) after 6m32s
[03:39:25.586] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:61:0)
[03:39:25.606] Build status: STARTED
[03:39:25.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:62:0) after 7m21s
[03:46:46.840] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:62:0)
[03:46:46.897] Build status: STARTED
[03:46:46.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:63:0) after 1m14s
[03:48:00.951] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:63:0)
[03:48:00.975] Build status: STARTED
[03:48:00.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:64:0) after 8m55s
[03:56:56.002] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:64:0)
[03:56:56.033] Build status: STARTED
[03:56:56.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:65:0) after 5m35s
[04:02:31.068] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:65:0)
[04:02:31.095] Build status: STARTED
[04:02:31.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:66:0) after 7m8s
[04:09:39.175] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:66:0)
[04:09:39.208] Build status: STARTED
[04:09:39.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:67:0) after 8m53s
[04:18:32.504] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:67:0)
[04:18:32.528] Build status: STARTED
[04:18:32.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:68:0) after 4m10s
[04:22:42.611] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:68:0)
[04:22:42.629] Build status: STARTED
[04:22:42.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:69:0) after 6m50s
[04:29:32.750] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:69:0)
[04:29:32.771] Build status: STARTED
[04:29:32.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:70:0) after 5m15s
[04:34:47.891] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:70:0)
[04:34:47.908] Build status: STARTED
[04:34:47.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:71:0) after 5m56s
[04:40:43.947] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:71:0)
[04:40:43.968] Build status: STARTED
[04:40:43.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:72:0) after 1m14s
[04:41:58.520] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:72:0)
[04:41:58.541] Build status: STARTED
[04:41:58.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:73:0) after 8m25s
[04:50:23.669] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:73:0)
[04:50:23.686] Build status: STARTED
[04:50:23.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:74:0) after 2m12s
[04:52:35.712] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:74:0)
[04:52:35.764] Build status: STARTED
[04:52:35.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:75:0) after 4m41s
[04:57:16.925] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:75:0)
[04:57:17.061] Build status: STARTED
[04:57:17.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:76:0) after 1m4s
[04:58:21.194] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:76:0)
[04:58:21.218] Build status: STARTED
[04:58:21.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:77:0) after 4m36s
[05:02:57.347] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:77:0)
[05:02:57.365] Build status: STARTED
[05:02:57.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:78:0) after 5m21s
[05:08:18.370] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:78:0)
[05:08:18.391] Build status: STARTED
[05:08:18.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:79:0) after 7m10s
[05:15:28.735] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:79:0)
[05:15:28.751] Build status: STARTED
[05:15:28.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:80:0) after 2m19s
[05:17:47.785] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:80:0)
[05:17:47.804] Build status: STARTED
[05:17:47.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:81:0) after 7m37s
[05:25:25.035] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:81:0)
[05:25:25.052] Build status: STARTED
[05:25:25.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:82:0) after 1m32s
[05:26:57.183] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:82:0)
[05:26:57.207] Build status: STARTED
[05:26:57.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:83:0) after 2m55s
[05:29:52.338] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:83:0)
[05:29:52.359] Build status: STARTED
[05:29:52.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:84:0) after 3m42s
[05:33:34.384] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:84:0)
[05:33:34.402] Build status: STARTED
[05:33:34.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:85:0) after 7m28s
[05:41:02.430] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:85:0)
[05:41:02.457] Build status: STARTED
[05:41:02.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:86:0) after 3m58s
[05:45:00.560] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:86:0)
[05:45:00.580] Build status: STARTED
[05:45:00.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:87:0) after 4m9s
[05:49:09.611] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:87:0)
[05:49:09.631] Build status: STARTED
[05:49:09.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:88:0) after 2m5s
[05:51:14.745] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:88:0)
[05:51:14.766] Build status: STARTED
[05:51:14.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:89:0) after 5m44s
[05:56:59.253] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:89:0)
[05:56:59.271] Build status: STARTED
[05:56:59.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:90:0) after 3m37s
[06:00:36.299] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:90:0)
[06:00:36.319] Build status: STARTED
[06:00:36.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:91:0) after 7m36s
[06:08:12.392] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:91:0)
[06:08:12.457] Build status: STARTED
[06:08:12.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:92:0) after 7m59s
[06:16:11.586] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:92:0)
[06:16:11.604] Build status: STARTED
[06:16:11.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:93:0) after 2m54s
[06:19:05.704] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:93:0)
[06:19:05.724] Build status: STARTED
[06:19:05.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:94:0) after 5m59s
[06:25:04.860] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:94:0)
[06:25:04.961] Build status: STARTED
[06:25:04.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:95:0) after 2m53s
[06:27:57.992] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:95:0)
[06:27:58.059] Build status: STARTED
[06:27:58.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:96:0) after 8m9s
[06:36:07.087] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:96:0)
[06:36:07.107] Build status: STARTED
[06:36:07.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:97:0) after 1m23s
[06:37:30.139] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:97:0)
[06:37:30.279] Build status: STARTED
[06:37:30.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:98:0) after 5m8s
[06:42:38.325] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:98:0)
[06:42:38.345] Build status: STARTED
[06:42:38.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:99:0) after 4m28s
[06:47:06.382] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:99:0)
[06:47:06.405] Build status: STARTED
[06:47:06.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:100:0) after 3m31s
[06:50:37.429] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:100:0)
[06:50:37.476] Build status: STARTED
[06:50:37.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:101:0) after 1m41s
[06:52:18.537] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:101:0)
[06:52:18.567] Build status: STARTED
[06:52:18.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:102:0) after 4m32s
[06:56:50.598] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:102:0)
[06:56:50.619] Build status: STARTED
[06:56:50.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:103:0) after 4m44s
[07:01:34.764] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:103:0)
[07:01:34.799] Build status: STARTED
[07:01:34.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:104:0) after 2m41s
[07:04:16.129] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:104:0)
[07:04:16.147] Build status: STARTED
[07:04:16.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:105:0) after 2m30s
[07:06:46.300] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:105:0)
[07:06:46.320] Build status: STARTED
[07:06:46.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:106:0) after 2m30s
[07:09:16.312] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:106:0)
[07:09:16.333] Build status: STARTED
[07:09:16.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:107:0) after 1m31s
[07:10:47.358] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:107:0)
[07:10:47.467] Build status: STARTED
[07:10:47.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:108:0) after 9m6s
[07:19:53.647] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:108:0)
[07:19:53.670] Build status: STARTED
[07:19:53.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:109:0) after 4m1s
[07:23:54.995] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:109:0)
[07:23:55.014] Build status: STARTED
[07:23:55.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:110:0) after 3m55s
[07:27:50.041] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:110:0)
[07:27:50.065] Build status: STARTED
[07:27:50.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:111:0) after 2m58s
[07:30:48.343] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:111:0)
[07:30:48.362] Build status: STARTED
[07:30:48.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:112:0) after 6m56s
[07:37:44.699] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:112:0)
[07:37:44.720] Build status: STARTED
[07:37:44.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:113:0) after 5m15s
[07:42:59.762] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:113:0)
[07:42:59.782] Build status: STARTED
[07:42:59.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:114:0) after 6m14s
[07:49:13.833] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:114:0)
[07:49:13.856] Build status: STARTED
[07:49:13.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:115:0) after 8m43s
[07:57:56.961] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:115:0)
[07:57:56.983] Build status: STARTED
[07:57:56.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:116:0) after 8m33s
[08:06:30.115] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:116:0)
[08:06:30.137] Build status: STARTED
[08:06:30.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:117:0) after 6m13s
[08:12:43.238] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:117:0)
[08:12:43.260] Build status: STARTED
[08:12:43.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:118:0) after 3m11s
[08:15:54.349] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:118:0)
[08:15:54.367] Build status: STARTED
[08:15:54.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:119:0) after 4m26s
[08:20:20.409] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:119:0)
[08:20:20.431] Build status: STARTED
[08:20:20.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:120:0) after 3m14s
[08:23:34.457] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:120:0)
[08:23:34.475] Build status: STARTED
[08:23:34.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:121:0) after 4m33s
[08:28:07.502] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:121:0)
[08:28:07.563] Build status: STARTED
[08:28:07.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:122:0) after 2m14s
[08:30:21.672] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:122:0)
[08:30:21.694] Build status: STARTED
[08:30:21.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:123:0) after 9m44s
[08:40:05.792] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:123:0)
[08:40:05.813] Build status: STARTED
[08:40:05.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:124:0) after 2m23s
[08:42:28.965] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:124:0)
[08:42:28.982] Build status: STARTED
[08:42:28.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:125:0) after 2m30s
[08:44:59.013] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:125:0)
[08:44:59.034] Build status: STARTED
[08:44:59.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:126:0) after 9m59s
[08:54:58.090] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:126:0)
[08:54:58.148] Build status: STARTED
[08:54:58.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:127:0) after 6m20s
[09:01:18.448] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:127:0)
[09:01:18.474] Build status: STARTED
[09:01:18.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946151933948539136:128:0) after 2m16s
[09:02:21.788] Received PubSub notification, asking Buildbucket for the build status
[09:02:21.816] Build:
{
"id": "8780721872007290225",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 18998,
"createdBy": "project:chromium",
"createTime": "2023-05-18T22:14:53.368337871Z",
"startTime": "2023-05-18T22:16:57.199646Z",
"endTime": "2023-05-19T09:02:21.390600232Z",
"updateTime": "2023-05-19T09:02:21.390600232Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "192543140f6bdf04cbe909e8cc080a0ee6a1ace6",
"ref": "refs/heads/main"
}
}
}
[09:02:21.816] Invocation finished in 10h47m29.683509682s with status FAILED