[11:29:52.134] New invocation is queued and will start shortly
[11:29:53.212] Starting the invocation (attempt 1)
[11:29:53.244] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e5c6120a9091ab98c9a9b578e30875fbd6635643"
[11:29:53.244] Popped gitiles commit info from properties and tags
[11:29:53.244] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[11:29:53.244] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[11:29:53.244] Buildbucket request:
{
"requestId": "8946283110817267632",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e5c6120a9091ab98c9a9b578e30875fbd6635643",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8946283110817267632"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[11:29:53.637] Scheduled build:
{
"id": "8780853048921576705",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 18991,
"createdBy": "project:chromium",
"createTime": "2023-05-17T11:29:53.313943829Z",
"updateTime": "2023-05-17T11:29:53.313943829Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e5c6120a9091ab98c9a9b578e30875fbd6635643",
"ref": "refs/heads/main"
}
}
}
[11:29:53.637] Task URL: https://cr-buildbucket.appspot.com/build/8780853048921576705
[11:29:53.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:2:0) after 3m13s
[11:33:06.846] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:2:0)
[11:33:06.882] Build status: SCHEDULED
[11:33:06.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:3:0) after 4m21s
[11:33:29.838] Received PubSub notification, asking Buildbucket for the build status
[11:33:29.855] Build status: STARTED
[11:37:27.906] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:3:0)
[11:37:27.923] Build status: STARTED
[11:37:27.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:5:0) after 1m57s
[11:39:24.983] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:5:0)
[11:39:25.004] Build status: STARTED
[11:39:25.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:6:0) after 8m30s
[11:47:55.124] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:6:0)
[11:47:55.183] Build status: STARTED
[11:47:55.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:7:0) after 2m14s
[11:50:09.279] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:7:0)
[11:50:09.311] Build status: STARTED
[11:50:09.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:8:0) after 4m31s
[11:54:40.403] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:8:0)
[11:54:40.448] Build status: STARTED
[11:54:40.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:9:0) after 7m55s
[12:02:35.473] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:9:0)
[12:02:35.523] Build status: STARTED
[12:02:35.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:10:0) after 1m29s
[12:04:04.568] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:10:0)
[12:04:04.586] Build status: STARTED
[12:04:04.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:11:0) after 1m2s
[12:05:07.091] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:11:0)
[12:05:07.134] Build status: STARTED
[12:05:07.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:12:0) after 7m59s
[12:13:06.298] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:12:0)
[12:13:06.318] Build status: STARTED
[12:13:06.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:13:0) after 2m35s
[12:15:41.456] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:13:0)
[12:15:41.481] Build status: STARTED
[12:15:41.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:14:0) after 1m29s
[12:17:10.596] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:14:0)
[12:17:10.623] Build status: STARTED
[12:17:10.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:15:0) after 5m15s
[12:22:25.896] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:15:0)
[12:22:25.919] Build status: STARTED
[12:22:25.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:16:0) after 9m2s
[12:31:27.950] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:16:0)
[12:31:27.972] Build status: STARTED
[12:31:27.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:17:0) after 7m37s
[12:39:05.340] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:17:0)
[12:39:05.359] Build status: STARTED
[12:39:05.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:18:0) after 8m34s
[12:47:39.508] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:18:0)
[12:47:39.526] Build status: STARTED
[12:47:39.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:19:0) after 7m1s
[12:54:40.988] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:19:0)
[12:54:41.010] Build status: STARTED
[12:54:41.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:20:0) after 9m38s
[13:04:19.307] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:20:0)
[13:04:19.378] Build status: STARTED
[13:04:19.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:21:0) after 2m35s
[13:06:54.419] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:21:0)
[13:06:54.439] Build status: STARTED
[13:06:54.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:22:0) after 9m36s
[13:16:31.000] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:22:0)
[13:16:31.019] Build status: STARTED
[13:16:31.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:23:0) after 9m15s
[13:25:46.252] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:23:0)
[13:25:46.281] Build status: STARTED
[13:25:46.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:24:0) after 7m51s
[13:33:37.383] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:24:0)
[13:33:37.405] Build status: STARTED
[13:33:37.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:25:0) after 6m22s
[13:39:59.435] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:25:0)
[13:39:59.451] Build status: STARTED
[13:39:59.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:26:0) after 2m11s
[13:42:10.761] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:26:0)
[13:42:10.779] Build status: STARTED
[13:42:10.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:27:0) after 2m50s
[13:45:00.967] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:27:0)
[13:45:00.993] Build status: STARTED
[13:45:00.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:28:0) after 1m27s
[13:46:28.024] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:28:0)
[13:46:28.043] Build status: STARTED
[13:46:28.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:29:0) after 4m18s
[13:50:46.135] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:29:0)
[13:50:46.179] Build status: STARTED
[13:50:46.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:30:0) after 6m26s
[13:57:12.192] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:30:0)
[13:57:12.218] Build status: STARTED
[13:57:12.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:31:0) after 9m53s
[14:07:05.242] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:31:0)
[14:07:05.257] Build status: STARTED
[14:07:05.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:32:0) after 2m21s
[14:09:26.278] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:32:0)
[14:09:26.292] Build status: STARTED
[14:09:26.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:33:0) after 1m42s
[14:11:08.450] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:33:0)
[14:11:08.467] Build status: STARTED
[14:11:08.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:34:0) after 1m46s
[14:12:54.901] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:34:0)
[14:12:54.986] Build status: STARTED
[14:12:54.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:35:0) after 9m50s
[14:22:45.529] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:35:0)
[14:22:45.549] Build status: STARTED
[14:22:45.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:36:0) after 9m47s
[14:32:32.722] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:36:0)
[14:32:32.779] Build status: STARTED
[14:32:32.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:37:0) after 7m13s
[14:39:45.812] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:37:0)
[14:39:45.888] Build status: STARTED
[14:39:45.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:38:0) after 8m59s
[14:48:44.911] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:38:0)
[14:48:44.931] Build status: STARTED
[14:48:44.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:39:0) after 7m46s
[14:56:31.039] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:39:0)
[14:56:31.058] Build status: STARTED
[14:56:31.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:40:0) after 3m11s
[14:59:42.080] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:40:0)
[14:59:42.099] Build status: STARTED
[14:59:42.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:41:0) after 2m51s
[15:02:33.197] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:41:0)
[15:02:33.212] Build status: STARTED
[15:02:33.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:42:0) after 8m36s
[15:11:09.310] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:42:0)
[15:11:09.329] Build status: STARTED
[15:11:09.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:43:0) after 2m55s
[15:14:04.627] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:43:0)
[15:14:04.647] Build status: STARTED
[15:14:04.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:44:0) after 6m14s
[15:20:18.684] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:44:0)
[15:20:18.726] Build status: STARTED
[15:20:18.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:45:0) after 9m23s
[15:29:41.959] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:45:0)
[15:29:41.976] Build status: STARTED
[15:29:41.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:46:0) after 2m18s
[15:32:00.262] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:46:0)
[15:32:00.284] Build status: STARTED
[15:32:00.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:47:0) after 8m34s
[15:40:34.800] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:47:0)
[15:40:34.820] Build status: STARTED
[15:40:34.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:48:0) after 1m58s
[15:42:32.943] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:48:0)
[15:42:32.962] Build status: STARTED
[15:42:32.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:49:0) after 3m5s
[15:45:38.083] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:49:0)
[15:45:38.111] Build status: STARTED
[15:45:38.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:50:0) after 9m40s
[15:55:18.139] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:50:0)
[15:55:18.156] Build status: STARTED
[15:55:18.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:51:0) after 1m45s
[15:57:03.475] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:51:0)
[15:57:03.497] Build status: STARTED
[15:57:03.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:52:0) after 6m49s
[16:03:52.842] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:52:0)
[16:03:52.875] Build status: STARTED
[16:03:52.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:53:0) after 1m27s
[16:05:20.128] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:53:0)
[16:05:20.148] Build status: STARTED
[16:05:20.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:54:0) after 8m28s
[16:13:48.309] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:54:0)
[16:13:48.582] Build status: STARTED
[16:13:48.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:55:0) after 1m36s
[16:15:24.813] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:55:0)
[16:15:24.831] Build status: STARTED
[16:15:24.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:56:0) after 9m45s
[16:25:10.373] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:56:0)
[16:25:10.455] Build status: STARTED
[16:25:10.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:57:0) after 7m15s
[16:32:25.486] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:57:0)
[16:32:25.504] Build status: STARTED
[16:32:25.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:58:0) after 8m51s
[16:41:17.334] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:58:0)
[16:41:17.355] Build status: STARTED
[16:41:17.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:59:0) after 3m53s
[16:45:10.422] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:59:0)
[16:45:10.476] Build status: STARTED
[16:45:10.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:60:0) after 8m39s
[16:53:49.720] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:60:0)
[16:53:49.742] Build status: STARTED
[16:53:49.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:61:0) after 6m29s
[17:00:19.042] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:61:0)
[17:00:19.065] Build status: STARTED
[17:00:19.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:62:0) after 8m38s
[17:08:57.093] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:62:0)
[17:08:57.116] Build status: STARTED
[17:08:57.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:63:0) after 8m17s
[17:17:14.154] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:63:0)
[17:17:14.205] Build status: STARTED
[17:17:14.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:64:0) after 1m17s
[17:18:31.581] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:64:0)
[17:18:31.605] Build status: STARTED
[17:18:31.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:65:0) after 6m8s
[17:24:39.636] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:65:0)
[17:24:39.658] Build status: STARTED
[17:24:39.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:66:0) after 7m54s
[17:32:33.694] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:66:0)
[17:32:33.719] Build status: STARTED
[17:32:33.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:67:0) after 3m7s
[17:35:41.382] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:67:0)
[17:35:41.402] Build status: STARTED
[17:35:41.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:68:0) after 3m22s
[17:39:04.220] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:68:0)
[17:39:04.242] Build status: STARTED
[17:39:04.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:69:0) after 4m59s
[17:44:03.567] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:69:0)
[17:44:03.589] Build status: STARTED
[17:44:03.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:70:0) after 1m28s
[17:45:31.655] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:70:0)
[17:45:31.682] Build status: STARTED
[17:45:31.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:71:0) after 8m30s
[17:54:02.249] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:71:0)
[17:54:02.283] Build status: STARTED
[17:54:02.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:72:0) after 3m18s
[17:57:20.296] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:72:0)
[17:57:20.315] Build status: STARTED
[17:57:20.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:73:0) after 2m32s
[17:59:52.452] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:73:0)
[17:59:52.472] Build status: STARTED
[17:59:52.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:74:0) after 5m26s
[18:05:18.672] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:74:0)
[18:05:18.698] Build status: STARTED
[18:05:18.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:75:0) after 1m13s
[18:06:31.723] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:75:0)
[18:06:31.740] Build status: STARTED
[18:06:31.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:76:0) after 9m27s
[18:15:58.900] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:76:0)
[18:15:58.919] Build status: STARTED
[18:15:58.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:77:0) after 2m42s
[18:18:41.060] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:77:0)
[18:18:41.080] Build status: STARTED
[18:18:41.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:78:0) after 2m48s
[18:21:29.781] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:78:0)
[18:21:29.800] Build status: STARTED
[18:21:29.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:79:0) after 5m59s
[18:27:28.959] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:79:0)
[18:27:28.979] Build status: STARTED
[18:27:28.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:80:0) after 4m53s
[18:32:22.210] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:80:0)
[18:32:22.229] Build status: STARTED
[18:32:22.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:81:0) after 8m38s
[18:41:00.730] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:81:0)
[18:41:00.754] Build status: STARTED
[18:41:00.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:82:0) after 6m19s
[18:47:20.031] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:82:0)
[18:47:20.100] Build status: STARTED
[18:47:20.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:83:0) after 7m40s
[18:55:00.131] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:83:0)
[18:55:00.148] Build status: STARTED
[18:55:00.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:84:0) after 3m18s
[18:58:18.224] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:84:0)
[18:58:18.245] Build status: STARTED
[18:58:18.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:85:0) after 1m18s
[18:59:36.470] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:85:0)
[18:59:36.493] Build status: STARTED
[18:59:36.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:86:0) after 2m2s
[19:01:38.522] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:86:0)
[19:01:38.543] Build status: STARTED
[19:01:38.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:87:0) after 2m48s
[19:04:26.600] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:87:0)
[19:04:26.619] Build status: STARTED
[19:04:26.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:88:0) after 4m54s
[19:09:20.716] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:88:0)
[19:09:20.732] Build status: STARTED
[19:09:20.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:89:0) after 3m31s
[19:12:51.820] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:89:0)
[19:12:51.841] Build status: STARTED
[19:12:51.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:90:0) after 6m24s
[19:19:15.973] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:90:0)
[19:19:15.992] Build status: STARTED
[19:19:15.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:91:0) after 1m35s
[19:20:51.031] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:91:0)
[19:20:51.088] Build status: STARTED
[19:20:51.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:92:0) after 2m8s
[19:22:59.147] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:92:0)
[19:22:59.216] Build status: STARTED
[19:22:59.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:93:0) after 9m47s
[19:32:46.772] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:93:0)
[19:32:46.792] Build status: STARTED
[19:32:46.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:94:0) after 8m12s
[19:40:59.208] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:94:0)
[19:40:59.231] Build status: STARTED
[19:40:59.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:95:0) after 1m25s
[19:42:24.254] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:95:0)
[19:42:24.275] Build status: STARTED
[19:42:24.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:96:0) after 5m43s
[19:48:07.303] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:96:0)
[19:48:07.323] Build status: STARTED
[19:48:07.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:97:0) after 9m48s
[19:57:55.636] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:97:0)
[19:57:55.652] Build status: STARTED
[19:57:55.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:98:0) after 4m8s
[20:02:03.767] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:98:0)
[20:02:03.875] Build status: STARTED
[20:02:03.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:99:0) after 5m25s
[20:07:28.896] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:99:0)
[20:07:28.937] Build status: STARTED
[20:07:28.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:100:0) after 2m52s
[20:10:21.152] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:100:0)
[20:10:21.168] Build status: STARTED
[20:10:21.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:101:0) after 6m17s
[20:16:38.227] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:101:0)
[20:16:38.249] Build status: STARTED
[20:16:38.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:102:0) after 2m48s
[20:19:26.283] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:102:0)
[20:19:26.299] Build status: STARTED
[20:19:26.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:103:0) after 2m10s
[20:21:36.907] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:103:0)
[20:21:36.937] Build status: STARTED
[20:21:36.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:104:0) after 4m57s
[20:26:34.218] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:104:0)
[20:26:34.238] Build status: STARTED
[20:26:34.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:105:0) after 7m22s
[20:33:56.497] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:105:0)
[20:33:56.524] Build status: STARTED
[20:33:56.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:106:0) after 3m34s
[20:37:30.899] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:106:0)
[20:37:31.032] Build status: STARTED
[20:37:31.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:107:0) after 3m6s
[20:40:37.054] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:107:0)
[20:40:37.074] Build status: STARTED
[20:40:37.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:108:0) after 3m11s
[20:43:48.099] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:108:0)
[20:43:48.125] Build status: STARTED
[20:43:48.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:109:0) after 9m46s
[20:53:34.406] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:109:0)
[20:53:34.424] Build status: STARTED
[20:53:34.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:110:0) after 2m19s
[20:55:53.459] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:110:0)
[20:55:53.481] Build status: STARTED
[20:55:53.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:111:0) after 6m36s
[21:02:29.662] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:111:0)
[21:02:29.707] Build status: STARTED
[21:02:29.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:112:0) after 3m11s
[21:05:40.737] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:112:0)
[21:05:40.758] Build status: STARTED
[21:05:40.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:113:0) after 1m21s
[21:07:02.143] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:113:0)
[21:07:02.168] Build status: STARTED
[21:07:02.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:114:0) after 7m44s
[21:14:46.507] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:114:0)
[21:14:46.526] Build status: STARTED
[21:14:46.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:115:0) after 6m31s
[21:21:17.550] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:115:0)
[21:21:17.566] Build status: STARTED
[21:21:17.566] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:116:0) after 1m12s
[21:22:29.561] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:116:0)
[21:22:29.588] Build status: STARTED
[21:22:29.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:117:0) after 9m29s
[21:31:58.636] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:117:0)
[21:31:58.653] Build status: STARTED
[21:31:58.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:118:0) after 6m34s
[21:38:32.953] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:118:0)
[21:38:33.082] Build status: STARTED
[21:38:33.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:119:0) after 3m50s
[21:42:23.271] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:119:0)
[21:42:23.290] Build status: STARTED
[21:42:23.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:120:0) after 6m24s
[21:48:47.415] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:120:0)
[21:48:47.433] Build status: STARTED
[21:48:47.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:121:0) after 1m16s
[21:50:03.704] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:121:0)
[21:50:03.724] Build status: STARTED
[21:50:03.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:122:0) after 4m55s
[21:54:58.754] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:122:0)
[21:54:58.771] Build status: STARTED
[21:54:58.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:123:0) after 5m28s
[22:00:26.796] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:123:0)
[22:00:26.837] Build status: STARTED
[22:00:26.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:124:0) after 2m49s
[22:03:16.198] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:124:0)
[22:03:16.218] Build status: STARTED
[22:03:16.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:125:0) after 5m20s
[22:08:36.377] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:125:0)
[22:08:36.399] Build status: STARTED
[22:08:36.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8946283110817267632:126:0) after 9m1s
[22:08:52.603] Received PubSub notification, asking Buildbucket for the build status
[22:08:52.621] Build:
{
"id": "8780853048921576705",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 18991,
"createdBy": "project:chromium",
"createTime": "2023-05-17T11:29:53.313943829Z",
"startTime": "2023-05-17T11:33:28.107794Z",
"endTime": "2023-05-17T22:08:51.961672252Z",
"updateTime": "2023-05-17T22:08:51.961672252Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e5c6120a9091ab98c9a9b578e30875fbd6635643",
"ref": "refs/heads/main"
}
}
}
[22:08:52.622] Invocation finished in 10h39m0.499091508s with status FAILED