[10:10:29.275] New invocation is queued and will start shortly
[10:10:30.681] Starting the invocation (attempt 1)
[10:10:30.715] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/32e23a7233a5cdb3e0f8c50fce0dc0efd9603648"
[10:10:30.715] Popped gitiles commit info from properties and tags
[10:10:30.715] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:10:30.717] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:10:30.717] Buildbucket request:
{
"requestId": "9017134932766786736",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "32e23a7233a5cdb3e0f8c50fce0dc0efd9603648",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9017134932766786736"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:10:31.286] Scheduled build:
{
"id": "8851704870480774256",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 12464,
"createdBy": "project:chromium",
"createTime": "2021-03-26T10:10:30.822275Z",
"updateTime": "2021-03-26T10:10:31.213122Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "32e23a7233a5cdb3e0f8c50fce0dc0efd9603648",
"ref": "refs/heads/master"
}
}
}
[10:10:31.287] Task URL: https://cr-buildbucket.appspot.com/build/8851704870480774256
[10:10:31.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:2:0) after 4m37s
[10:10:34.949] Received PubSub notification, asking Buildbucket for the build status
[10:10:34.977] Build status: STARTED
[10:15:08.490] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:2:0)
[10:15:08.533] Build status: STARTED
[10:15:08.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:4:0) after 8m58s
[10:24:06.870] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:4:0)
[10:24:06.907] Build status: STARTED
[10:24:06.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:5:0) after 1m28s
[10:25:34.967] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:5:0)
[10:25:34.999] Build status: STARTED
[10:25:34.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:6:0) after 9m54s
[10:35:29.022] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:6:0)
[10:35:29.052] Build status: STARTED
[10:35:29.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:7:0) after 8m29s
[10:43:58.210] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:7:0)
[10:43:58.239] Build status: STARTED
[10:43:58.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:8:0) after 3m32s
[10:47:30.261] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:8:0)
[10:47:30.287] Build status: STARTED
[10:47:30.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:9:0) after 7m19s
[10:54:49.316] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:9:0)
[10:54:49.347] Build status: STARTED
[10:54:49.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:10:0) after 7m45s
[11:02:34.372] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:10:0)
[11:02:34.400] Build status: STARTED
[11:02:34.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:11:0) after 6m42s
[11:09:16.827] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:11:0)
[11:09:16.879] Build status: STARTED
[11:09:16.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:12:0) after 7m47s
[11:17:03.916] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:12:0)
[11:17:03.969] Build status: STARTED
[11:17:03.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:13:0) after 4m45s
[11:21:48.994] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:13:0)
[11:21:49.022] Build status: STARTED
[11:21:49.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:14:0) after 3m3s
[11:24:52.312] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:14:0)
[11:24:52.347] Build status: STARTED
[11:24:52.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:15:0) after 9m57s
[11:34:49.472] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:15:0)
[11:34:49.501] Build status: STARTED
[11:34:49.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:16:0) after 3m42s
[11:38:31.547] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:16:0)
[11:38:31.572] Build status: STARTED
[11:38:31.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:17:0) after 9m23s
[11:47:54.595] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:17:0)
[11:47:54.619] Build status: STARTED
[11:47:54.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:18:0) after 2m33s
[11:50:27.641] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:18:0)
[11:50:27.673] Build status: STARTED
[11:50:27.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:19:0) after 6m43s
[11:57:10.693] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:19:0)
[11:57:10.723] Build status: STARTED
[11:57:10.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:20:0) after 4m16s
[12:01:26.919] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:20:0)
[12:01:26.944] Build status: STARTED
[12:01:26.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:21:0) after 9m9s
[12:10:35.984] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:21:0)
[12:10:36.011] Build status: STARTED
[12:10:36.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:22:0) after 1m33s
[12:12:09.345] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:22:0)
[12:12:09.375] Build status: STARTED
[12:12:09.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:23:0) after 3m58s
[12:16:07.386] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:23:0)
[12:16:07.467] Build status: STARTED
[12:16:07.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:24:0) after 1m55s
[12:18:02.548] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:24:0)
[12:18:02.577] Build status: STARTED
[12:18:02.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:25:0) after 6m11s
[12:24:13.705] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:25:0)
[12:24:13.734] Build status: STARTED
[12:24:13.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:26:0) after 7m15s
[12:31:28.780] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:26:0)
[12:31:28.809] Build status: STARTED
[12:31:28.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:27:0) after 5m4s
[12:36:32.867] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:27:0)
[12:36:32.905] Build status: STARTED
[12:36:32.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:28:0) after 7m54s
[12:44:26.987] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:28:0)
[12:44:27.032] Build status: STARTED
[12:44:27.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:29:0) after 1m27s
[12:45:54.132] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:29:0)
[12:45:54.170] Build status: STARTED
[12:45:54.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:30:0) after 4m26s
[12:50:20.307] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:30:0)
[12:50:20.336] Build status: STARTED
[12:50:20.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:31:0) after 5m36s
[12:55:56.721] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:31:0)
[12:55:56.752] Build status: STARTED
[12:55:56.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:32:0) after 1m23s
[12:57:20.417] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:32:0)
[12:57:20.443] Build status: STARTED
[12:57:20.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:33:0) after 9m24s
[13:06:44.691] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:33:0)
[13:06:44.727] Build status: STARTED
[13:06:44.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:34:0) after 4m31s
[13:11:15.866] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:34:0)
[13:11:15.898] Build status: STARTED
[13:11:15.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:35:0) after 1m41s
[13:12:56.990] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:35:0)
[13:12:57.024] Build status: STARTED
[13:12:57.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:36:0) after 7m1s
[13:19:58.177] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:36:0)
[13:19:58.205] Build status: STARTED
[13:19:58.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:37:0) after 6m24s
[13:26:22.231] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:37:0)
[13:26:22.267] Build status: STARTED
[13:26:22.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:38:0) after 9m22s
[13:35:44.294] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:38:0)
[13:35:44.343] Build status: STARTED
[13:35:44.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:39:0) after 4m35s
[13:40:19.601] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:39:0)
[13:40:19.628] Build status: STARTED
[13:40:19.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:40:0) after 9m39s
[13:49:58.656] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:40:0)
[13:49:58.684] Build status: STARTED
[13:49:58.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:41:0) after 8m22s
[13:58:20.722] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:41:0)
[13:58:20.759] Build status: STARTED
[13:58:20.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:42:0) after 8m2s
[14:06:23.216] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:42:0)
[14:06:23.242] Build status: STARTED
[14:06:23.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:43:0) after 3m4s
[14:09:27.339] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:43:0)
[14:09:27.364] Build status: STARTED
[14:09:27.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:44:0) after 6m49s
[14:16:16.772] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:44:0)
[14:16:16.815] Build status: STARTED
[14:16:16.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:45:0) after 8m24s
[14:24:40.916] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:45:0)
[14:24:40.941] Build status: STARTED
[14:24:40.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:46:0) after 5m43s
[14:30:24.239] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:46:0)
[14:30:24.302] Build status: STARTED
[14:30:24.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:47:0) after 9m58s
[14:40:22.422] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:47:0)
[14:40:22.501] Build status: STARTED
[14:40:22.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:48:0) after 1m1s
[14:41:23.525] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:48:0)
[14:41:23.587] Build status: STARTED
[14:41:23.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:49:0) after 4m52s
[14:46:15.663] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:49:0)
[14:46:15.688] Build status: STARTED
[14:46:15.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:50:0) after 4m22s
[14:50:37.862] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:50:0)
[14:50:37.887] Build status: STARTED
[14:50:37.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:51:0) after 8m33s
[14:59:10.920] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:51:0)
[14:59:10.955] Build status: STARTED
[14:59:10.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:52:0) after 3m48s
[15:02:59.112] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:52:0)
[15:02:59.140] Build status: STARTED
[15:02:59.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:53:0) after 1m54s
[15:04:53.231] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:53:0)
[15:04:53.281] Build status: STARTED
[15:04:53.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:54:0) after 7m42s
[15:12:35.357] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:54:0)
[15:12:35.411] Build status: STARTED
[15:12:35.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:55:0) after 7m24s
[15:19:59.775] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:55:0)
[15:19:59.809] Build status: STARTED
[15:19:59.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:56:0) after 5m30s
[15:25:30.063] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:56:0)
[15:25:30.098] Build status: STARTED
[15:25:30.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:57:0) after 1m11s
[15:26:41.876] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:57:0)
[15:26:41.915] Build status: STARTED
[15:26:41.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:58:0) after 5m6s
[15:31:48.212] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:58:0)
[15:31:48.273] Build status: STARTED
[15:31:48.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:59:0) after 4m37s
[15:36:25.393] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:59:0)
[15:36:25.424] Build status: STARTED
[15:36:25.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:60:0) after 5m59s
[15:42:24.673] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:60:0)
[15:42:24.713] Build status: STARTED
[15:42:24.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:61:0) after 3m8s
[15:45:33.405] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:61:0)
[15:45:33.440] Build status: STARTED
[15:45:33.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:62:0) after 8m3s
[15:53:36.722] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:62:0)
[15:53:36.756] Build status: STARTED
[15:53:36.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:63:0) after 7m58s
[16:01:35.080] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:63:0)
[16:01:35.118] Build status: STARTED
[16:01:35.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:64:0) after 6m25s
[16:08:00.623] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:64:0)
[16:08:00.661] Build status: STARTED
[16:08:00.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:65:0) after 3m3s
[16:11:03.813] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:65:0)
[16:11:03.838] Build status: STARTED
[16:11:03.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:66:0) after 2m13s
[16:13:17.063] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:66:0)
[16:13:17.090] Build status: STARTED
[16:13:17.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:67:0) after 8m9s
[16:21:26.213] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:67:0)
[16:21:26.241] Build status: STARTED
[16:21:26.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:68:0) after 7m54s
[16:29:20.272] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:68:0)
[16:29:20.302] Build status: STARTED
[16:29:20.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:69:0) after 1m22s
[16:30:42.340] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:69:0)
[16:30:42.395] Build status: STARTED
[16:30:42.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:70:0) after 8m4s
[16:38:46.579] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:70:0)
[16:38:46.713] Build status: STARTED
[16:38:46.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:71:0) after 6m11s
[16:44:57.905] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:71:0)
[16:44:57.949] Build status: STARTED
[16:44:57.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:72:0) after 9m6s
[16:54:03.975] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:72:0)
[16:54:04.000] Build status: STARTED
[16:54:04.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:73:0) after 7m27s
[17:01:31.028] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:73:0)
[17:01:31.153] Build status: STARTED
[17:01:31.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:74:0) after 7m30s
[17:09:02.169] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:74:0)
[17:09:02.202] Build status: STARTED
[17:09:02.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:75:0) after 6m25s
[17:15:27.224] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:75:0)
[17:15:27.253] Build status: STARTED
[17:15:27.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:76:0) after 4m49s
[17:20:16.406] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:76:0)
[17:20:16.432] Build status: STARTED
[17:20:16.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:77:0) after 1m22s
[17:21:38.509] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:77:0)
[17:21:38.557] Build status: STARTED
[17:21:38.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:78:0) after 2m0s
[17:23:40.112] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:78:0)
[17:23:40.137] Build status: STARTED
[17:23:40.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:79:0) after 9m15s
[17:32:55.197] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:79:0)
[17:32:55.226] Build status: STARTED
[17:32:55.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:80:0) after 3m48s
[17:36:43.328] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:80:0)
[17:36:43.355] Build status: STARTED
[17:36:43.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:81:0) after 8m10s
[17:44:53.378] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:81:0)
[17:44:53.409] Build status: STARTED
[17:44:53.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:82:0) after 1m39s
[17:46:32.445] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:82:0)
[17:46:32.474] Build status: STARTED
[17:46:32.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:83:0) after 5m21s
[17:51:53.513] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:83:0)
[17:51:53.545] Build status: STARTED
[17:51:53.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:84:0) after 3m51s
[17:55:44.727] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:84:0)
[17:55:44.755] Build status: STARTED
[17:55:44.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:85:0) after 5m4s
[18:00:48.923] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:85:0)
[18:00:48.956] Build status: STARTED
[18:00:48.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:86:0) after 1m43s
[18:02:32.104] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:86:0)
[18:02:32.137] Build status: STARTED
[18:02:32.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:87:0) after 2m25s
[18:04:57.804] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:87:0)
[18:04:57.851] Build status: STARTED
[18:04:57.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:88:0) after 4m30s
[18:09:27.873] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:88:0)
[18:09:27.903] Build status: STARTED
[18:09:27.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:89:0) after 1m25s
[18:10:52.945] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:89:0)
[18:10:53.016] Build status: STARTED
[18:10:53.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:90:0) after 1m48s
[18:12:41.305] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:90:0)
[18:12:41.329] Build status: STARTED
[18:12:41.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:91:0) after 1m19s
[18:14:00.630] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:91:0)
[18:14:00.671] Build status: STARTED
[18:14:00.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:92:0) after 9m21s
[18:23:23.532] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:92:0)
[18:23:23.557] Build status: STARTED
[18:23:23.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:93:0) after 8m8s
[18:31:31.591] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:93:0)
[18:31:31.649] Build status: STARTED
[18:31:31.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:94:0) after 8m12s
[18:39:43.708] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:94:0)
[18:39:43.739] Build status: STARTED
[18:39:43.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:95:0) after 8m29s
[18:48:12.945] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:95:0)
[18:48:12.977] Build status: STARTED
[18:48:12.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:96:0) after 6m22s
[18:54:35.000] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:96:0)
[18:54:35.024] Build status: STARTED
[18:54:35.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:97:0) after 1m12s
[18:55:47.212] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:97:0)
[18:55:47.241] Build status: STARTED
[18:55:47.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:98:0) after 7m35s
[19:03:22.273] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:98:0)
[19:03:22.342] Build status: STARTED
[19:03:22.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:99:0) after 2m38s
[19:06:00.541] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:99:0)
[19:06:00.592] Build status: STARTED
[19:06:00.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:100:0) after 2m1s
[19:08:01.616] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:100:0)
[19:08:01.645] Build status: STARTED
[19:08:01.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:101:0) after 7m36s
[19:15:37.674] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:101:0)
[19:15:37.703] Build status: STARTED
[19:15:37.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:102:0) after 7m37s
[19:23:14.752] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:102:0)
[19:23:14.789] Build status: STARTED
[19:23:14.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:103:0) after 3m5s
[19:26:19.832] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:103:0)
[19:26:19.869] Build status: STARTED
[19:26:19.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:104:0) after 3m17s
[19:29:37.385] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:104:0)
[19:29:37.412] Build status: STARTED
[19:29:37.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:105:0) after 4m49s
[19:34:26.518] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:105:0)
[19:34:26.544] Build status: STARTED
[19:34:26.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:106:0) after 6m39s
[19:41:05.928] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:106:0)
[19:41:05.956] Build status: STARTED
[19:41:05.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:107:0) after 8m10s
[19:49:16.128] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:107:0)
[19:49:16.156] Build status: STARTED
[19:49:16.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:108:0) after 9m39s
[19:58:55.436] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:108:0)
[19:58:55.585] Build status: STARTED
[19:58:55.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:109:0) after 9m55s
[20:08:51.738] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:109:0)
[20:08:51.812] Build status: STARTED
[20:08:51.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:110:0) after 9m23s
[20:18:15.099] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:110:0)
[20:18:15.132] Build status: STARTED
[20:18:15.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:111:0) after 5m59s
[20:24:14.392] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:111:0)
[20:24:14.429] Build status: STARTED
[20:24:14.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:112:0) after 2m24s
[20:26:38.453] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:112:0)
[20:26:38.479] Build status: STARTED
[20:26:38.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:113:0) after 6m25s
[20:33:03.501] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:113:0)
[20:33:03.533] Build status: STARTED
[20:33:03.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:114:0) after 9m38s
[20:42:41.572] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:114:0)
[20:42:41.599] Build status: STARTED
[20:42:41.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:115:0) after 5m0s
[20:47:41.728] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:115:0)
[20:47:41.757] Build status: STARTED
[20:47:41.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:116:0) after 4m2s
[20:51:43.885] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:116:0)
[20:51:43.915] Build status: STARTED
[20:51:43.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:117:0) after 5m44s
[20:57:28.140] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:117:0)
[20:57:28.165] Build status: STARTED
[20:57:28.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:118:0) after 7m21s
[21:04:49.190] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:118:0)
[21:04:49.222] Build status: STARTED
[21:04:49.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:119:0) after 1m27s
[21:06:17.236] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:119:0)
[21:06:17.274] Build status: STARTED
[21:06:17.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:120:0) after 4m24s
[21:10:41.305] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:120:0)
[21:10:41.334] Build status: STARTED
[21:10:41.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:9017134932766786736:121:0) after 9m45s
[21:12:56.836] Received PubSub notification, asking Buildbucket for the build status
[21:12:56.866] Build:
{
"id": "8851704870480774256",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 12464,
"createdBy": "project:chromium",
"createTime": "2021-03-26T10:10:30.822275Z",
"startTime": "2021-03-26T10:10:34.401217Z",
"endTime": "2021-03-26T21:12:56.485848659Z",
"updateTime": "2021-03-26T21:12:56.486319568Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "32e23a7233a5cdb3e0f8c50fce0dc0efd9603648",
"ref": "refs/heads/master"
}
}
}
[21:12:56.866] Invocation finished in 11h2m27.607400016s with status FAILED