[20:16:30.997] New invocation is queued and will start shortly
[20:16:32.072] Starting the invocation (attempt 1)
[20:16:32.111] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d8b3562aac9d5793246a509f3a91ead259372625"
[20:16:32.111] Popped gitiles commit info from properties and tags
[20:16:32.111] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:16:32.111] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:16:32.111] Buildbucket request:
{
"requestId": "8947427737565878336",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d8b3562aac9d5793246a509f3a91ead259372625",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8947427737565878336"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:16:32.583] Scheduled build:
{
"id": "8781997675670158673",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 18961,
"createdBy": "project:chromium",
"createTime": "2023-05-04T20:16:32.181179312Z",
"updateTime": "2023-05-04T20:16:32.181179312Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d8b3562aac9d5793246a509f3a91ead259372625",
"ref": "refs/heads/main"
}
}
}
[20:16:32.583] Task URL: https://cr-buildbucket.appspot.com/build/8781997675670158673
[20:16:32.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:2:0) after 9m50s
[20:18:46.015] Received PubSub notification, asking Buildbucket for the build status
[20:18:46.034] Build status: STARTED
[20:26:22.647] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:2:0)
[20:26:22.684] Build status: STARTED
[20:26:22.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:4:0) after 7m13s
[20:33:35.736] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:4:0)
[20:33:35.759] Build status: STARTED
[20:33:35.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:5:0) after 4m26s
[20:38:01.873] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:5:0)
[20:38:01.895] Build status: STARTED
[20:38:01.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:6:0) after 9m47s
[20:47:48.924] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:6:0)
[20:47:48.946] Build status: STARTED
[20:47:48.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:7:0) after 6m12s
[20:54:00.972] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:7:0)
[20:54:00.992] Build status: STARTED
[20:54:00.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:8:0) after 8m32s
[21:02:33.071] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:8:0)
[21:02:33.124] Build status: STARTED
[21:02:33.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:9:0) after 3m16s
[21:05:49.520] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:9:0)
[21:05:49.546] Build status: STARTED
[21:05:49.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:10:0) after 3m7s
[21:08:57.009] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:10:0)
[21:08:57.031] Build status: STARTED
[21:08:57.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:11:0) after 6m0s
[21:14:57.163] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:11:0)
[21:14:57.192] Build status: STARTED
[21:14:57.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:12:0) after 4m3s
[21:19:00.219] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:12:0)
[21:19:00.250] Build status: STARTED
[21:19:00.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:13:0) after 2m36s
[21:21:36.283] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:13:0)
[21:21:36.302] Build status: STARTED
[21:21:36.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:14:0) after 5m48s
[21:27:24.305] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:14:0)
[21:27:24.325] Build status: STARTED
[21:27:24.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:15:0) after 9m24s
[21:36:48.411] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:15:0)
[21:36:48.429] Build status: STARTED
[21:36:48.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:16:0) after 8m27s
[21:45:15.480] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:16:0)
[21:45:15.504] Build status: STARTED
[21:45:15.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:17:0) after 3m54s
[21:49:09.663] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:17:0)
[21:49:09.691] Build status: STARTED
[21:49:09.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:18:0) after 2m14s
[21:51:23.799] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:18:0)
[21:51:23.829] Build status: STARTED
[21:51:23.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:19:0) after 2m6s
[21:53:29.975] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:19:0)
[21:53:29.996] Build status: STARTED
[21:53:29.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:20:0) after 8m36s
[22:02:06.074] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:20:0)
[22:02:06.097] Build status: STARTED
[22:02:06.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:21:0) after 5m53s
[22:07:59.125] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:21:0)
[22:07:59.147] Build status: STARTED
[22:07:59.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:22:0) after 6m3s
[22:14:02.196] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:22:0)
[22:14:02.214] Build status: STARTED
[22:14:02.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:23:0) after 5m7s
[22:19:09.240] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:23:0)
[22:19:09.258] Build status: STARTED
[22:19:09.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:24:0) after 1m42s
[22:20:51.562] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:24:0)
[22:20:51.583] Build status: STARTED
[22:20:51.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:25:0) after 9m56s
[22:30:47.621] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:25:0)
[22:30:47.644] Build status: STARTED
[22:30:47.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:26:0) after 8m49s
[22:39:36.671] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:26:0)
[22:39:36.753] Build status: STARTED
[22:39:36.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:27:0) after 8m5s
[22:47:41.919] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:27:0)
[22:47:41.961] Build status: STARTED
[22:47:41.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:28:0) after 4m59s
[22:52:41.199] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:28:0)
[22:52:41.227] Build status: STARTED
[22:52:41.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:29:0) after 4m22s
[22:57:03.262] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:29:0)
[22:57:03.287] Build status: STARTED
[22:57:03.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:30:0) after 5m6s
[23:02:09.354] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:30:0)
[23:02:09.387] Build status: STARTED
[23:02:09.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:31:0) after 6m51s
[23:09:00.507] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:31:0)
[23:09:00.558] Build status: STARTED
[23:09:00.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:32:0) after 1m37s
[23:10:37.606] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:32:0)
[23:10:37.632] Build status: STARTED
[23:10:37.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:33:0) after 1m28s
[23:12:05.681] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:33:0)
[23:12:05.702] Build status: STARTED
[23:12:05.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:34:0) after 3m34s
[23:15:40.039] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:34:0)
[23:15:40.075] Build status: STARTED
[23:15:40.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:35:0) after 4m5s
[23:19:45.241] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:35:0)
[23:19:45.261] Build status: STARTED
[23:19:45.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:36:0) after 2m33s
[23:22:18.336] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:36:0)
[23:22:18.357] Build status: STARTED
[23:22:18.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:37:0) after 7m30s
[23:29:48.846] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:37:0)
[23:29:48.869] Build status: STARTED
[23:29:48.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:38:0) after 6m58s
[23:36:47.254] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:38:0)
[23:36:47.275] Build status: STARTED
[23:36:47.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:39:0) after 3m40s
[23:40:27.377] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:39:0)
[23:40:27.399] Build status: STARTED
[23:40:27.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:40:0) after 9m47s
[23:50:14.432] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:40:0)
[23:50:14.452] Build status: STARTED
[23:50:14.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:41:0) after 7m29s
[23:57:43.850] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:41:0)
[23:57:43.873] Build status: STARTED
[23:57:43.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:42:0) after 8m12s
[00:05:56.006] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:42:0)
[00:05:56.051] Build status: STARTED
[00:05:56.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:43:0) after 8m59s
[00:14:55.087] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:43:0)
[00:14:55.111] Build status: STARTED
[00:14:55.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:44:0) after 7m32s
[00:22:27.647] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:44:0)
[00:22:27.674] Build status: STARTED
[00:22:27.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:45:0) after 2m7s
[00:24:34.744] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:45:0)
[00:24:34.766] Build status: STARTED
[00:24:34.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:46:0) after 9m45s
[00:34:19.804] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:46:0)
[00:34:19.985] Build status: STARTED
[00:34:19.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:47:0) after 3m54s
[00:38:13.998] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:47:0)
[00:38:14.019] Build status: STARTED
[00:38:14.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:48:0) after 3m33s
[00:41:47.049] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:48:0)
[00:41:47.075] Build status: STARTED
[00:41:47.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:49:0) after 9m16s
[00:51:03.203] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:49:0)
[00:51:03.234] Build status: STARTED
[00:51:03.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:50:0) after 6m2s
[00:57:05.319] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:50:0)
[00:57:05.338] Build status: STARTED
[00:57:05.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:51:0) after 6m9s
[01:03:14.373] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:51:0)
[01:03:14.415] Build status: STARTED
[01:03:14.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:52:0) after 2m32s
[01:05:46.547] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:52:0)
[01:05:46.566] Build status: STARTED
[01:05:46.566] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:53:0) after 9m18s
[01:15:04.617] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:53:0)
[01:15:04.670] Build status: STARTED
[01:15:04.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:54:0) after 1m24s
[01:16:28.696] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:54:0)
[01:16:28.718] Build status: STARTED
[01:16:28.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:55:0) after 3m20s
[01:19:48.737] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:55:0)
[01:19:48.837] Build status: STARTED
[01:19:48.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:56:0) after 4m10s
[01:23:59.067] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:56:0)
[01:23:59.088] Build status: STARTED
[01:23:59.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:57:0) after 5m19s
[01:29:18.260] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:57:0)
[01:29:18.293] Build status: STARTED
[01:29:18.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:58:0) after 6m54s
[01:36:12.554] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:58:0)
[01:36:12.573] Build status: STARTED
[01:36:12.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:59:0) after 5m26s
[01:41:38.985] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:59:0)
[01:41:39.010] Build status: STARTED
[01:41:39.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:60:0) after 2m52s
[01:44:31.208] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:60:0)
[01:44:31.237] Build status: STARTED
[01:44:31.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:61:0) after 2m47s
[01:47:19.173] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:61:0)
[01:47:19.195] Build status: STARTED
[01:47:19.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:62:0) after 2m29s
[01:49:48.329] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:62:0)
[01:49:48.348] Build status: STARTED
[01:49:48.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:63:0) after 5m27s
[01:55:16.178] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:63:0)
[01:55:16.220] Build status: STARTED
[01:55:16.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:64:0) after 7m15s
[02:02:31.356] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:64:0)
[02:02:31.378] Build status: STARTED
[02:02:31.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:65:0) after 2m23s
[02:04:54.580] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:65:0)
[02:04:54.601] Build status: STARTED
[02:04:54.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:66:0) after 8m19s
[02:13:13.783] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:66:0)
[02:13:13.801] Build status: STARTED
[02:13:13.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:67:0) after 4m42s
[02:17:56.345] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:67:0)
[02:17:56.368] Build status: STARTED
[02:17:56.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:68:0) after 9m58s
[02:27:54.701] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:68:0)
[02:27:54.741] Build status: STARTED
[02:27:54.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:69:0) after 1m18s
[02:29:12.790] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:69:0)
[02:29:12.812] Build status: STARTED
[02:29:12.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:70:0) after 1m41s
[02:30:54.116] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:70:0)
[02:30:54.137] Build status: STARTED
[02:30:54.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:71:0) after 3m34s
[02:34:28.492] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:71:0)
[02:34:28.523] Build status: STARTED
[02:34:28.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:72:0) after 5m53s
[02:40:21.551] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:72:0)
[02:40:21.600] Build status: STARTED
[02:40:21.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:73:0) after 9m32s
[02:49:53.628] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:73:0)
[02:49:53.650] Build status: STARTED
[02:49:53.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:74:0) after 1m1s
[02:50:54.816] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:74:0)
[02:50:54.833] Build status: STARTED
[02:50:54.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:75:0) after 4m56s
[02:55:50.963] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:75:0)
[02:55:50.990] Build status: STARTED
[02:55:50.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:76:0) after 4m43s
[03:00:34.120] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:76:0)
[03:00:34.195] Build status: STARTED
[03:00:34.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:77:0) after 9m26s
[03:10:00.373] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:77:0)
[03:10:00.402] Build status: STARTED
[03:10:00.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:78:0) after 8m55s
[03:18:55.524] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:78:0)
[03:18:55.541] Build status: STARTED
[03:18:55.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:79:0) after 1m34s
[03:20:29.632] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:79:0)
[03:20:29.649] Build status: STARTED
[03:20:29.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:80:0) after 3m18s
[03:23:47.679] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:80:0)
[03:23:47.702] Build status: STARTED
[03:23:47.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:81:0) after 8m16s
[03:32:03.752] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:81:0)
[03:32:03.772] Build status: STARTED
[03:32:03.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:82:0) after 3m38s
[03:35:42.331] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:82:0)
[03:35:42.351] Build status: STARTED
[03:35:42.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:83:0) after 3m20s
[03:39:02.401] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:83:0)
[03:39:02.419] Build status: STARTED
[03:39:02.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:84:0) after 1m44s
[03:40:46.453] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:84:0)
[03:40:46.571] Build status: STARTED
[03:40:46.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:85:0) after 7m24s
[03:48:11.409] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:85:0)
[03:48:11.429] Build status: STARTED
[03:48:11.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:86:0) after 2m42s
[03:50:53.413] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:86:0)
[03:50:53.434] Build status: STARTED
[03:50:53.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:87:0) after 1m39s
[03:52:32.797] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:87:0)
[03:52:32.816] Build status: STARTED
[03:52:32.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:88:0) after 5m56s
[03:58:28.843] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:88:0)
[03:58:28.863] Build status: STARTED
[03:58:28.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:89:0) after 7m37s
[04:06:06.059] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:89:0)
[04:06:06.077] Build status: STARTED
[04:06:06.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:90:0) after 3m55s
[04:10:01.352] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:90:0)
[04:10:01.374] Build status: STARTED
[04:10:01.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:91:0) after 7m51s
[04:17:52.600] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:91:0)
[04:17:52.625] Build status: STARTED
[04:17:52.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:92:0) after 8m19s
[04:26:11.726] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:92:0)
[04:26:11.744] Build status: STARTED
[04:26:11.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:93:0) after 9m47s
[04:35:59.164] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:93:0)
[04:35:59.192] Build status: STARTED
[04:35:59.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:94:0) after 9m49s
[04:45:48.402] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:94:0)
[04:45:48.445] Build status: STARTED
[04:45:48.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:95:0) after 5m51s
[04:51:39.479] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:95:0)
[04:51:39.548] Build status: STARTED
[04:51:39.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:96:0) after 7m25s
[04:59:04.608] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:96:0)
[04:59:04.641] Build status: STARTED
[04:59:04.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:97:0) after 8m38s
[05:07:42.731] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:97:0)
[05:07:42.781] Build status: STARTED
[05:07:42.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:98:0) after 9m10s
[05:16:52.959] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:98:0)
[05:16:52.976] Build status: STARTED
[05:16:52.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:99:0) after 9m27s
[05:26:19.974] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:99:0)
[05:26:20.217] Build status: STARTED
[05:26:20.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:100:0) after 6m6s
[05:32:26.343] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:100:0)
[05:32:26.364] Build status: STARTED
[05:32:26.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:101:0) after 6m41s
[05:39:07.390] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:101:0)
[05:39:07.449] Build status: STARTED
[05:39:07.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:102:0) after 4m5s
[05:43:12.489] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:102:0)
[05:43:12.511] Build status: STARTED
[05:43:12.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:103:0) after 1m29s
[05:44:41.588] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:103:0)
[05:44:41.606] Build status: STARTED
[05:44:41.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:104:0) after 1m56s
[05:46:37.617] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:104:0)
[05:46:37.637] Build status: STARTED
[05:46:37.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:105:0) after 4m47s
[05:51:24.672] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:105:0)
[05:51:24.736] Build status: STARTED
[05:51:24.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:106:0) after 3m50s
[05:55:14.762] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:106:0)
[05:55:14.800] Build status: STARTED
[05:55:14.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:107:0) after 2m26s
[05:57:40.931] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:107:0)
[05:57:40.949] Build status: STARTED
[05:57:40.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:108:0) after 1m11s
[05:58:51.965] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:108:0)
[05:58:51.987] Build status: STARTED
[05:58:51.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:109:0) after 3m43s
[06:02:35.016] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:109:0)
[06:02:35.039] Build status: STARTED
[06:02:35.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:110:0) after 5m51s
[06:08:26.325] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:110:0)
[06:08:26.350] Build status: STARTED
[06:08:26.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:111:0) after 7m37s
[06:16:03.480] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:111:0)
[06:16:03.504] Build status: STARTED
[06:16:03.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:112:0) after 8m3s
[06:24:06.528] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:112:0)
[06:24:06.546] Build status: STARTED
[06:24:06.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:113:0) after 2m23s
[06:26:29.717] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:113:0)
[06:26:29.744] Build status: STARTED
[06:26:29.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:114:0) after 3m10s
[06:29:39.914] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:114:0)
[06:29:39.932] Build status: STARTED
[06:29:39.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:115:0) after 9m38s
[06:39:17.962] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:115:0)
[06:39:17.986] Build status: STARTED
[06:39:17.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:116:0) after 2m5s
[06:41:23.157] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:116:0)
[06:41:23.178] Build status: STARTED
[06:41:23.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:117:0) after 5m14s
[06:46:37.247] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:117:0)
[06:46:37.332] Build status: STARTED
[06:46:37.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:118:0) after 7m44s
[06:54:21.410] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:118:0)
[06:54:21.430] Build status: STARTED
[06:54:21.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:119:0) after 5m29s
[06:59:50.457] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:119:0)
[06:59:50.481] Build status: STARTED
[06:59:50.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:120:0) after 8m28s
[07:08:18.668] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:120:0)
[07:08:18.686] Build status: STARTED
[07:08:18.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947427737565878336:121:0) after 2m39s
[07:10:10.682] Received PubSub notification, asking Buildbucket for the build status
[07:10:10.704] Build:
{
"id": "8781997675670158673",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 18961,
"createdBy": "project:chromium",
"createTime": "2023-05-04T20:16:32.181179312Z",
"startTime": "2023-05-04T20:18:45.353479Z",
"endTime": "2023-05-05T07:09:57.175586757Z",
"updateTime": "2023-05-05T07:09:57.175586757Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d8b3562aac9d5793246a509f3a91ead259372625",
"ref": "refs/heads/main"
}
}
}
[07:10:10.704] Invocation finished in 10h53m39.714193796s with status FAILED