[16:55:16.396] New invocation is queued and will start shortly
[16:55:17.466] Starting the invocation (attempt 1)
[16:55:17.493] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/656581539ebb9cfd110af849f7a428d5770cf762"
[16:55:17.493] Popped gitiles commit info from properties and tags
[16:55:17.493] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:55:17.493] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:55:17.493] Buildbucket request:
{
"requestId": "8910929821252470224",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "656581539ebb9cfd110af849f7a428d5770cf762",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8910929821252470224"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:55:18.097] Scheduled build:
{
"id": "8745499759374134913",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 23533,
"createdBy": "project:chromium",
"createTime": "2024-06-10T16:55:17.555644028Z",
"updateTime": "2024-06-10T16:55:17.555644028Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "656581539ebb9cfd110af849f7a428d5770cf762",
"ref": "refs/heads/main"
}
}
}
[16:55:18.097] Task URL: https://cr-buildbucket.appspot.com/build/8745499759374134913
[16:55:18.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:2:0) after 1m0s
[16:55:18.995] Received PubSub notification, asking Buildbucket for the build status
[16:55:19.057] Build status: SCHEDULED
[16:56:18.131] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:2:0)
[16:56:18.214] Build status: SCHEDULED
[16:56:18.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:4:0) after 6m10s
[16:56:55.431] Received PubSub notification, asking Buildbucket for the build status
[16:56:55.449] Build status: STARTED
[17:02:28.306] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:4:0)
[17:02:28.383] Build status: STARTED
[17:02:28.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:6:0) after 2m36s
[17:05:04.418] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:6:0)
[17:05:04.438] Build status: STARTED
[17:05:04.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:7:0) after 1m36s
[17:06:40.476] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:7:0)
[17:06:40.492] Build status: STARTED
[17:06:40.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:8:0) after 4m19s
[17:10:59.674] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:8:0)
[17:10:59.693] Build status: STARTED
[17:10:59.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:9:0) after 4m15s
[17:15:14.716] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:9:0)
[17:15:14.743] Build status: STARTED
[17:15:14.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:10:0) after 6m57s
[17:22:11.764] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:10:0)
[17:22:11.782] Build status: STARTED
[17:22:11.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:11:0) after 9m21s
[17:31:32.885] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:11:0)
[17:31:32.913] Build status: STARTED
[17:31:32.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:12:0) after 1m39s
[17:33:11.982] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:12:0)
[17:33:11.998] Build status: STARTED
[17:33:11.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:13:0) after 5m21s
[17:38:33.050] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:13:0)
[17:38:33.069] Build status: STARTED
[17:38:33.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:14:0) after 4m15s
[17:42:48.106] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:14:0)
[17:42:48.137] Build status: STARTED
[17:42:48.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:15:0) after 3m7s
[17:45:55.155] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:15:0)
[17:45:55.171] Build status: STARTED
[17:45:55.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:16:0) after 7m9s
[17:53:04.316] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:16:0)
[17:53:04.352] Build status: STARTED
[17:53:04.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:17:0) after 8m2s
[18:01:06.429] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:17:0)
[18:01:06.540] Build status: STARTED
[18:01:06.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:18:0) after 8m15s
[18:09:21.566] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:18:0)
[18:09:21.582] Build status: STARTED
[18:09:21.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:19:0) after 8m16s
[18:17:37.677] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:19:0)
[18:17:37.692] Build status: STARTED
[18:17:37.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:20:0) after 1m32s
[18:19:09.739] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:20:0)
[18:19:09.760] Build status: STARTED
[18:19:09.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:21:0) after 2m16s
[18:21:25.779] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:21:0)
[18:21:25.811] Build status: STARTED
[18:21:25.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:22:0) after 8m29s
[18:29:54.825] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:22:0)
[18:29:54.843] Build status: STARTED
[18:29:54.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:23:0) after 1m56s
[18:31:50.863] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:23:0)
[18:31:50.883] Build status: STARTED
[18:31:50.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:24:0) after 7m55s
[18:39:45.894] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:24:0)
[18:39:45.912] Build status: STARTED
[18:39:45.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:25:0) after 7m18s
[18:47:03.987] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:25:0)
[18:47:04.006] Build status: STARTED
[18:47:04.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:26:0) after 1m42s
[18:48:46.072] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:26:0)
[18:48:46.089] Build status: STARTED
[18:48:46.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:27:0) after 7m18s
[18:56:04.220] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:27:0)
[18:56:04.239] Build status: STARTED
[18:56:04.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:28:0) after 4m53s
[19:00:57.298] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:28:0)
[19:00:57.325] Build status: STARTED
[19:00:57.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:29:0) after 2m32s
[19:03:29.575] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:29:0)
[19:03:29.602] Build status: STARTED
[19:03:29.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:30:0) after 3m18s
[19:06:47.666] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:30:0)
[19:06:47.694] Build status: STARTED
[19:06:47.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:31:0) after 9m18s
[19:16:05.727] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:31:0)
[19:16:05.792] Build status: STARTED
[19:16:05.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:32:0) after 1m31s
[19:17:36.824] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:32:0)
[19:17:36.841] Build status: STARTED
[19:17:36.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:33:0) after 8m55s
[19:26:31.914] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:33:0)
[19:26:31.931] Build status: STARTED
[19:26:31.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:34:0) after 8m15s
[19:34:47.090] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:34:0)
[19:34:47.109] Build status: STARTED
[19:34:47.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:35:0) after 7m46s
[19:42:33.235] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:35:0)
[19:42:33.254] Build status: STARTED
[19:42:33.254] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:36:0) after 2m24s
[19:44:57.274] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:36:0)
[19:44:57.295] Build status: STARTED
[19:44:57.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:37:0) after 5m28s
[19:50:25.327] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:37:0)
[19:50:25.355] Build status: STARTED
[19:50:25.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:38:0) after 8m3s
[19:58:28.375] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:38:0)
[19:58:28.400] Build status: STARTED
[19:58:28.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:39:0) after 9m49s
[20:08:17.426] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:39:0)
[20:08:17.444] Build status: STARTED
[20:08:17.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:40:0) after 9m37s
[20:17:54.493] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:40:0)
[20:17:54.517] Build status: STARTED
[20:17:54.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:41:0) after 4m58s
[20:22:52.559] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:41:0)
[20:22:52.578] Build status: STARTED
[20:22:52.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:42:0) after 7m57s
[20:30:49.661] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:42:0)
[20:30:49.692] Build status: STARTED
[20:30:49.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:43:0) after 7m1s
[20:37:50.718] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:43:0)
[20:37:50.742] Build status: STARTED
[20:37:50.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:44:0) after 2m5s
[20:39:55.825] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:44:0)
[20:39:55.853] Build status: STARTED
[20:39:55.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:45:0) after 8m31s
[20:48:26.875] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:45:0)
[20:48:26.910] Build status: STARTED
[20:48:26.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:46:0) after 7m13s
[20:55:39.919] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:46:0)
[20:55:39.937] Build status: STARTED
[20:55:39.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:47:0) after 6m52s
[21:02:31.968] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:47:0)
[21:02:31.987] Build status: STARTED
[21:02:31.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:48:0) after 3m19s
[21:05:51.110] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:48:0)
[21:05:51.132] Build status: STARTED
[21:05:51.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:49:0) after 1m21s
[21:07:12.152] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:49:0)
[21:07:12.235] Build status: STARTED
[21:07:12.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:50:0) after 4m26s
[21:11:38.266] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:50:0)
[21:11:38.282] Build status: STARTED
[21:11:38.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:51:0) after 4m8s
[21:15:46.321] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:51:0)
[21:15:46.340] Build status: STARTED
[21:15:46.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:52:0) after 8m11s
[21:23:57.363] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:52:0)
[21:23:57.380] Build status: STARTED
[21:23:57.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:53:0) after 8m58s
[21:32:55.403] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:53:0)
[21:32:55.426] Build status: STARTED
[21:32:55.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:54:0) after 2m33s
[21:35:28.525] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:54:0)
[21:35:28.547] Build status: STARTED
[21:35:28.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:55:0) after 2m7s
[21:37:35.556] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:55:0)
[21:37:35.642] Build status: STARTED
[21:37:35.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:56:0) after 6m12s
[21:43:47.660] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:56:0)
[21:43:47.677] Build status: STARTED
[21:43:47.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:57:0) after 8m23s
[21:52:10.810] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:57:0)
[21:52:10.835] Build status: STARTED
[21:52:10.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:58:0) after 1m45s
[21:53:55.875] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:58:0)
[21:53:55.893] Build status: STARTED
[21:53:55.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910929821252470224:59:0) after 4m5s
[21:57:54.944] Received PubSub notification, asking Buildbucket for the build status
[21:57:54.992] Build:
{
"id": "8745499759374134913",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 23533,
"createdBy": "project:chromium",
"createTime": "2024-06-10T16:55:17.555644028Z",
"startTime": "2024-06-10T16:56:55.238512055Z",
"endTime": "2024-06-10T21:57:54.599782720Z",
"updateTime": "2024-06-10T21:57:54.599782720Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "656581539ebb9cfd110af849f7a428d5770cf762",
"ref": "refs/heads/main"
}
}
}
[21:57:54.992] Invocation finished in 5h2m38.611865637s with status FAILED