[07:25:38.857] New invocation is queued and will start shortly
[07:25:39.953] Starting the invocation (attempt 1)
[07:25:39.982] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f84af0f0ec6e18e8eb205acf1e5fc1f970d7db48"
[07:25:39.982] Popped gitiles commit info from properties and tags
[07:25:39.982] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[07:25:39.982] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[07:25:39.982] Buildbucket request:
{
"requestId": "8887319850764867456",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f84af0f0ec6e18e8eb205acf1e5fc1f970d7db48",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8887319850764867456"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[07:25:40.768] Scheduled build:
{
"id": "8721889788750134929",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 26384,
"createdBy": "project:chromium",
"createTime": "2025-02-26T07:25:40.151466633Z",
"updateTime": "2025-02-26T07:25:40.151466633Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f84af0f0ec6e18e8eb205acf1e5fc1f970d7db48",
"ref": "refs/heads/main"
}
}
}
[07:25:40.769] Task URL: https://cr-buildbucket.appspot.com/build/8721889788750134929
[07:25:40.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:2:0) after 7m57s
[07:25:41.698] Received PubSub notification, asking Buildbucket for the build status
[07:25:41.938] Build status: SCHEDULED
[07:26:50.274] Received PubSub notification, asking Buildbucket for the build status
[07:26:50.298] Build status: STARTED
[07:33:37.797] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:2:0)
[07:33:37.849] Build status: STARTED
[07:33:37.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:5:0) after 4m51s
[07:38:28.868] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:5:0)
[07:38:28.893] Build status: STARTED
[07:38:28.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:6:0) after 1m34s
[07:40:03.082] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:6:0)
[07:40:03.107] Build status: STARTED
[07:40:03.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:7:0) after 2m53s
[07:42:56.890] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:7:0)
[07:42:56.914] Build status: STARTED
[07:42:56.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:8:0) after 1m0s
[07:43:56.899] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:8:0)
[07:43:56.946] Build status: STARTED
[07:43:56.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:9:0) after 9m47s
[07:53:43.964] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:9:0)
[07:53:43.983] Build status: STARTED
[07:53:43.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:10:0) after 6m59s
[08:00:43.104] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:10:0)
[08:00:43.125] Build status: STARTED
[08:00:43.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:11:0) after 2m26s
[08:03:09.364] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:11:0)
[08:03:09.383] Build status: STARTED
[08:03:09.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:12:0) after 8m51s
[08:12:00.804] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:12:0)
[08:12:00.822] Build status: STARTED
[08:12:00.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:13:0) after 6m38s
[08:18:39.349] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:13:0)
[08:18:39.384] Build status: STARTED
[08:18:39.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:14:0) after 9m53s
[08:28:32.654] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:14:0)
[08:28:32.682] Build status: STARTED
[08:28:32.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:15:0) after 9m44s
[08:38:17.108] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:15:0)
[08:38:17.122] Build status: STARTED
[08:38:17.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:16:0) after 7m11s
[08:45:28.405] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:16:0)
[08:45:28.427] Build status: STARTED
[08:45:28.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:17:0) after 4m53s
[08:50:21.667] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:17:0)
[08:50:21.684] Build status: STARTED
[08:50:21.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:18:0) after 3m11s
[08:53:32.796] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:18:0)
[08:53:32.944] Build status: STARTED
[08:53:32.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:19:0) after 7m15s
[09:00:47.970] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:19:0)
[09:00:47.984] Build status: STARTED
[09:00:47.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:20:0) after 7m9s
[09:07:57.185] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:20:0)
[09:07:57.257] Build status: STARTED
[09:07:57.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:21:0) after 9m16s
[09:17:13.678] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:21:0)
[09:17:13.695] Build status: STARTED
[09:17:13.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:22:0) after 8m36s
[09:25:49.718] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:22:0)
[09:25:49.735] Build status: STARTED
[09:25:49.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:23:0) after 3m36s
[09:29:26.073] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:23:0)
[09:29:26.087] Build status: STARTED
[09:29:26.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:24:0) after 6m10s
[09:35:36.293] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:24:0)
[09:35:36.309] Build status: STARTED
[09:35:36.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:25:0) after 1m50s
[09:37:26.461] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:25:0)
[09:37:26.488] Build status: STARTED
[09:37:26.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:26:0) after 4m29s
[09:41:55.498] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:26:0)
[09:41:55.519] Build status: STARTED
[09:41:55.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:27:0) after 5m27s
[09:47:22.588] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:27:0)
[09:47:22.611] Build status: STARTED
[09:47:22.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:28:0) after 3m48s
[09:51:10.645] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:28:0)
[09:51:10.664] Build status: STARTED
[09:51:10.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:29:0) after 8m30s
[09:59:40.696] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:29:0)
[09:59:40.733] Build status: STARTED
[09:59:40.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:30:0) after 3m5s
[10:02:45.754] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:30:0)
[10:02:46.054] Build status: STARTED
[10:02:46.054] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:31:0) after 7m17s
[10:10:03.078] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:31:0)
[10:10:03.098] Build status: STARTED
[10:10:03.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:32:0) after 9m47s
[10:19:50.210] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:32:0)
[10:19:50.240] Build status: STARTED
[10:19:50.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:33:0) after 4m13s
[10:24:03.293] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:33:0)
[10:24:03.309] Build status: STARTED
[10:24:03.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:34:0) after 8m2s
[10:32:05.331] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:34:0)
[10:32:05.436] Build status: STARTED
[10:32:05.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:35:0) after 9m50s
[10:41:55.509] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:35:0)
[10:41:55.529] Build status: STARTED
[10:41:55.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:36:0) after 1m17s
[10:43:12.550] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:36:0)
[10:43:12.571] Build status: STARTED
[10:43:12.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:37:0) after 9m40s
[10:52:52.587] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:37:0)
[10:52:52.602] Build status: STARTED
[10:52:52.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:38:0) after 5m52s
[10:58:44.689] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:38:0)
[10:58:44.713] Build status: STARTED
[10:58:44.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:39:0) after 4m33s
[11:03:17.781] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:39:0)
[11:03:17.815] Build status: STARTED
[11:03:17.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:40:0) after 7m42s
[11:10:59.835] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:40:0)
[11:10:59.852] Build status: STARTED
[11:10:59.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:41:0) after 5m28s
[11:16:27.893] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:41:0)
[11:16:27.910] Build status: STARTED
[11:16:27.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:42:0) after 7m56s
[11:24:23.971] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:42:0)
[11:24:23.987] Build status: STARTED
[11:24:23.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:43:0) after 4m13s
[11:28:37.056] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:43:0)
[11:28:37.078] Build status: STARTED
[11:28:37.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:44:0) after 6m15s
[11:34:52.086] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:44:0)
[11:34:52.099] Build status: STARTED
[11:34:52.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:45:0) after 6m35s
[11:41:27.207] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:45:0)
[11:41:27.224] Build status: STARTED
[11:41:27.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:46:0) after 7m9s
[11:48:36.495] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:46:0)
[11:48:36.510] Build status: STARTED
[11:48:36.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:47:0) after 8m30s
[11:57:06.490] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:47:0)
[11:57:06.504] Build status: STARTED
[11:57:06.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:48:0) after 1m32s
[11:58:38.531] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:48:0)
[11:58:38.548] Build status: STARTED
[11:58:38.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:49:0) after 3m35s
[12:02:13.572] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:49:0)
[12:02:13.658] Build status: STARTED
[12:02:13.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:50:0) after 3m12s
[12:05:25.838] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:50:0)
[12:05:25.854] Build status: STARTED
[12:05:25.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:51:0) after 2m13s
[12:07:39.004] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:51:0)
[12:07:39.020] Build status: STARTED
[12:07:39.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:52:0) after 7m28s
[12:15:07.473] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:52:0)
[12:15:07.490] Build status: STARTED
[12:15:07.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:53:0) after 2m41s
[12:17:48.516] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:53:0)
[12:17:48.530] Build status: STARTED
[12:17:48.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:54:0) after 1m43s
[12:19:31.983] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:54:0)
[12:19:32.005] Build status: STARTED
[12:19:32.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:55:0) after 2m54s
[12:22:26.012] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:55:0)
[12:22:26.108] Build status: STARTED
[12:22:26.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:56:0) after 3m43s
[12:26:09.419] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:56:0)
[12:26:09.441] Build status: STARTED
[12:26:09.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:57:0) after 2m50s
[12:28:59.461] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:57:0)
[12:28:59.475] Build status: STARTED
[12:28:59.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:58:0) after 6m30s
[12:35:29.777] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:58:0)
[12:35:29.793] Build status: STARTED
[12:35:29.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:59:0) after 4m30s
[12:39:59.903] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:59:0)
[12:39:59.918] Build status: STARTED
[12:39:59.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:60:0) after 8m53s
[12:48:53.318] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:60:0)
[12:48:53.332] Build status: STARTED
[12:48:53.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:61:0) after 4m30s
[12:53:23.415] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:61:0)
[12:53:23.430] Build status: STARTED
[12:53:23.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8887319850764867456:62:0) after 5m45s
[12:58:08.336] Received PubSub notification, asking Buildbucket for the build status
[12:58:08.354] Build:
{
"id": "8721889788750134929",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 26384,
"createdBy": "project:chromium",
"createTime": "2025-02-26T07:25:40.151466633Z",
"startTime": "2025-02-26T07:26:49.952258439Z",
"endTime": "2025-02-26T12:58:07.425264893Z",
"updateTime": "2025-02-26T12:58:07.425264893Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f84af0f0ec6e18e8eb205acf1e5fc1f970d7db48",
"ref": "refs/heads/main"
}
}
}
[12:58:08.354] Invocation finished in 5h32m29.507575131s with status FAILED