[08:13:23.498] New invocation is queued and will start shortly
[08:13:24.540] Starting the invocation (attempt 1)
[08:13:24.568] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a4fc928704aefc15fd83fb5544af3971fd2b6d1f"
[08:13:24.568] Popped gitiles commit info from properties and tags
[08:13:24.568] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:13:24.569] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:13:24.569] Buildbucket request:
{
"requestId": "8910872058232946448",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a4fc928704aefc15fd83fb5544af3971fd2b6d1f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8910872058232946448"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:13:25.430] Scheduled build:
{
"id": "8745441996390649585",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 23536,
"createdBy": "project:chromium",
"createTime": "2024-06-11T08:13:24.629979911Z",
"updateTime": "2024-06-11T08:13:24.629979911Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a4fc928704aefc15fd83fb5544af3971fd2b6d1f",
"ref": "refs/heads/main"
}
}
}
[08:13:25.430] Task URL: https://cr-buildbucket.appspot.com/build/8745441996390649585
[08:13:25.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:2:0) after 2m52s
[08:13:26.195] Received PubSub notification, asking Buildbucket for the build status
[08:13:26.252] Build status: SCHEDULED
[08:15:10.218] Received PubSub notification, asking Buildbucket for the build status
[08:15:10.243] Build status: STARTED
[08:16:17.450] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:2:0)
[08:16:17.475] Build status: STARTED
[08:16:17.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:5:0) after 1m31s
[08:17:48.496] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:5:0)
[08:17:48.533] Build status: STARTED
[08:17:48.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:6:0) after 9m44s
[08:27:32.886] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:6:0)
[08:27:32.945] Build status: STARTED
[08:27:32.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:7:0) after 2m31s
[08:30:03.964] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:7:0)
[08:30:03.991] Build status: STARTED
[08:30:03.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:8:0) after 8m12s
[08:38:16.114] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:8:0)
[08:38:16.145] Build status: STARTED
[08:38:16.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:9:0) after 5m0s
[08:43:16.166] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:9:0)
[08:43:16.204] Build status: STARTED
[08:43:16.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:10:0) after 5m10s
[08:48:26.225] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:10:0)
[08:48:26.246] Build status: STARTED
[08:48:26.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:11:0) after 4m31s
[08:52:57.525] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:11:0)
[08:52:57.607] Build status: STARTED
[08:52:57.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:12:0) after 9m50s
[09:02:47.625] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:12:0)
[09:02:47.652] Build status: STARTED
[09:02:47.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:13:0) after 9m19s
[09:12:06.673] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:13:0)
[09:12:06.726] Build status: STARTED
[09:12:06.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:14:0) after 5m54s
[09:18:00.795] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:14:0)
[09:18:00.815] Build status: STARTED
[09:18:00.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:15:0) after 4m15s
[09:22:15.833] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:15:0)
[09:22:15.872] Build status: STARTED
[09:22:15.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:16:0) after 1m28s
[09:23:43.891] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:16:0)
[09:23:43.909] Build status: STARTED
[09:23:43.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:17:0) after 3m53s
[09:27:37.114] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:17:0)
[09:27:37.130] Build status: STARTED
[09:27:37.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:18:0) after 8m44s
[09:36:21.204] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:18:0)
[09:36:21.224] Build status: STARTED
[09:36:21.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:19:0) after 3m58s
[09:40:19.243] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:19:0)
[09:40:19.303] Build status: STARTED
[09:40:19.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:20:0) after 3m17s
[09:43:36.439] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:20:0)
[09:43:36.465] Build status: STARTED
[09:43:36.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:21:0) after 2m3s
[09:45:39.489] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:21:0)
[09:45:39.513] Build status: STARTED
[09:45:39.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:22:0) after 5m21s
[09:51:00.690] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:22:0)
[09:51:00.828] Build status: STARTED
[09:51:00.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:23:0) after 7m45s
[09:58:45.863] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:23:0)
[09:58:45.888] Build status: STARTED
[09:58:45.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:24:0) after 7m8s
[10:05:53.909] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:24:0)
[10:05:53.931] Build status: STARTED
[10:05:53.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:25:0) after 2m29s
[10:08:23.011] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:25:0)
[10:08:23.033] Build status: STARTED
[10:08:23.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:26:0) after 7m33s
[10:15:56.140] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:26:0)
[10:15:56.161] Build status: STARTED
[10:15:56.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:27:0) after 9m25s
[10:25:21.293] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:27:0)
[10:25:21.309] Build status: STARTED
[10:25:21.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:28:0) after 6m42s
[10:32:03.329] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:28:0)
[10:32:03.367] Build status: STARTED
[10:32:03.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:29:0) after 5m37s
[10:37:40.714] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:29:0)
[10:37:40.734] Build status: STARTED
[10:37:40.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:30:0) after 5m51s
[10:43:32.014] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:30:0)
[10:43:32.032] Build status: STARTED
[10:43:32.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:31:0) after 4m51s
[10:48:23.494] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:31:0)
[10:48:23.530] Build status: STARTED
[10:48:23.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:32:0) after 1m18s
[10:49:41.548] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:32:0)
[10:49:41.567] Build status: STARTED
[10:49:41.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:33:0) after 7m38s
[10:57:19.657] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:33:0)
[10:57:19.679] Build status: STARTED
[10:57:19.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:34:0) after 6m47s
[11:04:06.712] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:34:0)
[11:04:06.731] Build status: STARTED
[11:04:06.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:35:0) after 6m36s
[11:10:42.782] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:35:0)
[11:10:42.817] Build status: STARTED
[11:10:42.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:36:0) after 3m37s
[11:14:19.853] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:36:0)
[11:14:19.874] Build status: STARTED
[11:14:19.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:37:0) after 5m48s
[11:20:07.904] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:37:0)
[11:20:07.925] Build status: STARTED
[11:20:07.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:38:0) after 3m34s
[11:23:42.093] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:38:0)
[11:23:42.129] Build status: STARTED
[11:23:42.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:39:0) after 5m58s
[11:29:40.155] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:39:0)
[11:29:40.172] Build status: STARTED
[11:29:40.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:40:0) after 8m23s
[11:38:03.180] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:40:0)
[11:38:03.216] Build status: STARTED
[11:38:03.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:41:0) after 3m19s
[11:41:22.290] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:41:0)
[11:41:22.326] Build status: STARTED
[11:41:22.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:42:0) after 5m48s
[11:47:10.410] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:42:0)
[11:47:10.429] Build status: STARTED
[11:47:10.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:43:0) after 6m11s
[11:53:22.013] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:43:0)
[11:53:22.048] Build status: STARTED
[11:53:22.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:44:0) after 8m30s
[12:01:52.143] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:44:0)
[12:01:52.173] Build status: STARTED
[12:01:52.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:45:0) after 6m51s
[12:08:43.194] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:45:0)
[12:08:43.357] Build status: STARTED
[12:08:43.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:46:0) after 7m55s
[12:16:38.382] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:46:0)
[12:16:38.402] Build status: STARTED
[12:16:38.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:47:0) after 5m26s
[12:22:04.419] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:47:0)
[12:22:04.539] Build status: STARTED
[12:22:04.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:48:0) after 7m48s
[12:29:52.719] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:48:0)
[12:29:52.737] Build status: STARTED
[12:29:52.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:49:0) after 8m38s
[12:38:30.905] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:49:0)
[12:38:30.937] Build status: STARTED
[12:38:30.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:50:0) after 2m13s
[12:40:43.958] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:50:0)
[12:40:43.977] Build status: STARTED
[12:40:43.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:51:0) after 3m14s
[12:43:57.997] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:51:0)
[12:43:58.019] Build status: STARTED
[12:43:58.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:52:0) after 9m48s
[12:53:46.059] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:52:0)
[12:53:46.077] Build status: STARTED
[12:53:46.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:53:0) after 4m31s
[12:58:17.095] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:53:0)
[12:58:17.116] Build status: STARTED
[12:58:17.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:54:0) after 5m35s
[13:03:52.158] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:54:0)
[13:03:52.180] Build status: STARTED
[13:03:52.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:55:0) after 2m14s
[13:06:06.236] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:55:0)
[13:06:06.320] Build status: STARTED
[13:06:06.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:56:0) after 1m46s
[13:07:52.423] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:56:0)
[13:07:52.453] Build status: STARTED
[13:07:52.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:57:0) after 4m43s
[13:12:35.473] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:57:0)
[13:12:35.491] Build status: STARTED
[13:12:35.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910872058232946448:58:0) after 9m6s
[13:15:44.100] Received PubSub notification, asking Buildbucket for the build status
[13:15:44.117] Build:
{
"id": "8745441996390649585",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 23536,
"createdBy": "project:chromium",
"createTime": "2024-06-11T08:13:24.629979911Z",
"startTime": "2024-06-11T08:15:09.974529972Z",
"endTime": "2024-06-11T13:15:43.841610935Z",
"updateTime": "2024-06-11T13:15:43.841610935Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a4fc928704aefc15fd83fb5544af3971fd2b6d1f",
"ref": "refs/heads/main"
}
}
}
[13:15:44.118] Invocation finished in 5h2m20.628282967s with status FAILED