[05:00:18.267] New invocation is queued and will start shortly
[05:00:19.411] Starting the invocation (attempt 1)
[05:00:19.443] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f3c2cc0f74d9e2946c4a7a74642b2f010d3dc3d3"
[05:00:19.443] Popped gitiles commit info from properties and tags
[05:00:19.443] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:00:19.443] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:00:19.443] Buildbucket request:
{
"requestId": "8865132738200605536",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f3c2cc0f74d9e2946c4a7a74642b2f010d3dc3d3",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8865132738200605536"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[05:00:20.052] Scheduled build:
{
"id": "8699702676217653201",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 29097,
"createdBy": "project:chromium",
"createTime": "2025-10-29T05:00:19.528992112Z",
"updateTime": "2025-10-29T05:00:19.528992112Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f3c2cc0f74d9e2946c4a7a74642b2f010d3dc3d3",
"ref": "refs/heads/main"
}
}
}
[05:00:20.052] Task URL: https://cr-buildbucket.appspot.com/build/8699702676217653201
[05:00:20.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:2:0) after 1m23s
[05:00:20.982] Received PubSub notification, asking Buildbucket for the build status
[05:00:21.048] Build status: SCHEDULED
[05:00:53.618] Received PubSub notification, asking Buildbucket for the build status
[05:00:53.657] Build status: STARTED
[05:01:43.065] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:2:0)
[05:01:43.111] Build status: STARTED
[05:01:43.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:5:0) after 3m22s
[05:05:05.128] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:5:0)
[05:05:05.146] Build status: STARTED
[05:05:05.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:6:0) after 2m12s
[05:07:17.159] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:6:0)
[05:07:17.263] Build status: STARTED
[05:07:17.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:7:0) after 1m44s
[05:09:01.280] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:7:0)
[05:09:01.302] Build status: STARTED
[05:09:01.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:8:0) after 1m32s
[05:10:33.288] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:8:0)
[05:10:33.314] Build status: STARTED
[05:10:33.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:9:0) after 5m35s
[05:16:08.588] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:9:0)
[05:16:08.660] Build status: STARTED
[05:16:08.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:10:0) after 6m5s
[05:22:13.768] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:10:0)
[05:22:13.802] Build status: STARTED
[05:22:13.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:11:0) after 9m41s
[05:31:54.825] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:11:0)
[05:31:54.861] Build status: STARTED
[05:31:54.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:12:0) after 1m57s
[05:33:51.874] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:12:0)
[05:33:51.902] Build status: STARTED
[05:33:51.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:13:0) after 7m30s
[05:41:21.988] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:13:0)
[05:41:22.225] Build status: STARTED
[05:41:22.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:14:0) after 9m46s
[05:51:08.243] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:14:0)
[05:51:08.266] Build status: STARTED
[05:51:08.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:15:0) after 4m54s
[05:56:02.342] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:15:0)
[05:56:02.414] Build status: STARTED
[05:56:02.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:16:0) after 9m29s
[06:05:31.434] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:16:0)
[06:05:31.461] Build status: STARTED
[06:05:31.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:17:0) after 7m35s
[06:13:06.523] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:17:0)
[06:13:06.545] Build status: STARTED
[06:13:06.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:18:0) after 5m48s
[06:18:54.638] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:18:0)
[06:18:54.661] Build status: STARTED
[06:18:54.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:19:0) after 5m56s
[06:24:50.713] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:19:0)
[06:24:50.728] Build status: STARTED
[06:24:50.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:20:0) after 7m25s
[06:32:15.741] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:20:0)
[06:32:15.755] Build status: STARTED
[06:32:15.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:21:0) after 7m50s
[06:40:05.844] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:21:0)
[06:40:05.944] Build status: STARTED
[06:40:05.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:22:0) after 5m45s
[06:45:51.119] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:22:0)
[06:45:51.138] Build status: STARTED
[06:45:51.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:23:0) after 1m52s
[06:47:43.181] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:23:0)
[06:47:43.197] Build status: STARTED
[06:47:43.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:24:0) after 8m25s
[06:56:08.217] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:24:0)
[06:56:08.236] Build status: STARTED
[06:56:08.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:25:0) after 5m3s
[07:01:11.441] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:25:0)
[07:01:11.455] Build status: STARTED
[07:01:11.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:26:0) after 3m49s
[07:05:00.470] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:26:0)
[07:05:00.490] Build status: STARTED
[07:05:00.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:27:0) after 9m56s
[07:14:56.558] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:27:0)
[07:14:56.575] Build status: STARTED
[07:14:56.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:28:0) after 7m29s
[07:22:25.915] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:28:0)
[07:22:25.943] Build status: STARTED
[07:22:25.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:29:0) after 3m3s
[07:25:28.970] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:29:0)
[07:25:28.988] Build status: STARTED
[07:25:28.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:30:0) after 1m39s
[07:27:08.029] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:30:0)
[07:27:08.052] Build status: STARTED
[07:27:08.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:31:0) after 4m23s
[07:31:31.081] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:31:0)
[07:31:31.128] Build status: STARTED
[07:31:31.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:32:0) after 4m11s
[07:35:42.244] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:32:0)
[07:35:42.288] Build status: STARTED
[07:35:42.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:33:0) after 1m42s
[07:37:24.550] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:33:0)
[07:37:24.567] Build status: STARTED
[07:37:24.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:34:0) after 5m10s
[07:42:34.584] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:34:0)
[07:42:34.607] Build status: STARTED
[07:42:34.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:35:0) after 1m25s
[07:43:59.988] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:35:0)
[07:44:00.018] Build status: STARTED
[07:44:00.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:36:0) after 1m44s
[07:45:43.996] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:36:0)
[07:45:44.013] Build status: STARTED
[07:45:44.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:37:0) after 8m17s
[07:54:01.608] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:37:0)
[07:54:01.622] Build status: STARTED
[07:54:01.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:38:0) after 1m10s
[07:55:11.638] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:38:0)
[07:55:11.658] Build status: STARTED
[07:55:11.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:39:0) after 8m2s
[08:03:13.674] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:39:0)
[08:03:13.694] Build status: STARTED
[08:03:13.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:40:0) after 6m36s
[08:09:49.711] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:40:0)
[08:09:49.726] Build status: STARTED
[08:09:49.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865132738200605536:41:0) after 5m38s
[08:13:04.120] Received PubSub notification, asking Buildbucket for the build status
[08:13:04.160] Build:
{
"id": "8699702676217653201",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 29097,
"createdBy": "project:chromium",
"createTime": "2025-10-29T05:00:19.528992112Z",
"startTime": "2025-10-29T05:00:53.376256829Z",
"endTime": "2025-10-29T08:13:03.855323962Z",
"updateTime": "2025-10-29T08:13:03.855323962Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f3c2cc0f74d9e2946c4a7a74642b2f010d3dc3d3",
"ref": "refs/heads/main"
}
}
}
[08:13:04.160] Invocation finished in 3h12m45.907847873s with status FAILED