[05:50:10.614] New invocation is queued and will start shortly
[05:50:11.647] Starting the invocation (attempt 1)
[05:50:11.673] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/667ec11b5789a97e48dea574780c5e5bb823b8e5"
[05:50:11.673] Popped gitiles commit info from properties and tags
[05:50:11.673] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:50:11.674] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:50:11.674] Buildbucket request:
{
"requestId": "8864948406562814096",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "667ec11b5789a97e48dea574780c5e5bb823b8e5",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8864948406562814096"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[05:50:12.366] Scheduled build:
{
"id": "8699518344736750801",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 29110,
"createdBy": "project:chromium",
"createTime": "2025-10-31T05:50:11.727356502Z",
"updateTime": "2025-10-31T05:50:11.727356502Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "667ec11b5789a97e48dea574780c5e5bb823b8e5",
"ref": "refs/heads/main"
}
}
}
[05:50:12.366] Task URL: https://cr-buildbucket.appspot.com/build/8699518344736750801
[05:50:12.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:2:0) after 4m25s
[05:50:13.238] Received PubSub notification, asking Buildbucket for the build status
[05:50:13.253] Build status: SCHEDULED
[05:50:47.853] Received PubSub notification, asking Buildbucket for the build status
[05:50:47.866] Build status: STARTED
[05:54:37.386] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:2:0)
[05:54:37.401] Build status: STARTED
[05:54:37.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:5:0) after 2m43s
[05:57:20.489] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:5:0)
[05:57:20.505] Build status: STARTED
[05:57:20.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:6:0) after 1m27s
[05:58:47.565] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:6:0)
[05:58:47.598] Build status: STARTED
[05:58:47.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:7:0) after 8m14s
[06:07:01.737] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:7:0)
[06:07:01.751] Build status: STARTED
[06:07:01.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:8:0) after 8m55s
[06:15:56.805] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:8:0)
[06:15:56.848] Build status: STARTED
[06:15:56.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:9:0) after 8m18s
[06:24:14.865] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:9:0)
[06:24:14.964] Build status: STARTED
[06:24:14.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:10:0) after 6m15s
[06:30:30.113] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:10:0)
[06:30:30.200] Build status: STARTED
[06:30:30.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:11:0) after 8m6s
[06:38:36.261] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:11:0)
[06:38:36.281] Build status: STARTED
[06:38:36.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:12:0) after 7m10s
[06:45:46.334] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:12:0)
[06:45:46.347] Build status: STARTED
[06:45:46.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:13:0) after 1m39s
[06:47:25.423] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:13:0)
[06:47:25.440] Build status: STARTED
[06:47:25.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:14:0) after 3m2s
[06:50:27.457] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:14:0)
[06:50:27.471] Build status: STARTED
[06:50:27.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:15:0) after 9m39s
[07:00:06.525] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:15:0)
[07:00:06.549] Build status: STARTED
[07:00:06.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:16:0) after 1m30s
[07:01:36.583] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:16:0)
[07:01:36.598] Build status: STARTED
[07:01:36.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:17:0) after 1m16s
[07:02:52.661] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:17:0)
[07:02:52.680] Build status: STARTED
[07:02:52.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:18:0) after 4m4s
[07:06:56.693] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:18:0)
[07:06:56.710] Build status: STARTED
[07:06:56.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:19:0) after 1m35s
[07:08:31.800] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:19:0)
[07:08:31.813] Build status: STARTED
[07:08:31.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:20:0) after 9m47s
[07:18:18.829] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:20:0)
[07:18:18.865] Build status: STARTED
[07:18:18.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:21:0) after 3m41s
[07:21:59.931] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:21:0)
[07:21:59.948] Build status: STARTED
[07:21:59.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:22:0) after 7m20s
[07:29:19.943] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:22:0)
[07:29:19.965] Build status: STARTED
[07:29:19.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:23:0) after 5m13s
[07:34:33.124] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:23:0)
[07:34:33.287] Build status: STARTED
[07:34:33.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:24:0) after 3m9s
[07:37:42.301] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:24:0)
[07:37:42.317] Build status: STARTED
[07:37:42.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:25:0) after 4m40s
[07:42:22.427] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:25:0)
[07:42:22.445] Build status: STARTED
[07:42:22.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:26:0) after 5m3s
[07:47:25.466] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:26:0)
[07:47:25.486] Build status: STARTED
[07:47:25.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:27:0) after 7m39s
[07:55:04.551] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:27:0)
[07:55:04.573] Build status: STARTED
[07:55:04.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:28:0) after 4m9s
[07:59:13.678] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:28:0)
[07:59:13.738] Build status: STARTED
[07:59:13.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:29:0) after 3m53s
[08:03:06.853] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:29:0)
[08:03:06.875] Build status: STARTED
[08:03:06.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:30:0) after 4m30s
[08:07:36.935] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:30:0)
[08:07:36.954] Build status: STARTED
[08:07:36.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:31:0) after 1m25s
[08:09:02.016] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:31:0)
[08:09:02.032] Build status: STARTED
[08:09:02.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:32:0) after 7m58s
[08:17:00.097] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:32:0)
[08:17:00.119] Build status: STARTED
[08:17:00.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:33:0) after 8m14s
[08:25:14.136] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:33:0)
[08:25:14.158] Build status: STARTED
[08:25:14.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:34:0) after 6m38s
[08:31:52.281] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:34:0)
[08:31:52.298] Build status: STARTED
[08:31:52.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:35:0) after 1m40s
[08:33:32.350] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:35:0)
[08:33:32.372] Build status: STARTED
[08:33:32.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:36:0) after 6m42s
[08:40:14.401] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:36:0)
[08:40:14.415] Build status: STARTED
[08:40:14.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:37:0) after 3m23s
[08:43:37.568] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:37:0)
[08:43:37.641] Build status: STARTED
[08:43:37.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:38:0) after 9m12s
[08:52:49.718] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:38:0)
[08:52:49.731] Build status: STARTED
[08:52:49.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:39:0) after 8m40s
[09:01:29.901] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:39:0)
[09:01:29.917] Build status: STARTED
[09:01:29.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:40:0) after 3m26s
[09:04:55.934] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:40:0)
[09:04:55.955] Build status: STARTED
[09:04:55.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:41:0) after 8m18s
[09:13:13.973] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:41:0)
[09:13:13.993] Build status: STARTED
[09:13:13.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8864948406562814096:42:0) after 8m38s
[09:13:44.678] Received PubSub notification, asking Buildbucket for the build status
[09:13:44.742] Build:
{
"id": "8699518344736750801",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 29110,
"createdBy": "project:chromium",
"createTime": "2025-10-31T05:50:11.727356502Z",
"startTime": "2025-10-31T05:50:47.575636507Z",
"endTime": "2025-10-31T09:13:44.444628714Z",
"updateTime": "2025-10-31T09:13:44.444628714Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "667ec11b5789a97e48dea574780c5e5bb823b8e5",
"ref": "refs/heads/main"
}
}
}
[09:13:44.742] Invocation finished in 3h23m34.140391146s with status FAILED