[23:26:02.516] New invocation is queued and will start shortly
[23:26:03.700] Starting the invocation (attempt 1)
[23:26:03.732] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/bb418a0f392b90d23ab8fec629f2379b760e4bcc"
[23:26:03.732] Popped gitiles commit info from properties and tags
[23:26:03.732] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:26:03.732] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:26:03.732] Buildbucket request:
{
"requestId": "8865787946941853872",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bb418a0f392b90d23ab8fec629f2379b760e4bcc",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8865787946941853872"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:26:04.277] Scheduled build:
{
"id": "8700357884933309617",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 29075,
"createdBy": "project:chromium",
"createTime": "2025-10-21T23:26:03.804514148Z",
"updateTime": "2025-10-21T23:26:03.804514148Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bb418a0f392b90d23ab8fec629f2379b760e4bcc",
"ref": "refs/heads/main"
}
}
}
[23:26:04.277] Task URL: https://cr-buildbucket.appspot.com/build/8700357884933309617
[23:26:04.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:2:0) after 3m38s
[23:26:05.289] Received PubSub notification, asking Buildbucket for the build status
[23:26:05.309] Build status: SCHEDULED
[23:26:08.733] Received PubSub notification, asking Buildbucket for the build status
[23:26:08.754] Build status: STARTED
[23:29:42.313] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:2:0)
[23:29:42.340] Build status: STARTED
[23:29:42.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:5:0) after 3m44s
[23:33:26.387] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:5:0)
[23:33:26.414] Build status: STARTED
[23:33:26.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:6:0) after 6m43s
[23:40:09.498] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:6:0)
[23:40:09.535] Build status: STARTED
[23:40:09.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:7:0) after 5m25s
[23:45:34.678] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:7:0)
[23:45:34.697] Build status: STARTED
[23:45:34.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:8:0) after 7m50s
[23:53:24.775] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:8:0)
[23:53:24.796] Build status: STARTED
[23:53:24.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:9:0) after 1m45s
[23:55:09.828] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:9:0)
[23:55:09.845] Build status: STARTED
[23:55:09.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:10:0) after 9m42s
[00:04:51.885] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:10:0)
[00:04:51.907] Build status: STARTED
[00:04:51.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:11:0) after 7m2s
[00:11:53.974] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:11:0)
[00:11:53.999] Build status: STARTED
[00:11:53.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:12:0) after 3m17s
[00:15:11.075] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:12:0)
[00:15:11.089] Build status: STARTED
[00:15:11.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:13:0) after 1m17s
[00:16:28.122] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:13:0)
[00:16:28.142] Build status: STARTED
[00:16:28.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:14:0) after 8m51s
[00:25:19.190] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:14:0)
[00:25:19.217] Build status: STARTED
[00:25:19.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:15:0) after 2m20s
[00:27:39.335] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:15:0)
[00:27:39.353] Build status: STARTED
[00:27:39.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:16:0) after 9m43s
[00:37:22.478] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:16:0)
[00:37:22.498] Build status: STARTED
[00:37:22.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:17:0) after 4m27s
[00:41:49.522] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:17:0)
[00:41:49.547] Build status: STARTED
[00:41:49.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:18:0) after 9m39s
[00:51:28.747] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:18:0)
[00:51:28.821] Build status: STARTED
[00:51:28.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:19:0) after 7m43s
[00:59:11.879] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:19:0)
[00:59:11.903] Build status: STARTED
[00:59:11.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:20:0) after 9m56s
[01:09:07.997] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:20:0)
[01:09:08.027] Build status: STARTED
[01:09:08.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:21:0) after 3m5s
[01:12:13.155] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:21:0)
[01:12:13.174] Build status: STARTED
[01:12:13.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:22:0) after 2m41s
[01:14:54.203] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:22:0)
[01:14:54.224] Build status: STARTED
[01:14:54.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:23:0) after 2m18s
[01:17:12.248] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:23:0)
[01:17:12.287] Build status: STARTED
[01:17:12.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:24:0) after 3m27s
[01:20:39.328] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:24:0)
[01:20:39.345] Build status: STARTED
[01:20:39.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:25:0) after 6m55s
[01:27:34.400] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:25:0)
[01:27:34.419] Build status: STARTED
[01:27:34.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:26:0) after 9m9s
[01:36:43.407] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:26:0)
[01:36:43.420] Build status: STARTED
[01:36:43.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:27:0) after 8m45s
[01:45:28.497] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:27:0)
[01:45:28.520] Build status: STARTED
[01:45:28.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:28:0) after 3m4s
[01:48:32.593] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:28:0)
[01:48:32.611] Build status: STARTED
[01:48:32.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:29:0) after 1m42s
[01:50:14.633] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:29:0)
[01:50:14.746] Build status: STARTED
[01:50:14.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:30:0) after 8m51s
[01:59:05.773] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:30:0)
[01:59:05.802] Build status: STARTED
[01:59:05.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:31:0) after 7m30s
[02:06:35.828] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:31:0)
[02:06:35.849] Build status: STARTED
[02:06:35.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:32:0) after 1m42s
[02:08:17.872] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:32:0)
[02:08:17.934] Build status: STARTED
[02:08:17.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:33:0) after 5m7s
[02:13:24.962] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:33:0)
[02:13:24.979] Build status: STARTED
[02:13:24.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:34:0) after 7m9s
[02:20:34.018] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:34:0)
[02:20:34.034] Build status: STARTED
[02:20:34.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:35:0) after 2m35s
[02:23:09.061] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:35:0)
[02:23:09.076] Build status: STARTED
[02:23:09.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:36:0) after 6m1s
[02:29:10.208] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:36:0)
[02:29:10.236] Build status: STARTED
[02:29:10.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:37:0) after 8m34s
[02:37:44.260] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:37:0)
[02:37:44.275] Build status: STARTED
[02:37:44.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:38:0) after 5m20s
[02:43:04.268] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:38:0)
[02:43:04.286] Build status: STARTED
[02:43:04.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:39:0) after 8m52s
[02:51:56.837] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:39:0)
[02:51:56.853] Build status: STARTED
[02:51:56.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:40:0) after 5m2s
[02:56:58.927] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:40:0)
[02:56:58.945] Build status: STARTED
[02:56:58.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:41:0) after 2m8s
[02:59:07.044] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:41:0)
[02:59:07.059] Build status: STARTED
[02:59:07.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:42:0) after 8m35s
[03:07:42.174] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:42:0)
[03:07:42.247] Build status: STARTED
[03:07:42.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:43:0) after 2m22s
[03:10:04.280] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:43:0)
[03:10:04.299] Build status: STARTED
[03:10:04.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:44:0) after 2m52s
[03:12:56.455] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:44:0)
[03:12:56.481] Build status: STARTED
[03:12:56.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:45:0) after 4m39s
[03:17:35.557] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:45:0)
[03:17:35.574] Build status: STARTED
[03:17:35.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:46:0) after 5m54s
[03:23:29.624] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:46:0)
[03:23:29.646] Build status: STARTED
[03:23:29.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:47:0) after 7m39s
[03:31:08.751] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:47:0)
[03:31:08.827] Build status: STARTED
[03:31:08.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:48:0) after 7m14s
[03:38:22.905] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:48:0)
[03:38:22.932] Build status: STARTED
[03:38:22.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:49:0) after 6m0s
[03:44:23.098] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:49:0)
[03:44:23.734] Build status: STARTED
[03:44:23.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:50:0) after 2m6s
[03:46:29.758] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:50:0)
[03:46:29.773] Build status: STARTED
[03:46:29.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:51:0) after 7m10s
[03:53:39.852] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:51:0)
[03:53:39.865] Build status: STARTED
[03:53:39.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:52:0) after 9m32s
[04:03:11.892] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:52:0)
[04:03:11.911] Build status: STARTED
[04:03:11.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:53:0) after 3m59s
[04:07:10.982] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:53:0)
[04:07:11.001] Build status: STARTED
[04:07:11.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:54:0) after 7m5s
[04:14:16.080] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:54:0)
[04:14:16.150] Build status: STARTED
[04:14:16.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:55:0) after 2m37s
[04:16:53.292] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:55:0)
[04:16:53.313] Build status: STARTED
[04:16:53.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:56:0) after 8m15s
[04:25:08.345] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:56:0)
[04:25:08.402] Build status: STARTED
[04:25:08.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:57:0) after 1m18s
[04:26:26.584] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:57:0)
[04:26:26.606] Build status: STARTED
[04:26:26.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:58:0) after 6m40s
[04:33:06.725] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:58:0)
[04:33:06.740] Build status: STARTED
[04:33:06.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:59:0) after 9m43s
[04:42:49.770] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:59:0)
[04:42:49.787] Build status: STARTED
[04:42:49.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:60:0) after 6m0s
[04:48:49.765] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:60:0)
[04:48:49.788] Build status: STARTED
[04:48:49.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:61:0) after 1m33s
[04:50:22.810] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:61:0)
[04:50:22.900] Build status: STARTED
[04:50:22.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:62:0) after 4m45s
[04:55:08.030] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:62:0)
[04:55:08.070] Build status: STARTED
[04:55:08.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:63:0) after 4m15s
[04:59:23.100] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:63:0)
[04:59:23.118] Build status: STARTED
[04:59:23.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:64:0) after 9m45s
[05:09:08.098] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:64:0)
[05:09:08.138] Build status: STARTED
[05:09:08.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:65:0) after 6m44s
[05:15:52.162] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:65:0)
[05:15:52.179] Build status: STARTED
[05:15:52.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:66:0) after 4m6s
[05:19:58.171] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:66:0)
[05:19:58.192] Build status: STARTED
[05:19:58.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:67:0) after 5m36s
[05:25:34.223] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:67:0)
[05:25:34.241] Build status: STARTED
[05:25:34.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:68:0) after 6m8s
[05:31:42.389] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:68:0)
[05:31:42.431] Build status: STARTED
[05:31:42.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:69:0) after 9m47s
[05:41:29.457] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:69:0)
[05:41:29.471] Build status: STARTED
[05:41:29.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:70:0) after 1m11s
[05:42:40.510] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:70:0)
[05:42:40.527] Build status: STARTED
[05:42:40.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:71:0) after 8m56s
[05:51:36.546] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:71:0)
[05:51:36.561] Build status: STARTED
[05:51:36.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:72:0) after 2m43s
[05:54:19.793] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:72:0)
[05:54:19.813] Build status: STARTED
[05:54:19.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:73:0) after 8m26s
[06:02:45.867] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:73:0)
[06:02:45.890] Build status: STARTED
[06:02:45.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:74:0) after 7m31s
[06:10:16.924] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:74:0)
[06:10:16.937] Build status: STARTED
[06:10:16.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:75:0) after 2m58s
[06:13:14.975] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:75:0)
[06:13:14.991] Build status: STARTED
[06:13:14.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:76:0) after 6m52s
[06:20:07.012] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:76:0)
[06:20:07.067] Build status: STARTED
[06:20:07.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:77:0) after 2m0s
[06:22:07.098] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:77:0)
[06:22:07.144] Build status: STARTED
[06:22:07.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:78:0) after 4m37s
[06:26:44.167] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:78:0)
[06:26:44.192] Build status: STARTED
[06:26:44.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:79:0) after 1m41s
[06:28:25.227] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:79:0)
[06:28:25.263] Build status: STARTED
[06:28:25.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:80:0) after 6m57s
[06:35:22.290] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:80:0)
[06:35:22.302] Build status: STARTED
[06:35:22.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:81:0) after 2m10s
[06:37:32.328] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:81:0)
[06:37:32.346] Build status: STARTED
[06:37:32.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:82:0) after 5m53s
[06:43:25.343] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:82:0)
[06:43:25.358] Build status: STARTED
[06:43:25.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:83:0) after 1m11s
[06:44:36.382] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:83:0)
[06:44:36.401] Build status: STARTED
[06:44:36.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:84:0) after 8m13s
[06:52:49.423] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:84:0)
[06:52:49.437] Build status: STARTED
[06:52:49.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:85:0) after 5m11s
[06:58:00.469] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:85:0)
[06:58:00.488] Build status: STARTED
[06:58:00.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:86:0) after 1m32s
[06:59:32.473] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:86:0)
[06:59:32.491] Build status: STARTED
[06:59:32.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:87:0) after 8m31s
[07:08:03.569] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:87:0)
[07:08:03.656] Build status: STARTED
[07:08:03.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:88:0) after 5m39s
[07:13:42.680] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:88:0)
[07:13:42.698] Build status: STARTED
[07:13:42.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:89:0) after 5m33s
[07:19:15.733] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:89:0)
[07:19:15.752] Build status: STARTED
[07:19:15.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:90:0) after 5m37s
[07:24:52.776] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:90:0)
[07:24:52.794] Build status: STARTED
[07:24:52.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:91:0) after 9m25s
[07:34:17.892] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:91:0)
[07:34:17.906] Build status: STARTED
[07:34:17.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:92:0) after 3m19s
[07:37:36.934] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:92:0)
[07:37:36.950] Build status: STARTED
[07:37:36.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:93:0) after 2m56s
[07:40:33.036] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:93:0)
[07:40:33.050] Build status: STARTED
[07:40:33.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:94:0) after 3m26s
[07:43:59.134] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:94:0)
[07:43:59.163] Build status: STARTED
[07:43:59.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:95:0) after 8m47s
[07:52:46.194] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:95:0)
[07:52:46.226] Build status: STARTED
[07:52:46.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:96:0) after 4m28s
[07:57:14.264] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:96:0)
[07:57:14.295] Build status: STARTED
[07:57:14.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:97:0) after 6m6s
[08:03:20.396] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:97:0)
[08:03:20.413] Build status: STARTED
[08:03:20.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:98:0) after 3m56s
[08:07:16.456] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:98:0)
[08:07:16.526] Build status: STARTED
[08:07:16.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:99:0) after 4m56s
[08:12:12.553] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:99:0)
[08:12:12.573] Build status: STARTED
[08:12:12.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:100:0) after 6m18s
[08:18:30.661] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:100:0)
[08:18:30.694] Build status: STARTED
[08:18:30.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:101:0) after 8m18s
[08:26:48.783] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:101:0)
[08:26:48.857] Build status: STARTED
[08:26:48.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:102:0) after 4m51s
[08:31:39.882] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:102:0)
[08:31:39.906] Build status: STARTED
[08:31:39.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:103:0) after 2m38s
[08:34:17.937] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:103:0)
[08:34:17.952] Build status: STARTED
[08:34:17.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:104:0) after 2m25s
[08:36:43.122] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:104:0)
[08:36:43.143] Build status: STARTED
[08:36:43.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:105:0) after 3m1s
[08:39:44.165] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:105:0)
[08:39:44.236] Build status: STARTED
[08:39:44.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:106:0) after 2m25s
[08:42:09.378] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:106:0)
[08:42:09.394] Build status: STARTED
[08:42:09.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:107:0) after 5m52s
[08:48:01.514] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:107:0)
[08:48:01.537] Build status: STARTED
[08:48:01.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:108:0) after 5m1s
[08:53:02.611] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:108:0)
[08:53:02.623] Build status: STARTED
[08:53:02.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:109:0) after 1m22s
[08:54:24.649] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:109:0)
[08:54:24.669] Build status: STARTED
[08:54:24.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:110:0) after 1m30s
[08:55:54.765] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:110:0)
[08:55:54.831] Build status: STARTED
[08:55:54.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:111:0) after 5m22s
[09:01:16.858] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:111:0)
[09:01:16.882] Build status: STARTED
[09:01:16.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:112:0) after 2m41s
[09:03:57.910] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:112:0)
[09:03:57.952] Build status: STARTED
[09:03:57.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:113:0) after 2m24s
[09:06:22.057] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:113:0)
[09:06:22.076] Build status: STARTED
[09:06:22.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:114:0) after 7m0s
[09:13:22.102] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:114:0)
[09:13:22.119] Build status: STARTED
[09:13:22.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:115:0) after 1m28s
[09:14:50.200] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:115:0)
[09:14:50.234] Build status: STARTED
[09:14:50.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:116:0) after 5m26s
[09:20:16.280] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:116:0)
[09:20:16.297] Build status: STARTED
[09:20:16.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:117:0) after 3m8s
[09:23:24.424] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:117:0)
[09:23:24.452] Build status: STARTED
[09:23:24.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8865787946941853872:118:0) after 4m44s
[09:25:23.410] Received PubSub notification, asking Buildbucket for the build status
[09:25:23.430] Build:
{
"id": "8700357884933309617",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 29075,
"createdBy": "project:chromium",
"createTime": "2025-10-21T23:26:03.804514148Z",
"startTime": "2025-10-21T23:26:08.421489515Z",
"endTime": "2025-10-22T09:25:23.030963418Z",
"updateTime": "2025-10-22T09:25:23.030963418Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bb418a0f392b90d23ab8fec629f2379b760e4bcc",
"ref": "refs/heads/main"
}
}
}
[09:25:23.430] Invocation finished in 9h59m20.925369342s with status FAILED