[01:19:32.999] New invocation is queued and will start shortly
[01:19:34.233] Starting the invocation (attempt 1)
[01:19:34.254] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f3d997201047d5f486faac5fc8b7bcdb8c7cd244"
[01:19:34.254] Popped gitiles commit info from properties and tags
[01:19:34.254] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:19:34.255] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:19:34.255] Buildbucket request:
{
"requestId": "8874840502270358224",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f3d997201047d5f486faac5fc8b7bcdb8c7cd244",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8874840502270358224"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:19:34.742] Scheduled build:
{
"id": "8709410440246900737",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 27810,
"createdBy": "project:chromium",
"createTime": "2025-07-14T01:19:34.304787357Z",
"updateTime": "2025-07-14T01:19:34.304787357Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f3d997201047d5f486faac5fc8b7bcdb8c7cd244",
"ref": "refs/heads/main"
}
}
}
[01:19:34.742] Task URL: https://cr-buildbucket.appspot.com/build/8709410440246900737
[01:19:34.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:2:0) after 2m10s
[01:19:34.833] Received PubSub notification, asking Buildbucket for the build status
[01:19:34.869] Build status: SCHEDULED
[01:20:46.557] Received PubSub notification, asking Buildbucket for the build status
[01:20:46.589] Build status: STARTED
[01:21:45.134] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:2:0)
[01:21:45.168] Build status: STARTED
[01:21:45.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:5:0) after 6m54s
[01:28:39.238] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:5:0)
[01:28:39.321] Build status: STARTED
[01:28:39.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:6:0) after 5m30s
[01:34:09.350] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:6:0)
[01:34:09.372] Build status: STARTED
[01:34:09.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:7:0) after 4m38s
[01:38:47.393] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:7:0)
[01:38:47.413] Build status: STARTED
[01:38:47.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:8:0) after 6m34s
[01:45:21.544] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:8:0)
[01:45:21.572] Build status: STARTED
[01:45:21.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:9:0) after 6m31s
[01:51:52.558] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:9:0)
[01:51:52.604] Build status: STARTED
[01:51:52.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:10:0) after 4m49s
[01:56:41.593] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:10:0)
[01:56:41.623] Build status: STARTED
[01:56:41.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:11:0) after 1m20s
[01:58:01.771] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:11:0)
[01:58:01.788] Build status: STARTED
[01:58:01.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:12:0) after 6m31s
[02:04:32.820] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:12:0)
[02:04:32.851] Build status: STARTED
[02:04:32.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:13:0) after 9m32s
[02:14:04.869] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:13:0)
[02:14:04.921] Build status: STARTED
[02:14:04.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:14:0) after 5m37s
[02:19:41.998] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:14:0)
[02:19:42.021] Build status: STARTED
[02:19:42.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:15:0) after 3m54s
[02:23:36.204] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:15:0)
[02:23:36.346] Build status: STARTED
[02:23:36.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:16:0) after 1m28s
[02:25:04.372] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:16:0)
[02:25:04.399] Build status: STARTED
[02:25:04.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:17:0) after 8m34s
[02:33:39.500] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:17:0)
[02:33:39.516] Build status: STARTED
[02:33:39.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:18:0) after 9m51s
[02:43:30.584] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:18:0)
[02:43:30.607] Build status: STARTED
[02:43:30.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:19:0) after 3m8s
[02:46:38.629] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:19:0)
[02:46:38.645] Build status: STARTED
[02:46:38.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:20:0) after 5m35s
[02:52:13.683] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:20:0)
[02:52:13.759] Build status: STARTED
[02:52:13.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:21:0) after 5m18s
[02:57:31.981] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:21:0)
[02:57:32.000] Build status: STARTED
[02:57:32.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:22:0) after 9m51s
[03:07:23.240] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:22:0)
[03:07:23.262] Build status: STARTED
[03:07:23.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:23:0) after 2m42s
[03:10:05.372] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:23:0)
[03:10:05.393] Build status: STARTED
[03:10:05.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:24:0) after 8m57s
[03:19:02.419] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:24:0)
[03:19:02.437] Build status: STARTED
[03:19:02.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:25:0) after 8m44s
[03:27:46.500] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:25:0)
[03:27:46.539] Build status: STARTED
[03:27:46.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:26:0) after 5m47s
[03:33:33.615] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:26:0)
[03:33:33.630] Build status: STARTED
[03:33:33.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:27:0) after 8m17s
[03:41:50.650] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:27:0)
[03:41:50.666] Build status: STARTED
[03:41:50.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:28:0) after 7m0s
[03:48:50.861] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:28:0)
[03:48:50.882] Build status: STARTED
[03:48:50.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:29:0) after 2m59s
[03:51:50.063] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:29:0)
[03:51:50.087] Build status: STARTED
[03:51:50.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:30:0) after 6m2s
[03:57:52.110] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:30:0)
[03:57:52.135] Build status: STARTED
[03:57:52.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:31:0) after 8m39s
[04:06:31.213] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:31:0)
[04:06:31.236] Build status: STARTED
[04:06:31.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:32:0) after 5m5s
[04:11:36.288] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:32:0)
[04:11:36.309] Build status: STARTED
[04:11:36.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:33:0) after 4m50s
[04:16:26.346] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:33:0)
[04:16:26.406] Build status: STARTED
[04:16:26.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:34:0) after 3m41s
[04:20:07.428] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:34:0)
[04:20:07.476] Build status: STARTED
[04:20:07.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:35:0) after 5m30s
[04:25:37.501] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:35:0)
[04:25:37.518] Build status: STARTED
[04:25:37.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:36:0) after 8m39s
[04:34:16.542] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:36:0)
[04:34:16.561] Build status: STARTED
[04:34:16.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:37:0) after 3m10s
[04:37:26.583] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:37:0)
[04:37:26.598] Build status: STARTED
[04:37:26.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:38:0) after 3m41s
[04:41:07.728] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:38:0)
[04:41:07.747] Build status: STARTED
[04:41:07.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:39:0) after 8m48s
[04:49:55.865] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:39:0)
[04:49:55.882] Build status: STARTED
[04:49:55.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:40:0) after 2m23s
[04:52:19.139] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:40:0)
[04:52:19.164] Build status: STARTED
[04:52:19.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:41:0) after 4m38s
[04:56:57.273] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:41:0)
[04:56:57.321] Build status: STARTED
[04:56:57.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:42:0) after 1m43s
[04:58:40.338] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:42:0)
[04:58:40.355] Build status: STARTED
[04:58:40.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:43:0) after 2m59s
[05:01:39.375] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:43:0)
[05:01:39.391] Build status: STARTED
[05:01:39.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:44:0) after 3m43s
[05:05:22.445] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:44:0)
[05:05:22.464] Build status: STARTED
[05:05:22.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:45:0) after 1m19s
[05:06:41.717] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:45:0)
[05:06:41.748] Build status: STARTED
[05:06:41.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:46:0) after 2m10s
[05:08:51.868] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:46:0)
[05:08:51.910] Build status: STARTED
[05:08:51.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:47:0) after 5m7s
[05:13:59.029] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:47:0)
[05:13:59.060] Build status: STARTED
[05:13:59.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:48:0) after 5m55s
[05:19:54.265] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:48:0)
[05:19:54.312] Build status: STARTED
[05:19:54.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:49:0) after 8m41s
[05:28:35.453] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:49:0)
[05:28:35.491] Build status: STARTED
[05:28:35.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:50:0) after 5m25s
[05:34:00.549] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:50:0)
[05:34:00.656] Build status: STARTED
[05:34:00.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:51:0) after 7m46s
[05:41:46.679] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:51:0)
[05:41:46.694] Build status: STARTED
[05:41:46.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:52:0) after 3m50s
[05:45:37.048] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:52:0)
[05:45:37.085] Build status: STARTED
[05:45:37.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:53:0) after 1m43s
[05:47:20.111] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:53:0)
[05:47:20.351] Build status: STARTED
[05:47:20.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:54:0) after 6m32s
[05:53:52.460] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:54:0)
[05:53:52.476] Build status: STARTED
[05:53:52.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:55:0) after 4m7s
[05:57:59.678] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:55:0)
[05:57:59.695] Build status: STARTED
[05:57:59.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:56:0) after 5m10s
[06:03:09.792] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:56:0)
[06:03:09.816] Build status: STARTED
[06:03:09.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:57:0) after 5m17s
[06:08:26.931] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:57:0)
[06:08:26.956] Build status: STARTED
[06:08:26.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:58:0) after 8m39s
[06:17:06.003] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:58:0)
[06:17:06.122] Build status: STARTED
[06:17:06.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:59:0) after 4m14s
[06:21:20.153] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:59:0)
[06:21:20.172] Build status: STARTED
[06:21:20.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:60:0) after 3m38s
[06:24:58.196] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:60:0)
[06:24:58.221] Build status: STARTED
[06:24:58.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:61:0) after 5m38s
[06:30:36.273] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:61:0)
[06:30:36.310] Build status: STARTED
[06:30:36.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:62:0) after 6m16s
[06:36:52.338] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:62:0)
[06:36:52.364] Build status: STARTED
[06:36:52.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:63:0) after 7m8s
[06:44:00.449] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:63:0)
[06:44:00.471] Build status: STARTED
[06:44:00.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:64:0) after 7m30s
[06:51:30.550] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:64:0)
[06:51:30.564] Build status: STARTED
[06:51:30.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:65:0) after 2m32s
[06:54:02.644] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:65:0)
[06:54:02.694] Build status: STARTED
[06:54:02.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:66:0) after 3m7s
[06:57:09.700] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:66:0)
[06:57:09.718] Build status: STARTED
[06:57:09.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:67:0) after 4m34s
[07:01:43.747] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:67:0)
[07:01:43.764] Build status: STARTED
[07:01:43.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:68:0) after 5m48s
[07:07:31.842] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:68:0)
[07:07:31.868] Build status: STARTED
[07:07:31.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:69:0) after 5m41s
[07:13:12.961] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:69:0)
[07:13:13.009] Build status: STARTED
[07:13:13.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:70:0) after 1m40s
[07:14:53.028] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:70:0)
[07:14:53.044] Build status: STARTED
[07:14:53.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:71:0) after 8m11s
[07:23:04.048] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:71:0)
[07:23:04.077] Build status: STARTED
[07:23:04.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:72:0) after 6m20s
[07:29:24.280] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:72:0)
[07:29:24.301] Build status: STARTED
[07:29:24.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:73:0) after 2m26s
[07:31:50.575] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:73:0)
[07:31:50.637] Build status: STARTED
[07:31:50.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:74:0) after 9m18s
[07:41:09.044] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:74:0)
[07:41:09.076] Build status: STARTED
[07:41:09.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:75:0) after 1m29s
[07:42:38.183] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:75:0)
[07:42:38.207] Build status: STARTED
[07:42:38.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:76:0) after 2m55s
[07:45:33.403] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:76:0)
[07:45:33.453] Build status: STARTED
[07:45:33.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:77:0) after 5m39s
[07:51:12.468] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:77:0)
[07:51:12.485] Build status: STARTED
[07:51:12.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:78:0) after 3m56s
[07:55:08.744] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:78:0)
[07:55:08.773] Build status: STARTED
[07:55:08.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:79:0) after 8m24s
[08:03:32.865] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:79:0)
[08:03:32.885] Build status: STARTED
[08:03:32.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:80:0) after 8m26s
[08:11:58.908] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:80:0)
[08:11:58.926] Build status: STARTED
[08:11:58.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:81:0) after 1m17s
[08:13:15.944] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:81:0)
[08:13:15.961] Build status: STARTED
[08:13:15.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:82:0) after 3m38s
[08:16:53.969] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:82:0)
[08:16:53.992] Build status: STARTED
[08:16:53.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:83:0) after 1m55s
[08:18:49.013] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:83:0)
[08:18:49.031] Build status: STARTED
[08:18:49.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:84:0) after 3m0s
[08:21:49.073] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:84:0)
[08:21:49.092] Build status: STARTED
[08:21:49.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:85:0) after 9m34s
[08:31:23.131] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:85:0)
[08:31:23.155] Build status: STARTED
[08:31:23.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:86:0) after 2m20s
[08:33:43.319] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:86:0)
[08:33:43.344] Build status: STARTED
[08:33:43.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:87:0) after 8m8s
[08:41:51.485] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:87:0)
[08:41:51.502] Build status: STARTED
[08:41:51.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:88:0) after 6m15s
[08:48:06.593] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:88:0)
[08:48:06.609] Build status: STARTED
[08:48:06.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:89:0) after 7m7s
[08:55:13.700] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:89:0)
[08:55:13.722] Build status: STARTED
[08:55:13.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:90:0) after 4m23s
[08:59:36.748] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:90:0)
[08:59:36.777] Build status: STARTED
[08:59:36.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:91:0) after 1m29s
[09:01:05.800] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:91:0)
[09:01:05.823] Build status: STARTED
[09:01:05.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:92:0) after 6m37s
[09:07:42.898] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:92:0)
[09:07:42.915] Build status: STARTED
[09:07:42.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:93:0) after 1m20s
[09:09:02.942] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:93:0)
[09:09:02.968] Build status: STARTED
[09:09:02.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:94:0) after 1m4s
[09:10:07.053] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:94:0)
[09:10:07.094] Build status: STARTED
[09:10:07.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:95:0) after 8m34s
[09:18:41.141] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:95:0)
[09:18:41.184] Build status: STARTED
[09:18:41.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:96:0) after 9m30s
[09:28:11.228] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:96:0)
[09:28:11.250] Build status: STARTED
[09:28:11.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:97:0) after 9m8s
[09:37:19.321] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:97:0)
[09:37:19.343] Build status: STARTED
[09:37:19.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:98:0) after 5m40s
[09:42:59.381] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:98:0)
[09:42:59.400] Build status: STARTED
[09:42:59.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:99:0) after 7m23s
[09:50:22.432] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:99:0)
[09:50:22.505] Build status: STARTED
[09:50:22.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:100:0) after 7m36s
[09:57:58.563] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:100:0)
[09:57:58.577] Build status: STARTED
[09:57:58.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:101:0) after 3m16s
[10:01:14.604] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:101:0)
[10:01:14.623] Build status: STARTED
[10:01:14.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874840502270358224:102:0) after 8m57s
[10:09:19.473] Received PubSub notification, asking Buildbucket for the build status
[10:09:19.489] Build:
{
"id": "8709410440246900737",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 27810,
"createdBy": "project:chromium",
"createTime": "2025-07-14T01:19:34.304787357Z",
"startTime": "2025-07-14T01:20:45.992862905Z",
"endTime": "2025-07-14T10:09:19.187154199Z",
"updateTime": "2025-07-14T10:09:19.187154199Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f3d997201047d5f486faac5fc8b7bcdb8c7cd244",
"ref": "refs/heads/main"
}
}
}
[10:09:19.489] Invocation finished in 8h49m46.499118688s with status FAILED