[21:53:00.724] New invocation is queued and will start shortly
[21:53:02.007] Starting the invocation (attempt 1)
[21:53:02.028] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9b48fd0c7048c43e3e1523222b17f1537edb52a3"
[21:53:02.028] Popped gitiles commit info from properties and tags
[21:53:02.028] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:53:02.028] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:53:02.028] Buildbucket request:
{
"requestId": "8876846629772138384",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9b48fd0c7048c43e3e1523222b17f1537edb52a3",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8876846629772138384"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:53:02.847] Scheduled build:
{
"id": "8711416567689528017",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 26099,
"createdBy": "project:chromium",
"createTime": "2025-06-21T21:53:02.086806922Z",
"updateTime": "2025-06-21T21:53:02.086806922Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9b48fd0c7048c43e3e1523222b17f1537edb52a3",
"ref": "refs/heads/main"
}
}
}
[21:53:02.847] Task URL: https://cr-buildbucket.appspot.com/build/8711416567689528017
[21:53:02.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:2:0) after 2m58s
[21:53:03.879] Received PubSub notification, asking Buildbucket for the build status
[21:53:03.910] Build status: SCHEDULED
[21:54:28.489] Received PubSub notification, asking Buildbucket for the build status
[21:54:28.516] Build status: STARTED
[21:56:00.970] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:2:0)
[21:56:00.998] Build status: STARTED
[21:56:00.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:5:0) after 7m59s
[22:04:00.082] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:5:0)
[22:04:00.099] Build status: STARTED
[22:04:00.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:6:0) after 2m24s
[22:06:24.497] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:6:0)
[22:06:24.560] Build status: STARTED
[22:06:24.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:7:0) after 9m59s
[22:16:23.602] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:7:0)
[22:16:23.676] Build status: STARTED
[22:16:23.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:8:0) after 7m23s
[22:23:46.695] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:8:0)
[22:23:46.755] Build status: STARTED
[22:23:46.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:9:0) after 2m53s
[22:26:39.769] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:9:0)
[22:26:39.804] Build status: STARTED
[22:26:39.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:10:0) after 7m11s
[22:33:50.824] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:10:0)
[22:33:50.849] Build status: STARTED
[22:33:50.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:11:0) after 6m24s
[22:40:15.327] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:11:0)
[22:40:15.362] Build status: STARTED
[22:40:15.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:12:0) after 5m54s
[22:46:09.385] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:12:0)
[22:46:09.451] Build status: STARTED
[22:46:09.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:13:0) after 9m21s
[22:55:30.600] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:13:0)
[22:55:30.620] Build status: STARTED
[22:55:30.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:14:0) after 1m39s
[22:57:09.638] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:14:0)
[22:57:09.680] Build status: STARTED
[22:57:09.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:15:0) after 1m8s
[22:58:17.924] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:15:0)
[22:58:17.955] Build status: STARTED
[22:58:17.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:16:0) after 4m12s
[23:02:29.969] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:16:0)
[23:02:29.994] Build status: STARTED
[23:02:29.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:17:0) after 8m4s
[23:10:34.021] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:17:0)
[23:10:34.040] Build status: STARTED
[23:10:34.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:18:0) after 8m36s
[23:19:10.123] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:18:0)
[23:19:10.151] Build status: STARTED
[23:19:10.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:19:0) after 2m42s
[23:21:52.354] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:19:0)
[23:21:52.369] Build status: STARTED
[23:21:52.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:20:0) after 6m50s
[23:28:42.370] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:20:0)
[23:28:42.388] Build status: STARTED
[23:28:42.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:21:0) after 4m29s
[23:33:11.406] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:21:0)
[23:33:11.433] Build status: STARTED
[23:33:11.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:22:0) after 6m12s
[23:39:23.549] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:22:0)
[23:39:23.580] Build status: STARTED
[23:39:23.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:23:0) after 7m1s
[23:46:24.983] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:23:0)
[23:46:25.016] Build status: STARTED
[23:46:25.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:24:0) after 7m53s
[23:54:18.262] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:24:0)
[23:54:18.286] Build status: STARTED
[23:54:18.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:25:0) after 3m32s
[23:57:50.417] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:25:0)
[23:57:50.498] Build status: STARTED
[23:57:50.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:26:0) after 5m35s
[00:03:25.783] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:26:0)
[00:03:25.798] Build status: STARTED
[00:03:25.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:27:0) after 2m1s
[00:05:26.847] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:27:0)
[00:05:26.865] Build status: STARTED
[00:05:26.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:28:0) after 7m37s
[00:13:03.915] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:28:0)
[00:13:03.964] Build status: STARTED
[00:13:03.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:29:0) after 4m44s
[00:17:48.086] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:29:0)
[00:17:48.105] Build status: STARTED
[00:17:48.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:30:0) after 6m19s
[00:24:07.176] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:30:0)
[00:24:07.286] Build status: STARTED
[00:24:07.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:31:0) after 3m52s
[00:27:59.645] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:31:0)
[00:27:59.659] Build status: STARTED
[00:27:59.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:32:0) after 9m43s
[00:37:42.683] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:32:0)
[00:37:42.700] Build status: STARTED
[00:37:42.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:33:0) after 8m4s
[00:45:46.797] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:33:0)
[00:45:46.815] Build status: STARTED
[00:45:46.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:34:0) after 5m45s
[00:51:31.839] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:34:0)
[00:51:31.857] Build status: STARTED
[00:51:31.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:35:0) after 2m58s
[00:54:29.878] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:35:0)
[00:54:29.894] Build status: STARTED
[00:54:29.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:36:0) after 4m0s
[00:58:29.916] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:36:0)
[00:58:29.937] Build status: STARTED
[00:58:29.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:37:0) after 5m30s
[01:04:00.047] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:37:0)
[01:04:00.067] Build status: STARTED
[01:04:00.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:38:0) after 2m34s
[01:06:34.178] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:38:0)
[01:06:34.201] Build status: STARTED
[01:06:34.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:39:0) after 7m33s
[01:14:07.222] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:39:0)
[01:14:07.242] Build status: STARTED
[01:14:07.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:40:0) after 4m30s
[01:18:37.365] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:40:0)
[01:18:37.393] Build status: STARTED
[01:18:37.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:41:0) after 3m59s
[01:22:36.536] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:41:0)
[01:22:36.555] Build status: STARTED
[01:22:36.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:42:0) after 1m34s
[01:24:10.579] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:42:0)
[01:24:10.616] Build status: STARTED
[01:24:10.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:43:0) after 3m8s
[01:27:18.626] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:43:0)
[01:27:18.644] Build status: STARTED
[01:27:18.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:44:0) after 8m1s
[01:35:19.752] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:44:0)
[01:35:19.768] Build status: STARTED
[01:35:19.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:45:0) after 4m44s
[01:40:03.824] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:45:0)
[01:40:03.838] Build status: STARTED
[01:40:03.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:46:0) after 3m51s
[01:43:54.853] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:46:0)
[01:43:54.873] Build status: STARTED
[01:43:54.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:47:0) after 1m27s
[01:45:21.928] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:47:0)
[01:45:21.946] Build status: STARTED
[01:45:21.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:48:0) after 5m38s
[01:50:59.980] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:48:0)
[01:51:00.002] Build status: STARTED
[01:51:00.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:49:0) after 1m42s
[01:52:42.226] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:49:0)
[01:52:42.244] Build status: STARTED
[01:52:42.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:50:0) after 9m53s
[02:02:35.266] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:50:0)
[02:02:35.284] Build status: STARTED
[02:02:35.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:51:0) after 3m52s
[02:06:27.402] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:51:0)
[02:06:27.419] Build status: STARTED
[02:06:27.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:52:0) after 2m33s
[02:09:00.611] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:52:0)
[02:09:00.642] Build status: STARTED
[02:09:00.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:53:0) after 8m49s
[02:17:49.714] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:53:0)
[02:17:49.730] Build status: STARTED
[02:17:49.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:54:0) after 7m38s
[02:25:27.889] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:54:0)
[02:25:27.906] Build status: STARTED
[02:25:27.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:55:0) after 5m28s
[02:30:55.934] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:55:0)
[02:30:55.952] Build status: STARTED
[02:30:55.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:56:0) after 5m37s
[02:36:32.958] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:56:0)
[02:36:32.974] Build status: STARTED
[02:36:32.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:57:0) after 9m27s
[02:45:59.955] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:57:0)
[02:45:59.974] Build status: STARTED
[02:45:59.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:58:0) after 3m23s
[02:49:23.102] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:58:0)
[02:49:23.119] Build status: STARTED
[02:49:23.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:59:0) after 6m19s
[02:55:42.141] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:59:0)
[02:55:42.159] Build status: STARTED
[02:55:42.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:60:0) after 9m21s
[03:05:03.176] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:60:0)
[03:05:03.215] Build status: STARTED
[03:05:03.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:61:0) after 8m5s
[03:13:08.339] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:61:0)
[03:13:08.358] Build status: STARTED
[03:13:08.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:62:0) after 1m11s
[03:14:19.382] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:62:0)
[03:14:19.398] Build status: STARTED
[03:14:19.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:63:0) after 8m46s
[03:23:05.425] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:63:0)
[03:23:05.446] Build status: STARTED
[03:23:05.446] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:64:0) after 9m9s
[03:32:14.861] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:64:0)
[03:32:14.906] Build status: STARTED
[03:32:14.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:65:0) after 1m45s
[03:34:00.066] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:65:0)
[03:34:00.122] Build status: STARTED
[03:34:00.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:66:0) after 1m2s
[03:35:02.245] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:66:0)
[03:35:02.262] Build status: STARTED
[03:35:02.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:67:0) after 2m59s
[03:38:01.277] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:67:0)
[03:38:01.321] Build status: STARTED
[03:38:01.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:68:0) after 7m42s
[03:45:43.344] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:68:0)
[03:45:43.359] Build status: STARTED
[03:45:43.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:69:0) after 7m18s
[03:53:01.520] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:69:0)
[03:53:01.544] Build status: STARTED
[03:53:01.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:70:0) after 7m47s
[04:00:48.561] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:70:0)
[04:00:48.577] Build status: STARTED
[04:00:48.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:71:0) after 1m35s
[04:02:23.620] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:71:0)
[04:02:23.639] Build status: STARTED
[04:02:23.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:72:0) after 5m23s
[04:07:46.762] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:72:0)
[04:07:46.782] Build status: STARTED
[04:07:46.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:73:0) after 5m44s
[04:13:30.813] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:73:0)
[04:13:30.837] Build status: STARTED
[04:13:30.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:74:0) after 6m25s
[04:19:55.893] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:74:0)
[04:19:55.914] Build status: STARTED
[04:19:55.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:75:0) after 6m9s
[04:26:05.032] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:75:0)
[04:26:05.052] Build status: STARTED
[04:26:05.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:76:0) after 5m10s
[04:31:15.158] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:76:0)
[04:31:15.207] Build status: STARTED
[04:31:15.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:77:0) after 5m27s
[04:36:42.227] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:77:0)
[04:36:42.268] Build status: STARTED
[04:36:42.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:78:0) after 4m3s
[04:40:45.312] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:78:0)
[04:40:45.330] Build status: STARTED
[04:40:45.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:79:0) after 5m39s
[04:46:24.480] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:79:0)
[04:46:24.504] Build status: STARTED
[04:46:24.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:80:0) after 2m16s
[04:48:40.607] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:80:0)
[04:48:40.624] Build status: STARTED
[04:48:40.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:81:0) after 5m53s
[04:54:33.640] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:81:0)
[04:54:33.655] Build status: STARTED
[04:54:33.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:82:0) after 4m3s
[04:58:36.709] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:82:0)
[04:58:36.725] Build status: STARTED
[04:58:36.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:83:0) after 5m56s
[05:04:32.742] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:83:0)
[05:04:32.758] Build status: STARTED
[05:04:32.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:84:0) after 1m14s
[05:05:46.778] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:84:0)
[05:05:46.869] Build status: STARTED
[05:05:46.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:85:0) after 6m30s
[05:12:16.977] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:85:0)
[05:12:16.992] Build status: STARTED
[05:12:16.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:86:0) after 1m45s
[05:14:02.029] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:86:0)
[05:14:02.046] Build status: STARTED
[05:14:02.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:87:0) after 8m24s
[05:22:26.115] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:87:0)
[05:22:26.265] Build status: STARTED
[05:22:26.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:88:0) after 7m49s
[05:30:15.293] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:88:0)
[05:30:15.310] Build status: STARTED
[05:30:15.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:89:0) after 4m50s
[05:35:05.449] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:89:0)
[05:35:05.683] Build status: STARTED
[05:35:05.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:90:0) after 4m33s
[05:39:38.801] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:90:0)
[05:39:38.851] Build status: STARTED
[05:39:38.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:91:0) after 2m17s
[05:41:55.856] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:91:0)
[05:41:55.871] Build status: STARTED
[05:41:55.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:92:0) after 1m19s
[05:43:15.238] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:92:0)
[05:43:15.280] Build status: STARTED
[05:43:15.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:93:0) after 9m10s
[05:52:25.272] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:93:0)
[05:52:25.333] Build status: STARTED
[05:52:25.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:94:0) after 8m3s
[06:00:28.360] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:94:0)
[06:00:28.386] Build status: STARTED
[06:00:28.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:95:0) after 2m32s
[06:03:00.407] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:95:0)
[06:03:00.425] Build status: STARTED
[06:03:00.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:96:0) after 3m51s
[06:06:51.456] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:96:0)
[06:06:51.476] Build status: STARTED
[06:06:51.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876846629772138384:97:0) after 9m2s
[06:14:02.273] Received PubSub notification, asking Buildbucket for the build status
[06:14:02.290] Build:
{
"id": "8711416567689528017",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 26099,
"createdBy": "project:chromium",
"createTime": "2025-06-21T21:53:02.086806922Z",
"startTime": "2025-06-21T21:54:23.337086184Z",
"endTime": "2025-06-22T06:14:01.186822715Z",
"updateTime": "2025-06-22T06:14:01.186822715Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9b48fd0c7048c43e3e1523222b17f1537edb52a3",
"ref": "refs/heads/main"
}
}
}
[06:14:02.290] Invocation finished in 8h21m1.574364498s with status FAILED