[21:24:32.782] New invocation is queued and will start shortly
[21:24:34.347] Starting the invocation (attempt 1)
[21:24:34.377] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c3ba5071f3faad09b676f60e1427a9551a9c1b12"
[21:24:34.377] Popped gitiles commit info from properties and tags
[21:24:34.377] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:24:34.377] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:24:34.377] Buildbucket request:
{
"requestId": "8882918417431668976",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c3ba5071f3faad09b676f60e1427a9551a9c1b12",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8882918417431668976"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:24:34.911] Scheduled build:
{
"id": "8717488355025225521",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 25469,
"createdBy": "project:chromium",
"createTime": "2025-04-15T21:24:34.449092446Z",
"updateTime": "2025-04-15T21:24:34.449092446Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c3ba5071f3faad09b676f60e1427a9551a9c1b12",
"ref": "refs/heads/main"
}
}
}
[21:24:34.911] Task URL: https://cr-buildbucket.appspot.com/build/8717488355025225521
[21:24:34.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:2:0) after 1m57s
[21:24:35.918] Received PubSub notification, asking Buildbucket for the build status
[21:24:35.946] Build status: SCHEDULED
[21:24:41.056] Received PubSub notification, asking Buildbucket for the build status
[21:24:41.159] Build status: STARTED
[21:26:31.936] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:2:0)
[21:26:31.975] Build status: STARTED
[21:26:31.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:5:0) after 5m50s
[21:32:22.070] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:5:0)
[21:32:22.095] Build status: STARTED
[21:32:22.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:6:0) after 1m34s
[21:33:56.163] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:6:0)
[21:33:56.220] Build status: STARTED
[21:33:56.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:7:0) after 8m34s
[21:42:30.252] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:7:0)
[21:42:30.306] Build status: STARTED
[21:42:30.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:8:0) after 1m14s
[21:43:44.335] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:8:0)
[21:43:44.359] Build status: STARTED
[21:43:44.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:9:0) after 4m7s
[21:47:51.376] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:9:0)
[21:47:51.396] Build status: STARTED
[21:47:51.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:10:0) after 5m4s
[21:52:55.425] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:10:0)
[21:52:55.440] Build status: STARTED
[21:52:55.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:11:0) after 5m8s
[21:58:03.465] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:11:0)
[21:58:03.483] Build status: STARTED
[21:58:03.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:12:0) after 8m59s
[22:07:02.517] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:12:0)
[22:07:02.533] Build status: STARTED
[22:07:02.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:13:0) after 7m40s
[22:14:42.569] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:13:0)
[22:14:42.595] Build status: STARTED
[22:14:42.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:14:0) after 1m27s
[22:16:09.616] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:14:0)
[22:16:09.635] Build status: STARTED
[22:16:09.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:15:0) after 7m5s
[22:23:14.674] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:15:0)
[22:23:14.692] Build status: STARTED
[22:23:14.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:16:0) after 3m41s
[22:26:55.795] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:16:0)
[22:26:55.819] Build status: STARTED
[22:26:55.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:17:0) after 4m42s
[22:31:37.952] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:17:0)
[22:31:38.005] Build status: STARTED
[22:31:38.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:18:0) after 8m8s
[22:39:46.072] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:18:0)
[22:39:46.134] Build status: STARTED
[22:39:46.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:19:0) after 4m4s
[22:43:50.162] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:19:0)
[22:43:50.185] Build status: STARTED
[22:43:50.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:20:0) after 5m19s
[22:49:09.225] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:20:0)
[22:49:09.243] Build status: STARTED
[22:49:09.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:21:0) after 9m14s
[22:58:23.274] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:21:0)
[22:58:23.289] Build status: STARTED
[22:58:23.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:22:0) after 3m38s
[23:02:01.348] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:22:0)
[23:02:01.362] Build status: STARTED
[23:02:01.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:23:0) after 4m11s
[23:06:12.395] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:23:0)
[23:06:12.418] Build status: STARTED
[23:06:12.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:24:0) after 6m23s
[23:12:35.529] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:24:0)
[23:12:35.547] Build status: STARTED
[23:12:35.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:25:0) after 3m19s
[23:15:54.724] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:25:0)
[23:15:54.751] Build status: STARTED
[23:15:54.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:26:0) after 6m45s
[23:22:39.830] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:26:0)
[23:22:39.874] Build status: STARTED
[23:22:39.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:27:0) after 1m17s
[23:23:56.964] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:27:0)
[23:23:56.982] Build status: STARTED
[23:23:56.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:28:0) after 1m16s
[23:25:13.065] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:28:0)
[23:25:13.085] Build status: STARTED
[23:25:13.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:29:0) after 3m21s
[23:28:34.165] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:29:0)
[23:28:34.186] Build status: STARTED
[23:28:34.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:30:0) after 6m35s
[23:35:09.216] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:30:0)
[23:35:09.235] Build status: STARTED
[23:35:09.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:31:0) after 2m26s
[23:37:35.376] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:31:0)
[23:37:35.392] Build status: STARTED
[23:37:35.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:32:0) after 7m40s
[23:45:15.490] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:32:0)
[23:45:15.514] Build status: STARTED
[23:45:15.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:33:0) after 7m32s
[23:52:47.579] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:33:0)
[23:52:47.595] Build status: STARTED
[23:52:47.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:34:0) after 8m14s
[00:01:01.760] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:34:0)
[00:01:01.801] Build status: STARTED
[00:01:01.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:35:0) after 2m26s
[00:03:27.847] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:35:0)
[00:03:27.863] Build status: STARTED
[00:03:27.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:36:0) after 9m1s
[00:12:28.990] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:36:0)
[00:12:29.005] Build status: STARTED
[00:12:29.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:37:0) after 6m24s
[00:18:53.090] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:37:0)
[00:18:53.107] Build status: STARTED
[00:18:53.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:38:0) after 1m15s
[00:20:08.231] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:38:0)
[00:20:08.281] Build status: STARTED
[00:20:08.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:39:0) after 2m36s
[00:22:44.301] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:39:0)
[00:22:44.320] Build status: STARTED
[00:22:44.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:40:0) after 7m28s
[00:30:12.488] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:40:0)
[00:30:12.510] Build status: STARTED
[00:30:12.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:41:0) after 9m52s
[00:40:04.555] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:41:0)
[00:40:04.611] Build status: STARTED
[00:40:04.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:42:0) after 4m45s
[00:44:49.697] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:42:0)
[00:44:49.722] Build status: STARTED
[00:44:49.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:43:0) after 9m45s
[00:54:34.754] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:43:0)
[00:54:34.768] Build status: STARTED
[00:54:34.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:44:0) after 7m41s
[01:02:15.817] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:44:0)
[01:02:15.834] Build status: STARTED
[01:02:15.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:45:0) after 7m11s
[01:09:26.830] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:45:0)
[01:09:26.850] Build status: STARTED
[01:09:26.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:46:0) after 4m46s
[01:14:12.873] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:46:0)
[01:14:12.967] Build status: STARTED
[01:14:12.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:47:0) after 6m12s
[01:20:24.993] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:47:0)
[01:20:25.012] Build status: STARTED
[01:20:25.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:48:0) after 8m12s
[01:28:37.003] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:48:0)
[01:28:37.020] Build status: STARTED
[01:28:37.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:49:0) after 4m32s
[01:33:09.059] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:49:0)
[01:33:09.114] Build status: STARTED
[01:33:09.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:50:0) after 8m9s
[01:41:18.143] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:50:0)
[01:41:18.165] Build status: STARTED
[01:41:18.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:51:0) after 4m58s
[01:46:16.197] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:51:0)
[01:46:16.238] Build status: STARTED
[01:46:16.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:52:0) after 8m22s
[01:54:38.292] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:52:0)
[01:54:38.307] Build status: STARTED
[01:54:38.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:53:0) after 1m9s
[01:55:47.343] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:53:0)
[01:55:47.362] Build status: STARTED
[01:55:47.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:54:0) after 5m9s
[02:00:56.444] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:54:0)
[02:00:56.466] Build status: STARTED
[02:00:56.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:55:0) after 3m38s
[02:04:34.498] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:55:0)
[02:04:34.515] Build status: STARTED
[02:04:34.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:56:0) after 8m54s
[02:13:28.546] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:56:0)
[02:13:28.564] Build status: STARTED
[02:13:28.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:57:0) after 1m34s
[02:15:02.611] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:57:0)
[02:15:02.630] Build status: STARTED
[02:15:02.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:58:0) after 3m38s
[02:18:40.889] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:58:0)
[02:18:40.916] Build status: STARTED
[02:18:40.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:59:0) after 6m43s
[02:25:23.995] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:59:0)
[02:25:24.013] Build status: STARTED
[02:25:24.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:60:0) after 3m18s
[02:28:42.045] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:60:0)
[02:28:42.063] Build status: STARTED
[02:28:42.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:61:0) after 7m50s
[02:36:32.073] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:61:0)
[02:36:32.091] Build status: STARTED
[02:36:32.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:62:0) after 4m35s
[02:41:07.130] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:62:0)
[02:41:07.208] Build status: STARTED
[02:41:07.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:63:0) after 4m32s
[02:45:39.268] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:63:0)
[02:45:39.372] Build status: STARTED
[02:45:39.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:64:0) after 7m14s
[02:52:53.456] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:64:0)
[02:52:53.503] Build status: STARTED
[02:52:53.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:65:0) after 1m23s
[02:54:16.587] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:65:0)
[02:54:16.647] Build status: STARTED
[02:54:16.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:66:0) after 6m58s
[03:01:14.738] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:66:0)
[03:01:14.757] Build status: STARTED
[03:01:14.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:67:0) after 7m24s
[03:08:38.822] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:67:0)
[03:08:38.839] Build status: STARTED
[03:08:38.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:68:0) after 2m2s
[03:10:40.934] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:68:0)
[03:10:40.958] Build status: STARTED
[03:10:40.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:69:0) after 9m51s
[03:20:32.075] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:69:0)
[03:20:32.105] Build status: STARTED
[03:20:32.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:70:0) after 1m56s
[03:22:28.131] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:70:0)
[03:22:28.153] Build status: STARTED
[03:22:28.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:71:0) after 2m6s
[03:24:34.235] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:71:0)
[03:24:34.256] Build status: STARTED
[03:24:34.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:72:0) after 1m6s
[03:25:40.280] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:72:0)
[03:25:40.298] Build status: STARTED
[03:25:40.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:73:0) after 3m39s
[03:29:19.326] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:73:0)
[03:29:19.342] Build status: STARTED
[03:29:19.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:74:0) after 2m31s
[03:31:50.392] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:74:0)
[03:31:50.407] Build status: STARTED
[03:31:50.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:75:0) after 4m27s
[03:36:17.508] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:75:0)
[03:36:17.539] Build status: STARTED
[03:36:17.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:76:0) after 4m35s
[03:40:52.617] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:76:0)
[03:40:52.640] Build status: STARTED
[03:40:52.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:77:0) after 1m45s
[03:42:37.677] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:77:0)
[03:42:37.696] Build status: STARTED
[03:42:37.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:78:0) after 8m44s
[03:51:21.728] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:78:0)
[03:51:21.807] Build status: STARTED
[03:51:21.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:79:0) after 2m13s
[03:53:34.836] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:79:0)
[03:53:34.857] Build status: STARTED
[03:53:34.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:80:0) after 1m16s
[03:54:50.882] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:80:0)
[03:54:50.906] Build status: STARTED
[03:54:50.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:81:0) after 1m3s
[03:55:53.938] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:81:0)
[03:55:53.952] Build status: STARTED
[03:55:53.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:82:0) after 2m16s
[03:58:09.976] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:82:0)
[03:58:10.030] Build status: STARTED
[03:58:10.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:83:0) after 8m46s
[04:06:56.155] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:83:0)
[04:06:56.171] Build status: STARTED
[04:06:56.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:84:0) after 9m44s
[04:16:40.203] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:84:0)
[04:16:40.262] Build status: STARTED
[04:16:40.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:85:0) after 6m55s
[04:23:35.287] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:85:0)
[04:23:35.318] Build status: STARTED
[04:23:35.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:86:0) after 4m35s
[04:28:10.382] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:86:0)
[04:28:10.397] Build status: STARTED
[04:28:10.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:87:0) after 2m58s
[04:31:08.421] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:87:0)
[04:31:08.443] Build status: STARTED
[04:31:08.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:88:0) after 3m37s
[04:34:45.746] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:88:0)
[04:34:45.824] Build status: STARTED
[04:34:45.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:89:0) after 7m15s
[04:42:00.893] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:89:0)
[04:42:00.912] Build status: STARTED
[04:42:00.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:90:0) after 3m23s
[04:45:24.017] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:90:0)
[04:45:24.048] Build status: STARTED
[04:45:24.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:91:0) after 1m20s
[04:46:44.074] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:91:0)
[04:46:44.088] Build status: STARTED
[04:46:44.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8882918417431668976:92:0) after 7m28s
[04:48:30.289] Received PubSub notification, asking Buildbucket for the build status
[04:48:30.309] Build:
{
"id": "8717488355025225521",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 25469,
"createdBy": "project:chromium",
"createTime": "2025-04-15T21:24:34.449092446Z",
"startTime": "2025-04-15T21:24:40.743774446Z",
"endTime": "2025-04-16T04:48:29.860354664Z",
"updateTime": "2025-04-16T04:48:29.860354664Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c3ba5071f3faad09b676f60e1427a9551a9c1b12",
"ref": "refs/heads/main"
}
}
}
[04:48:30.309] Invocation finished in 7h23m57.538172252s with status FAILED