[02:43:56.289] New invocation is queued and will start shortly
[02:43:57.441] Starting the invocation (attempt 1)
[02:43:57.467] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/bb296b4f253cfd774b3f5dba97d26f265ee84855"
[02:43:57.467] Popped gitiles commit info from properties and tags
[02:43:57.467] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:43:57.467] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:43:57.467] Buildbucket request:
{
"requestId": "8910892785660063904",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bb296b4f253cfd774b3f5dba97d26f265ee84855",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8910892785660063904"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:43:58.369] Scheduled build:
{
"id": "8745462723682802257",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 21656,
"createdBy": "project:chromium",
"createTime": "2024-06-11T02:43:57.543819220Z",
"updateTime": "2024-06-11T02:43:57.543819220Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bb296b4f253cfd774b3f5dba97d26f265ee84855",
"ref": "refs/heads/main"
}
}
}
[02:43:58.369] Task URL: https://cr-buildbucket.appspot.com/build/8745462723682802257
[02:43:58.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:2:0) after 4m35s
[02:43:59.097] Received PubSub notification, asking Buildbucket for the build status
[02:43:59.138] Build status: SCHEDULED
[02:45:32.245] Received PubSub notification, asking Buildbucket for the build status
[02:45:32.262] Build status: STARTED
[02:48:33.498] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:2:0)
[02:48:33.519] Build status: STARTED
[02:48:33.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:5:0) after 1m13s
[02:49:47.104] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:5:0)
[02:49:47.123] Build status: STARTED
[02:49:47.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:6:0) after 6m45s
[02:56:32.605] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:6:0)
[02:56:32.661] Build status: STARTED
[02:56:32.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:7:0) after 7m29s
[03:04:01.663] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:7:0)
[03:04:01.772] Build status: STARTED
[03:04:01.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:8:0) after 6m44s
[03:10:46.007] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:8:0)
[03:10:46.035] Build status: STARTED
[03:10:46.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:9:0) after 4m19s
[03:15:05.063] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:9:0)
[03:15:05.178] Build status: STARTED
[03:15:05.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:10:0) after 9m43s
[03:24:48.210] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:10:0)
[03:24:48.232] Build status: STARTED
[03:24:48.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:11:0) after 2m13s
[03:27:01.270] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:11:0)
[03:27:01.311] Build status: STARTED
[03:27:01.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:12:0) after 3m15s
[03:30:16.431] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:12:0)
[03:30:16.449] Build status: STARTED
[03:30:16.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:13:0) after 5m47s
[03:36:03.589] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:13:0)
[03:36:03.942] Build status: STARTED
[03:36:03.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:14:0) after 1m30s
[03:37:34.033] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:14:0)
[03:37:34.054] Build status: STARTED
[03:37:34.054] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:15:0) after 4m49s
[03:42:23.083] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:15:0)
[03:42:23.107] Build status: STARTED
[03:42:23.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:16:0) after 7m4s
[03:49:27.281] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:16:0)
[03:49:27.305] Build status: STARTED
[03:49:27.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:17:0) after 9m31s
[03:58:58.398] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:17:0)
[03:58:58.457] Build status: STARTED
[03:58:58.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:18:0) after 5m48s
[04:04:46.502] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:18:0)
[04:04:46.526] Build status: STARTED
[04:04:46.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:19:0) after 2m32s
[04:07:18.547] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:19:0)
[04:07:18.568] Build status: STARTED
[04:07:18.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:20:0) after 1m17s
[04:08:35.706] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:20:0)
[04:08:35.780] Build status: STARTED
[04:08:35.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:21:0) after 9m55s
[04:18:30.798] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:21:0)
[04:18:30.818] Build status: STARTED
[04:18:30.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:22:0) after 3m32s
[04:22:02.850] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:22:0)
[04:22:02.867] Build status: STARTED
[04:22:02.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:23:0) after 6m14s
[04:28:16.911] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:23:0)
[04:28:16.929] Build status: STARTED
[04:28:16.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:24:0) after 1m12s
[04:29:29.129] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:24:0)
[04:29:29.154] Build status: STARTED
[04:29:29.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:25:0) after 3m8s
[04:32:37.177] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:25:0)
[04:32:37.196] Build status: STARTED
[04:32:37.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:26:0) after 1m11s
[04:33:48.379] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:26:0)
[04:33:48.413] Build status: STARTED
[04:33:48.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:27:0) after 7m38s
[04:41:26.461] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:27:0)
[04:41:26.484] Build status: STARTED
[04:41:26.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:28:0) after 4m35s
[04:46:01.579] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:28:0)
[04:46:01.629] Build status: STARTED
[04:46:01.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:29:0) after 3m16s
[04:49:17.681] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:29:0)
[04:49:17.742] Build status: STARTED
[04:49:17.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:30:0) after 4m59s
[04:54:16.976] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:30:0)
[04:54:16.997] Build status: STARTED
[04:54:16.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:31:0) after 8m4s
[05:02:21.017] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:31:0)
[05:02:21.052] Build status: STARTED
[05:02:21.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:32:0) after 7m22s
[05:09:43.224] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:32:0)
[05:09:43.241] Build status: STARTED
[05:09:43.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:33:0) after 7m2s
[05:16:45.264] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:33:0)
[05:16:45.281] Build status: STARTED
[05:16:45.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:34:0) after 9m2s
[05:25:47.309] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:34:0)
[05:25:47.378] Build status: STARTED
[05:25:47.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:35:0) after 7m0s
[05:32:47.545] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:35:0)
[05:32:47.567] Build status: STARTED
[05:32:47.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:36:0) after 9m38s
[05:42:25.609] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:36:0)
[05:42:25.630] Build status: STARTED
[05:42:25.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:37:0) after 9m0s
[05:51:25.759] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:37:0)
[05:51:25.778] Build status: STARTED
[05:51:25.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:38:0) after 5m10s
[05:56:35.803] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:38:0)
[05:56:35.843] Build status: STARTED
[05:56:35.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:39:0) after 1m10s
[05:57:45.915] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:39:0)
[05:57:45.932] Build status: STARTED
[05:57:45.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:40:0) after 8m30s
[06:06:16.122] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:40:0)
[06:06:16.142] Build status: STARTED
[06:06:16.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:41:0) after 9m13s
[06:15:29.465] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:41:0)
[06:15:29.481] Build status: STARTED
[06:15:29.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:42:0) after 4m42s
[06:20:11.502] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:42:0)
[06:20:11.525] Build status: STARTED
[06:20:11.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:43:0) after 5m44s
[06:25:55.710] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:43:0)
[06:25:55.751] Build status: STARTED
[06:25:55.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:44:0) after 7m7s
[06:33:02.774] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:44:0)
[06:33:02.792] Build status: STARTED
[06:33:02.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:45:0) after 5m41s
[06:38:44.089] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:45:0)
[06:38:44.107] Build status: STARTED
[06:38:44.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:46:0) after 8m6s
[06:46:50.228] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:46:0)
[06:46:50.247] Build status: STARTED
[06:46:50.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:47:0) after 8m15s
[06:55:05.280] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:47:0)
[06:55:05.299] Build status: STARTED
[06:55:05.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:48:0) after 1m21s
[06:56:26.392] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:48:0)
[06:56:26.412] Build status: STARTED
[06:56:26.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:49:0) after 7m9s
[07:03:35.542] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:49:0)
[07:03:35.560] Build status: STARTED
[07:03:35.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:50:0) after 1m2s
[07:04:37.856] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:50:0)
[07:04:37.886] Build status: STARTED
[07:04:37.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:51:0) after 9m0s
[07:13:37.971] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:51:0)
[07:13:37.990] Build status: STARTED
[07:13:37.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:52:0) after 8m1s
[07:21:39.232] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:52:0)
[07:21:39.249] Build status: STARTED
[07:21:39.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:53:0) after 6m48s
[07:28:27.221] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:53:0)
[07:28:27.337] Build status: STARTED
[07:28:27.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8910892785660063904:54:0) after 9m26s
[07:28:49.778] Received PubSub notification, asking Buildbucket for the build status
[07:28:49.800] Build:
{
"id": "8745462723682802257",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 21656,
"createdBy": "project:chromium",
"createTime": "2024-06-11T02:43:57.543819220Z",
"startTime": "2024-06-11T02:45:32.021662839Z",
"endTime": "2024-06-11T07:28:49.359288142Z",
"updateTime": "2024-06-11T07:28:49.359288142Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bb296b4f253cfd774b3f5dba97d26f265ee84855",
"ref": "refs/heads/main"
}
}
}
[07:28:49.800] Invocation finished in 4h44m53.525746971s with status FAILED