[14:39:56.669] New invocation is queued and will start shortly
[14:39:57.994] Starting the invocation (attempt 1)
[14:39:58.025] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/94d60da657a29fae82892a4ac69a6391e2c81eee"
[14:39:58.025] Popped gitiles commit info from properties and tags
[14:39:58.025] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:39:58.025] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:39:58.025] Buildbucket request:
{
"requestId": "8929148325640761328",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "94d60da657a29fae82892a4ac69a6391e2c81eee",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8929148325640761328"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:39:58.831] Scheduled build:
{
"id": "8763718263504149569",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 18409,
"createdBy": "project:chromium",
"createTime": "2023-11-22T14:39:58.083963361Z",
"updateTime": "2023-11-22T14:39:58.083963361Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "94d60da657a29fae82892a4ac69a6391e2c81eee",
"ref": "refs/heads/main"
}
}
}
[14:39:58.831] Task URL: https://cr-buildbucket.appspot.com/build/8763718263504149569
[14:39:58.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:2:0) after 9m45s
[14:39:59.548] Received PubSub notification, asking Buildbucket for the build status
[14:39:59.587] Build status: SCHEDULED
[14:39:59.859] Received PubSub notification, asking Buildbucket for the build status
[14:39:59.877] Build status: STARTED
[14:49:43.862] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:2:0)
[14:49:43.878] Build status: STARTED
[14:49:43.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:5:0) after 9m26s
[14:59:09.941] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:5:0)
[14:59:09.966] Build status: STARTED
[14:59:09.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:6:0) after 7m21s
[15:06:31.214] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:6:0)
[15:06:31.257] Build status: STARTED
[15:06:31.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:7:0) after 5m7s
[15:11:38.286] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:7:0)
[15:11:38.334] Build status: STARTED
[15:11:38.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:8:0) after 5m30s
[15:17:09.769] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:8:0)
[15:17:09.847] Build status: STARTED
[15:17:09.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:9:0) after 7m31s
[15:24:40.987] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:9:0)
[15:24:41.012] Build status: STARTED
[15:24:41.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:10:0) after 8m19s
[15:33:00.358] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:10:0)
[15:33:00.379] Build status: STARTED
[15:33:00.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:11:0) after 4m2s
[15:37:02.414] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:11:0)
[15:37:02.439] Build status: STARTED
[15:37:02.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:12:0) after 8m5s
[15:45:07.509] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:12:0)
[15:45:07.532] Build status: STARTED
[15:45:07.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:13:0) after 1m44s
[15:46:51.650] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:13:0)
[15:46:51.667] Build status: STARTED
[15:46:51.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:14:0) after 3m45s
[15:50:36.771] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:14:0)
[15:50:36.931] Build status: STARTED
[15:50:36.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:15:0) after 9m15s
[15:59:51.964] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:15:0)
[15:59:51.986] Build status: STARTED
[15:59:51.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:16:0) after 3m3s
[16:02:55.016] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:16:0)
[16:02:55.035] Build status: STARTED
[16:02:55.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:17:0) after 2m22s
[16:05:17.024] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:17:0)
[16:05:17.054] Build status: STARTED
[16:05:17.054] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:18:0) after 2m24s
[16:07:41.393] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:18:0)
[16:07:41.414] Build status: STARTED
[16:07:41.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:19:0) after 2m24s
[16:10:05.502] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:19:0)
[16:10:05.548] Build status: STARTED
[16:10:05.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:20:0) after 9m34s
[16:19:39.769] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:20:0)
[16:19:39.840] Build status: STARTED
[16:19:39.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:21:0) after 5m15s
[16:24:55.064] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:21:0)
[16:24:55.092] Build status: STARTED
[16:24:55.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:22:0) after 9m4s
[16:33:59.140] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:22:0)
[16:33:59.247] Build status: STARTED
[16:33:59.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:23:0) after 4m26s
[16:38:25.235] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:23:0)
[16:38:25.272] Build status: STARTED
[16:38:25.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:24:0) after 9m1s
[16:47:26.295] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:24:0)
[16:47:26.316] Build status: STARTED
[16:47:26.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:25:0) after 9m28s
[16:56:54.588] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:25:0)
[16:56:54.631] Build status: STARTED
[16:56:54.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:26:0) after 6m42s
[17:03:36.695] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:26:0)
[17:03:36.848] Build status: STARTED
[17:03:36.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:27:0) after 9m53s
[17:13:29.990] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:27:0)
[17:13:30.163] Build status: STARTED
[17:13:30.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:28:0) after 4m42s
[17:18:12.194] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:28:0)
[17:18:12.236] Build status: STARTED
[17:18:12.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:29:0) after 5m6s
[17:23:18.685] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:29:0)
[17:23:18.725] Build status: STARTED
[17:23:18.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:30:0) after 3m31s
[17:26:49.937] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:30:0)
[17:26:49.957] Build status: STARTED
[17:26:49.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:31:0) after 1m41s
[17:28:31.164] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:31:0)
[17:28:31.202] Build status: STARTED
[17:28:31.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:32:0) after 2m29s
[17:31:00.390] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:32:0)
[17:31:00.416] Build status: STARTED
[17:31:00.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:33:0) after 8m29s
[17:39:29.541] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:33:0)
[17:39:29.612] Build status: STARTED
[17:39:29.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:34:0) after 8m3s
[17:47:32.797] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:34:0)
[17:47:32.828] Build status: STARTED
[17:47:32.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:35:0) after 7m26s
[17:54:58.962] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:35:0)
[17:54:58.990] Build status: STARTED
[17:54:58.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:36:0) after 7m58s
[18:02:57.021] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:36:0)
[18:02:57.047] Build status: STARTED
[18:02:57.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:37:0) after 9m17s
[18:12:14.563] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:37:0)
[18:12:14.579] Build status: STARTED
[18:12:14.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:38:0) after 5m26s
[18:17:40.597] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:38:0)
[18:17:40.618] Build status: STARTED
[18:17:40.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:39:0) after 8m18s
[18:25:58.656] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:39:0)
[18:25:58.694] Build status: STARTED
[18:25:58.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:40:0) after 4m29s
[18:30:27.752] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:40:0)
[18:30:27.778] Build status: STARTED
[18:30:27.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:41:0) after 9m34s
[18:40:01.859] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:41:0)
[18:40:02.037] Build status: STARTED
[18:40:02.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:42:0) after 9m36s
[18:49:38.157] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:42:0)
[18:49:38.192] Build status: STARTED
[18:49:38.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:43:0) after 9m58s
[18:59:36.247] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:43:0)
[18:59:36.296] Build status: STARTED
[18:59:36.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:44:0) after 1m59s
[19:01:35.318] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:44:0)
[19:01:35.411] Build status: STARTED
[19:01:35.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:45:0) after 8m47s
[19:10:22.403] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:45:0)
[19:10:22.423] Build status: STARTED
[19:10:22.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:46:0) after 5m45s
[19:16:07.420] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:46:0)
[19:16:07.450] Build status: STARTED
[19:16:07.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:47:0) after 7m7s
[19:23:15.375] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:47:0)
[19:23:15.398] Build status: STARTED
[19:23:15.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:48:0) after 7m33s
[19:30:48.423] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:48:0)
[19:30:48.449] Build status: STARTED
[19:30:48.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:49:0) after 3m13s
[19:34:01.489] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:49:0)
[19:34:01.508] Build status: STARTED
[19:34:01.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:50:0) after 8m19s
[19:42:20.605] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:50:0)
[19:42:20.631] Build status: STARTED
[19:42:20.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:51:0) after 2m57s
[19:45:17.657] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:51:0)
[19:45:17.689] Build status: STARTED
[19:45:17.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:52:0) after 4m45s
[19:50:02.712] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:52:0)
[19:50:02.840] Build status: STARTED
[19:50:02.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:53:0) after 9m17s
[19:59:19.850] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:53:0)
[19:59:19.907] Build status: STARTED
[19:59:19.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:54:0) after 6m59s
[20:06:18.942] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:54:0)
[20:06:18.960] Build status: STARTED
[20:06:18.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:55:0) after 2m45s
[20:09:03.992] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:55:0)
[20:09:04.030] Build status: STARTED
[20:09:04.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:56:0) after 7m42s
[20:16:46.071] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:56:0)
[20:16:46.213] Build status: STARTED
[20:16:46.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:57:0) after 1m3s
[20:17:49.319] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:57:0)
[20:17:49.387] Build status: STARTED
[20:17:49.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:58:0) after 6m47s
[20:24:36.625] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:58:0)
[20:24:36.656] Build status: STARTED
[20:24:36.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:59:0) after 7m20s
[20:31:57.039] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:59:0)
[20:31:57.054] Build status: STARTED
[20:31:57.054] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:60:0) after 9m51s
[20:41:48.374] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:60:0)
[20:41:48.404] Build status: STARTED
[20:41:48.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:61:0) after 4m26s
[20:46:14.394] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:61:0)
[20:46:14.417] Build status: STARTED
[20:46:14.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:62:0) after 6m55s
[20:53:09.442] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:62:0)
[20:53:09.472] Build status: STARTED
[20:53:09.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:63:0) after 5m3s
[20:58:12.493] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:63:0)
[20:58:12.643] Build status: STARTED
[20:58:12.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:64:0) after 1m41s
[20:59:53.664] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:64:0)
[20:59:53.694] Build status: STARTED
[20:59:53.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:65:0) after 9m7s
[21:09:01.097] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:65:0)
[21:09:01.115] Build status: STARTED
[21:09:01.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:66:0) after 7m40s
[21:16:41.517] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:66:0)
[21:16:41.541] Build status: STARTED
[21:16:41.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:67:0) after 2m6s
[21:18:47.572] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:67:0)
[21:18:47.596] Build status: STARTED
[21:18:47.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:68:0) after 3m7s
[21:21:54.619] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:68:0)
[21:21:54.637] Build status: STARTED
[21:21:54.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:69:0) after 1m15s
[21:23:09.670] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:69:0)
[21:23:09.688] Build status: STARTED
[21:23:09.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:70:0) after 7m5s
[21:30:14.824] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:70:0)
[21:30:14.847] Build status: STARTED
[21:30:14.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:71:0) after 3m51s
[21:34:05.923] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:71:0)
[21:34:05.939] Build status: STARTED
[21:34:05.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:72:0) after 9m40s
[21:43:46.044] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:72:0)
[21:43:46.062] Build status: STARTED
[21:43:46.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:73:0) after 7m9s
[21:50:55.316] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:73:0)
[21:50:55.409] Build status: STARTED
[21:50:55.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:74:0) after 5m0s
[21:55:56.088] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:74:0)
[21:55:56.108] Build status: STARTED
[21:55:56.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:75:0) after 9m8s
[22:05:04.161] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:75:0)
[22:05:04.245] Build status: STARTED
[22:05:04.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:76:0) after 6m19s
[22:11:23.293] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:76:0)
[22:11:23.313] Build status: STARTED
[22:11:23.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:77:0) after 6m21s
[22:17:44.349] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:77:0)
[22:17:44.372] Build status: STARTED
[22:17:44.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:78:0) after 4m46s
[22:22:30.495] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:78:0)
[22:22:30.520] Build status: STARTED
[22:22:30.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:79:0) after 5m39s
[22:28:10.101] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:79:0)
[22:28:10.123] Build status: STARTED
[22:28:10.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:80:0) after 1m3s
[22:29:13.161] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:80:0)
[22:29:13.190] Build status: STARTED
[22:29:13.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:81:0) after 3m42s
[22:32:55.387] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:81:0)
[22:32:55.412] Build status: STARTED
[22:32:55.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:82:0) after 7m29s
[22:40:24.470] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:82:0)
[22:40:24.500] Build status: STARTED
[22:40:24.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:83:0) after 1m19s
[22:41:43.539] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:83:0)
[22:41:43.574] Build status: STARTED
[22:41:43.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:84:0) after 9m32s
[22:51:15.649] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:84:0)
[22:51:15.679] Build status: STARTED
[22:51:15.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:85:0) after 9m37s
[23:00:52.708] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:85:0)
[23:00:52.747] Build status: STARTED
[23:00:52.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:86:0) after 6m24s
[23:07:16.971] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:86:0)
[23:07:17.003] Build status: STARTED
[23:07:17.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:87:0) after 2m54s
[23:10:11.352] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:87:0)
[23:10:11.376] Build status: STARTED
[23:10:11.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:88:0) after 9m35s
[23:19:46.478] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:88:0)
[23:19:46.505] Build status: STARTED
[23:19:46.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8929148325640761328:89:0) after 8m51s
[23:20:27.977] Received PubSub notification, asking Buildbucket for the build status
[23:20:27.996] Build:
{
"id": "8763718263504149569",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 18409,
"createdBy": "project:chromium",
"createTime": "2023-11-22T14:39:58.083963361Z",
"startTime": "2023-11-22T14:39:59.258298Z",
"endTime": "2023-11-22T23:20:27.078451Z",
"updateTime": "2023-11-22T23:20:27.078451Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "94d60da657a29fae82892a4ac69a6391e2c81eee",
"ref": "refs/heads/main"
}
}
}
[23:20:27.996] Invocation finished in 8h40m31.334034092s with status FAILED