[01:22:06.131] New invocation is queued and will start shortly
[01:22:07.329] Starting the invocation (attempt 1)
[01:22:07.365] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/56e16d8c76ab0d1939748ae168f12fe1abec8852"
[01:22:07.365] Popped gitiles commit info from properties and tags
[01:22:07.365] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:22:07.365] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:22:07.365] Buildbucket request:
{
"requestId": "8969695365551552128",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "56e16d8c76ab0d1939748ae168f12fe1abec8852",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8969695365551552128"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:22:07.984] Scheduled build:
{
"id": "8804265303512607425",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 14179,
"createdBy": "project:chromium",
"createTime": "2022-09-01T01:22:07.421888462Z",
"updateTime": "2022-09-01T01:22:07.421888462Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "56e16d8c76ab0d1939748ae168f12fe1abec8852",
"ref": "refs/heads/main"
}
}
}
[01:22:07.984] Task URL: https://cr-buildbucket.appspot.com/build/8804265303512607425
[01:22:07.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:2:0) after 7m5s
[01:23:49.536] Received PubSub notification, asking Buildbucket for the build status
[01:23:49.559] Build status: STARTED
[01:29:13.043] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:2:0)
[01:29:13.067] Build status: STARTED
[01:29:13.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:4:0) after 8m13s
[01:37:26.123] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:4:0)
[01:37:26.146] Build status: STARTED
[01:37:26.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:5:0) after 6m3s
[01:43:30.679] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:5:0)
[01:43:30.708] Build status: STARTED
[01:43:30.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:6:0) after 4m30s
[01:48:01.033] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:6:0)
[01:48:01.058] Build status: STARTED
[01:48:01.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:7:0) after 7m54s
[01:55:55.308] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:7:0)
[01:55:55.333] Build status: STARTED
[01:55:55.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:8:0) after 5m7s
[02:01:02.471] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:8:0)
[02:01:02.514] Build status: STARTED
[02:01:02.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:9:0) after 7m46s
[02:08:48.535] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:9:0)
[02:08:48.560] Build status: STARTED
[02:08:48.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:10:0) after 3m32s
[02:12:20.823] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:10:0)
[02:12:20.846] Build status: STARTED
[02:12:20.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:11:0) after 2m7s
[02:14:28.001] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:11:0)
[02:14:28.024] Build status: STARTED
[02:14:28.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:12:0) after 5m11s
[02:19:39.085] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:12:0)
[02:19:39.166] Build status: STARTED
[02:19:39.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:13:0) after 1m8s
[02:20:47.198] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:13:0)
[02:20:47.220] Build status: STARTED
[02:20:47.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:14:0) after 2m44s
[02:23:31.593] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:14:0)
[02:23:31.631] Build status: STARTED
[02:23:31.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:15:0) after 7m35s
[02:31:06.628] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:15:0)
[02:31:06.652] Build status: STARTED
[02:31:06.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:16:0) after 3m34s
[02:34:40.876] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:16:0)
[02:34:40.901] Build status: STARTED
[02:34:40.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:17:0) after 6m27s
[02:41:08.093] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:17:0)
[02:41:08.119] Build status: STARTED
[02:41:08.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:18:0) after 8m27s
[02:49:35.204] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:18:0)
[02:49:35.233] Build status: STARTED
[02:49:35.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:19:0) after 4m36s
[02:54:11.253] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:19:0)
[02:54:11.275] Build status: STARTED
[02:54:11.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:20:0) after 9m52s
[03:04:03.403] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:20:0)
[03:04:03.429] Build status: STARTED
[03:04:03.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:21:0) after 3m6s
[03:07:09.466] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:21:0)
[03:07:09.516] Build status: STARTED
[03:07:09.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:22:0) after 3m39s
[03:10:48.544] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:22:0)
[03:10:48.578] Build status: STARTED
[03:10:48.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:23:0) after 8m3s
[03:18:52.295] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:23:0)
[03:18:52.323] Build status: STARTED
[03:18:52.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:24:0) after 7m26s
[03:26:18.356] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:24:0)
[03:26:18.381] Build status: STARTED
[03:26:18.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:25:0) after 2m59s
[03:29:17.581] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:25:0)
[03:29:17.624] Build status: STARTED
[03:29:17.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:26:0) after 4m11s
[03:33:28.891] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:26:0)
[03:33:28.912] Build status: STARTED
[03:33:28.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:27:0) after 3m38s
[03:37:07.118] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:27:0)
[03:37:07.139] Build status: STARTED
[03:37:07.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:28:0) after 7m22s
[03:44:29.262] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:28:0)
[03:44:29.300] Build status: STARTED
[03:44:29.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:29:0) after 5m17s
[03:49:46.424] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:29:0)
[03:49:46.453] Build status: STARTED
[03:49:46.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:30:0) after 6m50s
[03:56:36.476] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:30:0)
[03:56:36.503] Build status: STARTED
[03:56:36.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:31:0) after 6m41s
[04:03:17.607] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:31:0)
[04:03:17.640] Build status: STARTED
[04:03:17.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:32:0) after 3m47s
[04:07:04.668] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:32:0)
[04:07:04.696] Build status: STARTED
[04:07:04.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:33:0) after 7m14s
[04:14:18.730] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:33:0)
[04:14:18.755] Build status: STARTED
[04:14:18.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:34:0) after 8m56s
[04:23:14.786] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:34:0)
[04:23:14.815] Build status: STARTED
[04:23:14.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:35:0) after 6m57s
[04:30:12.074] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:35:0)
[04:30:12.123] Build status: STARTED
[04:30:12.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:36:0) after 1m27s
[04:31:39.158] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:36:0)
[04:31:39.181] Build status: STARTED
[04:31:39.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:37:0) after 4m20s
[04:35:59.252] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:37:0)
[04:35:59.277] Build status: STARTED
[04:35:59.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:38:0) after 3m27s
[04:39:26.958] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:38:0)
[04:39:26.986] Build status: STARTED
[04:39:26.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:39:0) after 3m36s
[04:43:03.015] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:39:0)
[04:43:03.037] Build status: STARTED
[04:43:03.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:40:0) after 7m57s
[04:51:00.063] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:40:0)
[04:51:00.110] Build status: STARTED
[04:51:00.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:41:0) after 1m40s
[04:52:40.398] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:41:0)
[04:52:40.428] Build status: STARTED
[04:52:40.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:42:0) after 7m2s
[04:59:42.481] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:42:0)
[04:59:42.507] Build status: STARTED
[04:59:42.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:43:0) after 5m3s
[05:04:45.536] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:43:0)
[05:04:45.563] Build status: STARTED
[05:04:45.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:44:0) after 5m41s
[05:10:26.842] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:44:0)
[05:10:26.863] Build status: STARTED
[05:10:26.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:45:0) after 5m44s
[05:16:10.934] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:45:0)
[05:16:10.995] Build status: STARTED
[05:16:10.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:46:0) after 8m46s
[05:24:57.079] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:46:0)
[05:24:57.106] Build status: STARTED
[05:24:57.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:47:0) after 1m40s
[05:26:37.085] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:47:0)
[05:26:37.104] Build status: STARTED
[05:26:37.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:48:0) after 6m32s
[05:33:09.126] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:48:0)
[05:33:09.152] Build status: STARTED
[05:33:09.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:49:0) after 7m15s
[05:40:24.197] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:49:0)
[05:40:24.222] Build status: STARTED
[05:40:24.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:50:0) after 1m9s
[05:41:33.304] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:50:0)
[05:41:33.379] Build status: STARTED
[05:41:33.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:51:0) after 6m2s
[05:47:35.434] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:51:0)
[05:47:35.460] Build status: STARTED
[05:47:35.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:52:0) after 3m3s
[05:50:38.487] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:52:0)
[05:50:38.509] Build status: STARTED
[05:50:38.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:53:0) after 7m30s
[05:58:08.729] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:53:0)
[05:58:08.801] Build status: STARTED
[05:58:08.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:54:0) after 7m13s
[06:05:21.811] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:54:0)
[06:05:21.839] Build status: STARTED
[06:05:21.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:55:0) after 5m37s
[06:10:58.883] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:55:0)
[06:10:58.913] Build status: STARTED
[06:10:58.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:56:0) after 2m48s
[06:13:46.936] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:56:0)
[06:13:46.966] Build status: STARTED
[06:13:46.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:57:0) after 8m11s
[06:21:58.108] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:57:0)
[06:21:58.137] Build status: STARTED
[06:21:58.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:58:0) after 8m37s
[06:30:35.169] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:58:0)
[06:30:35.197] Build status: STARTED
[06:30:35.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:59:0) after 7m3s
[06:37:38.310] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:59:0)
[06:37:38.334] Build status: STARTED
[06:37:38.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:60:0) after 6m24s
[06:44:02.707] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:60:0)
[06:44:02.737] Build status: STARTED
[06:44:02.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:61:0) after 8m42s
[06:52:44.843] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:61:0)
[06:52:44.916] Build status: STARTED
[06:52:44.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:62:0) after 9m40s
[07:02:24.954] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:62:0)
[07:02:24.984] Build status: STARTED
[07:02:24.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:63:0) after 8m48s
[07:11:13.051] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:63:0)
[07:11:13.180] Build status: STARTED
[07:11:13.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8969695365551552128:64:0) after 9m16s
[07:19:34.194] Received PubSub notification, asking Buildbucket for the build status
[07:19:34.217] Build:
{
"id": "8804265303512607425",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 14179,
"createdBy": "project:chromium",
"createTime": "2022-09-01T01:22:07.421888462Z",
"startTime": "2022-09-01T01:23:48.766316Z",
"endTime": "2022-09-01T07:19:33.804284178Z",
"updateTime": "2022-09-01T07:19:33.804284178Z",
"status": "SUCCESS",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "56e16d8c76ab0d1939748ae168f12fe1abec8852",
"ref": "refs/heads/main"
}
}
}
[07:19:34.217] Invocation finished in 5h57m28.123765381s with status SUCCEEDED