[01:03:30.016] New invocation is queued and will start shortly
[01:03:33.491] Starting the invocation (attempt 1)
[01:03:33.516] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/06f64efd8a3ee08406444b83fc58ade1f8769d25"
[01:03:33.516] Popped gitiles commit info from properties and tags
[01:03:33.516] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:03:33.516] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:03:33.516] Buildbucket request:
{
"requestId": "8955382215163545296",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "06f64efd8a3ee08406444b83fc58ade1f8769d25",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8955382215163545296"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:03:34.000] Scheduled build:
{
"id": "8789952150697452625",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 16059,
"createdBy": "project:chromium",
"createTime": "2023-02-06T01:03:33.647814689Z",
"updateTime": "2023-02-06T01:03:33.647814689Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "06f64efd8a3ee08406444b83fc58ade1f8769d25",
"ref": "refs/heads/main"
}
},
"canary": true
}
[01:03:34.000] Task URL: https://cr-buildbucket.appspot.com/build/8789952150697452625
[01:03:34.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:2:0) after 7m34s
[01:04:34.307] Received PubSub notification, asking Buildbucket for the build status
[01:04:34.347] Build status: STARTED
[01:11:08.019] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:2:0)
[01:11:08.046] Build status: STARTED
[01:11:08.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:4:0) after 3m6s
[01:14:14.065] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:4:0)
[01:14:14.088] Build status: STARTED
[01:14:14.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:5:0) after 3m17s
[01:17:31.175] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:5:0)
[01:17:31.198] Build status: STARTED
[01:17:31.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:6:0) after 2m9s
[01:19:40.462] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:6:0)
[01:19:40.521] Build status: STARTED
[01:19:40.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:7:0) after 9m59s
[01:29:39.530] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:7:0)
[01:29:39.558] Build status: STARTED
[01:29:39.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:8:0) after 1m6s
[01:30:45.574] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:8:0)
[01:30:45.607] Build status: STARTED
[01:30:45.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:9:0) after 9m40s
[01:40:25.623] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:9:0)
[01:40:25.656] Build status: STARTED
[01:40:25.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:10:0) after 7m48s
[01:48:13.944] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:10:0)
[01:48:13.978] Build status: STARTED
[01:48:13.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:11:0) after 9m34s
[01:57:48.401] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:11:0)
[01:57:48.435] Build status: STARTED
[01:57:48.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:12:0) after 5m36s
[02:03:24.452] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:12:0)
[02:03:24.476] Build status: STARTED
[02:03:24.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:13:0) after 7m38s
[02:11:02.789] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:13:0)
[02:11:02.881] Build status: STARTED
[02:11:02.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:14:0) after 7m37s
[02:18:39.950] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:14:0)
[02:18:39.969] Build status: STARTED
[02:18:39.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:15:0) after 9m43s
[02:28:23.212] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:15:0)
[02:28:23.251] Build status: STARTED
[02:28:23.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:16:0) after 8m28s
[02:36:51.315] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:16:0)
[02:36:51.400] Build status: STARTED
[02:36:51.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:17:0) after 1m23s
[02:38:14.424] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:17:0)
[02:38:14.448] Build status: STARTED
[02:38:14.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:18:0) after 5m35s
[02:43:49.501] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:18:0)
[02:43:49.525] Build status: STARTED
[02:43:49.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:19:0) after 3m58s
[02:47:47.567] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:19:0)
[02:47:47.590] Build status: STARTED
[02:47:47.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:20:0) after 5m59s
[02:53:46.725] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:20:0)
[02:53:46.751] Build status: STARTED
[02:53:46.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:21:0) after 4m7s
[02:57:53.907] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:21:0)
[02:57:53.929] Build status: STARTED
[02:57:53.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:22:0) after 4m2s
[03:01:56.048] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:22:0)
[03:01:56.068] Build status: STARTED
[03:01:56.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:23:0) after 7m2s
[03:08:58.482] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:23:0)
[03:08:58.506] Build status: STARTED
[03:08:58.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:24:0) after 6m30s
[03:15:28.520] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:24:0)
[03:15:28.541] Build status: STARTED
[03:15:28.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:25:0) after 4m46s
[03:20:14.610] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:25:0)
[03:20:14.627] Build status: STARTED
[03:20:14.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:26:0) after 4m6s
[03:24:20.757] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:26:0)
[03:24:20.777] Build status: STARTED
[03:24:20.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:27:0) after 7m14s
[03:31:34.794] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:27:0)
[03:31:34.817] Build status: STARTED
[03:31:34.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:28:0) after 4m58s
[03:36:32.831] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:28:0)
[03:36:32.859] Build status: STARTED
[03:36:32.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:29:0) after 9m7s
[03:45:39.925] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:29:0)
[03:45:39.944] Build status: STARTED
[03:45:39.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:30:0) after 8m33s
[03:54:12.962] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:30:0)
[03:54:12.984] Build status: STARTED
[03:54:12.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:31:0) after 1m48s
[03:56:01.123] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:31:0)
[03:56:01.160] Build status: STARTED
[03:56:01.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:32:0) after 4m36s
[04:00:37.175] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:32:0)
[04:00:37.228] Build status: STARTED
[04:00:37.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:33:0) after 8m3s
[04:08:40.399] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:33:0)
[04:08:40.419] Build status: STARTED
[04:08:40.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:34:0) after 7m43s
[04:16:23.521] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:34:0)
[04:16:23.574] Build status: STARTED
[04:16:23.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:35:0) after 2m56s
[04:19:19.594] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:35:0)
[04:19:19.617] Build status: STARTED
[04:19:19.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:36:0) after 9m33s
[04:28:52.698] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:36:0)
[04:28:52.758] Build status: STARTED
[04:28:52.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:37:0) after 1m47s
[04:30:39.780] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:37:0)
[04:30:39.870] Build status: STARTED
[04:30:39.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:38:0) after 5m31s
[04:36:10.886] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:38:0)
[04:36:10.908] Build status: STARTED
[04:36:10.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:39:0) after 6m35s
[04:42:46.129] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:39:0)
[04:42:46.152] Build status: STARTED
[04:42:46.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:40:0) after 4m19s
[04:47:05.288] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:40:0)
[04:47:05.309] Build status: STARTED
[04:47:05.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:41:0) after 4m25s
[04:51:30.328] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:41:0)
[04:51:30.353] Build status: STARTED
[04:51:30.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:42:0) after 8m48s
[05:00:18.471] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:42:0)
[05:00:18.495] Build status: STARTED
[05:00:18.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:43:0) after 1m14s
[05:01:32.523] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:43:0)
[05:01:32.544] Build status: STARTED
[05:01:32.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955382215163545296:44:0) after 8m58s
[05:01:56.406] Received PubSub notification, asking Buildbucket for the build status
[05:01:56.426] Build:
{
"id": "8789952150697452625",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 16059,
"createdBy": "project:chromium",
"createTime": "2023-02-06T01:03:33.647814689Z",
"startTime": "2023-02-06T01:04:30.543075454Z",
"endTime": "2023-02-06T05:01:56.222728043Z",
"updateTime": "2023-02-06T05:01:56.222728043Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "06f64efd8a3ee08406444b83fc58ade1f8769d25",
"ref": "refs/heads/main"
}
},
"canary": true
}
[05:01:56.426] Invocation finished in 3h58m26.420972454s with status FAILED