[01:42:10.283] New invocation is queued and will start shortly
[01:42:11.437] Starting the invocation (attempt 1)
[01:42:11.468] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/fa18beb4eb7cdaf1095e06c855e9190e1a02e391"
[01:42:11.468] Popped gitiles commit info from properties and tags
[01:42:11.468] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:42:11.468] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:42:11.469] Buildbucket request:
{
"requestId": "8900387423581460816",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fa18beb4eb7cdaf1095e06c855e9190e1a02e391",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8900387423581460816"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:42:12.348] Scheduled build:
{
"id": "8734957361609192529",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 22998,
"createdBy": "project:chromium",
"createTime": "2024-10-05T01:42:11.537670527Z",
"updateTime": "2024-10-05T01:42:11.537670527Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fa18beb4eb7cdaf1095e06c855e9190e1a02e391",
"ref": "refs/heads/main"
}
}
}
[01:42:12.349] Task URL: https://cr-buildbucket.appspot.com/build/8734957361609192529
[01:42:12.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:2:0) after 1m40s
[01:42:12.997] Received PubSub notification, asking Buildbucket for the build status
[01:42:13.045] Build status: SCHEDULED
[01:42:20.261] Received PubSub notification, asking Buildbucket for the build status
[01:42:20.313] Build status: STARTED
[01:43:52.467] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:2:0)
[01:43:52.490] Build status: STARTED
[01:43:52.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:5:0) after 9m15s
[01:53:07.515] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:5:0)
[01:53:07.550] Build status: STARTED
[01:53:07.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:6:0) after 3m4s
[01:56:11.669] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:6:0)
[01:56:11.697] Build status: STARTED
[01:56:11.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:7:0) after 8m48s
[02:04:59.783] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:7:0)
[02:04:59.841] Build status: STARTED
[02:04:59.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:8:0) after 9m16s
[02:14:15.908] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:8:0)
[02:14:15.928] Build status: STARTED
[02:14:15.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:9:0) after 8m36s
[02:22:51.957] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:9:0)
[02:22:51.977] Build status: STARTED
[02:22:51.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:10:0) after 8m21s
[02:31:13.047] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:10:0)
[02:31:13.078] Build status: STARTED
[02:31:13.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:11:0) after 4m4s
[02:35:17.096] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:11:0)
[02:35:17.114] Build status: STARTED
[02:35:17.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:12:0) after 5m29s
[02:40:46.297] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:12:0)
[02:40:46.315] Build status: STARTED
[02:40:46.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:13:0) after 7m46s
[02:48:32.487] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:13:0)
[02:48:32.650] Build status: STARTED
[02:48:32.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:14:0) after 9m58s
[02:58:30.753] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:14:0)
[02:58:30.787] Build status: STARTED
[02:58:30.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:15:0) after 7m50s
[03:06:20.813] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:15:0)
[03:06:20.928] Build status: STARTED
[03:06:20.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:16:0) after 4m52s
[03:11:12.992] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:16:0)
[03:11:13.013] Build status: STARTED
[03:11:13.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:17:0) after 3m30s
[03:14:43.272] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:17:0)
[03:14:43.292] Build status: STARTED
[03:14:43.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:18:0) after 4m26s
[03:19:09.305] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:18:0)
[03:19:09.385] Build status: STARTED
[03:19:09.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:19:0) after 7m42s
[03:26:51.402] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:19:0)
[03:26:51.419] Build status: STARTED
[03:26:51.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:20:0) after 5m46s
[03:32:37.466] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:20:0)
[03:32:37.545] Build status: STARTED
[03:32:37.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:21:0) after 9m1s
[03:41:38.562] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:21:0)
[03:41:38.578] Build status: STARTED
[03:41:38.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:22:0) after 2m39s
[03:44:17.664] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:22:0)
[03:44:17.768] Build status: STARTED
[03:44:17.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:23:0) after 9m4s
[03:53:21.927] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:23:0)
[03:53:21.946] Build status: STARTED
[03:53:21.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:24:0) after 9m40s
[04:03:01.968] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:24:0)
[04:03:01.987] Build status: STARTED
[04:03:01.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:25:0) after 1m59s
[04:05:01.013] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:25:0)
[04:05:01.032] Build status: STARTED
[04:05:01.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:26:0) after 5m39s
[04:10:40.048] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:26:0)
[04:10:40.065] Build status: STARTED
[04:10:40.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:27:0) after 3m17s
[04:13:57.567] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:27:0)
[04:13:57.588] Build status: STARTED
[04:13:57.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:28:0) after 9m8s
[04:23:05.582] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:28:0)
[04:23:05.726] Build status: STARTED
[04:23:05.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:29:0) after 1m58s
[04:25:04.004] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:29:0)
[04:25:04.027] Build status: STARTED
[04:25:04.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:30:0) after 5m49s
[04:30:53.056] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:30:0)
[04:30:53.073] Build status: STARTED
[04:30:53.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:31:0) after 8m30s
[04:39:23.100] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:31:0)
[04:39:23.118] Build status: STARTED
[04:39:23.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:32:0) after 7m25s
[04:46:48.149] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:32:0)
[04:46:48.172] Build status: STARTED
[04:46:48.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:33:0) after 2m37s
[04:49:25.197] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:33:0)
[04:49:25.215] Build status: STARTED
[04:49:25.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:34:0) after 4m19s
[04:53:44.557] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:34:0)
[04:53:44.575] Build status: STARTED
[04:53:44.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:35:0) after 6m19s
[05:00:03.892] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:35:0)
[05:00:03.909] Build status: STARTED
[05:00:03.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:36:0) after 9m58s
[05:10:01.928] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:36:0)
[05:10:01.991] Build status: STARTED
[05:10:01.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:37:0) after 1m24s
[05:11:25.978] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:37:0)
[05:11:25.994] Build status: STARTED
[05:11:25.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:38:0) after 4m18s
[05:15:44.216] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:38:0)
[05:15:44.230] Build status: STARTED
[05:15:44.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:39:0) after 4m11s
[05:19:55.304] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:39:0)
[05:19:55.322] Build status: STARTED
[05:19:55.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:40:0) after 8m16s
[05:28:11.839] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:40:0)
[05:28:11.855] Build status: STARTED
[05:28:11.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:41:0) after 6m21s
[05:34:32.992] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:41:0)
[05:34:33.009] Build status: STARTED
[05:34:33.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:42:0) after 1m47s
[05:36:20.045] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:42:0)
[05:36:20.125] Build status: STARTED
[05:36:20.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:43:0) after 9m17s
[05:45:37.198] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:43:0)
[05:45:37.221] Build status: STARTED
[05:45:37.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:44:0) after 2m7s
[05:47:44.308] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:44:0)
[05:47:44.356] Build status: STARTED
[05:47:44.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:45:0) after 6m36s
[05:54:20.373] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:45:0)
[05:54:20.391] Build status: STARTED
[05:54:20.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:46:0) after 4m58s
[05:59:18.409] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:46:0)
[05:59:18.499] Build status: STARTED
[05:59:18.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900387423581460816:47:0) after 7m29s
[06:06:06.951] Received PubSub notification, asking Buildbucket for the build status
[06:06:06.971] Build:
{
"id": "8734957361609192529",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 22998,
"createdBy": "project:chromium",
"createTime": "2024-10-05T01:42:11.537670527Z",
"startTime": "2024-10-05T01:42:20.065752900Z",
"endTime": "2024-10-05T06:06:05.263078534Z",
"updateTime": "2024-10-05T06:06:05.263078534Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fa18beb4eb7cdaf1095e06c855e9190e1a02e391",
"ref": "refs/heads/main"
}
}
}
[06:06:06.971] Invocation finished in 4h23m56.698590825s with status FAILED