[22:24:09.044] New invocation is queued and will start shortly
[22:24:10.320] Starting the invocation (attempt 1)
[22:24:10.353] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/8b906d5c6bc7404a173ff457d3e128cc2e4e33a3"
[22:24:10.353] Popped gitiles commit info from properties and tags
[22:24:10.353] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:24:10.353] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:24:10.354] Buildbucket request:
{
"requestId": "8916344948057021920",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8b906d5c6bc7404a173ff457d3e128cc2e4e33a3",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8916344948057021920"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:24:11.119] Scheduled build:
{
"id": "8750914885918033569",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 20364,
"createdBy": "project:chromium",
"createTime": "2024-04-11T22:24:10.450419762Z",
"updateTime": "2024-04-11T22:24:10.450419762Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8b906d5c6bc7404a173ff457d3e128cc2e4e33a3",
"ref": "refs/heads/main"
}
}
}
[22:24:11.119] Task URL: https://cr-buildbucket.appspot.com/build/8750914885918033569
[22:24:11.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:2:0) after 5m39s
[22:24:12.072] Received PubSub notification, asking Buildbucket for the build status
[22:24:12.164] Build status: SCHEDULED
[22:25:40.742] Received PubSub notification, asking Buildbucket for the build status
[22:25:40.759] Build status: STARTED
[22:29:50.143] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:2:0)
[22:29:50.164] Build status: STARTED
[22:29:50.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:5:0) after 6m52s
[22:36:42.264] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:5:0)
[22:36:42.285] Build status: STARTED
[22:36:42.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:6:0) after 7m47s
[22:44:29.318] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:6:0)
[22:44:29.340] Build status: STARTED
[22:44:29.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:7:0) after 3m38s
[22:48:07.359] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:7:0)
[22:48:07.412] Build status: STARTED
[22:48:07.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:8:0) after 1m54s
[22:50:01.487] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:8:0)
[22:50:01.529] Build status: STARTED
[22:50:01.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:9:0) after 3m43s
[22:53:44.594] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:9:0)
[22:53:44.619] Build status: STARTED
[22:53:44.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:10:0) after 4m13s
[22:57:57.657] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:10:0)
[22:57:57.680] Build status: STARTED
[22:57:57.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:11:0) after 1m59s
[22:59:56.704] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:11:0)
[22:59:56.731] Build status: STARTED
[22:59:56.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:12:0) after 9m56s
[23:09:52.825] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:12:0)
[23:09:52.855] Build status: STARTED
[23:09:52.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:13:0) after 3m23s
[23:13:15.943] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:13:0)
[23:13:15.967] Build status: STARTED
[23:13:15.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:14:0) after 5m43s
[23:18:59.017] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:14:0)
[23:18:59.054] Build status: STARTED
[23:18:59.054] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:15:0) after 6m23s
[23:25:22.087] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:15:0)
[23:25:22.105] Build status: STARTED
[23:25:22.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:16:0) after 1m15s
[23:26:37.148] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:16:0)
[23:26:37.164] Build status: STARTED
[23:26:37.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:17:0) after 9m47s
[23:36:24.169] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:17:0)
[23:36:24.229] Build status: STARTED
[23:36:24.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:18:0) after 4m27s
[23:40:51.252] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:18:0)
[23:40:51.338] Build status: STARTED
[23:40:51.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:19:0) after 9m59s
[23:50:50.485] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:19:0)
[23:50:50.526] Build status: STARTED
[23:50:50.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:20:0) after 1m34s
[23:52:24.605] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:20:0)
[23:52:24.644] Build status: STARTED
[23:52:24.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:21:0) after 4m43s
[23:57:07.748] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:21:0)
[23:57:07.766] Build status: STARTED
[23:57:07.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:22:0) after 4m46s
[00:01:53.756] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:22:0)
[00:01:53.776] Build status: STARTED
[00:01:53.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:23:0) after 4m20s
[00:06:13.899] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:23:0)
[00:06:13.923] Build status: STARTED
[00:06:13.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:24:0) after 7m26s
[00:13:39.991] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:24:0)
[00:13:40.013] Build status: STARTED
[00:13:40.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:25:0) after 4m31s
[00:18:11.090] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:25:0)
[00:18:11.108] Build status: STARTED
[00:18:11.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:26:0) after 6m42s
[00:24:53.209] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:26:0)
[00:24:53.252] Build status: STARTED
[00:24:53.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:27:0) after 5m38s
[00:30:31.278] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:27:0)
[00:30:31.303] Build status: STARTED
[00:30:31.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:28:0) after 6m45s
[00:37:16.774] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:28:0)
[00:37:16.799] Build status: STARTED
[00:37:16.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:29:0) after 1m53s
[00:39:10.038] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:29:0)
[00:39:10.060] Build status: STARTED
[00:39:10.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:30:0) after 8m41s
[00:47:51.083] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:30:0)
[00:47:51.107] Build status: STARTED
[00:47:51.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:31:0) after 5m39s
[00:53:30.150] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:31:0)
[00:53:30.175] Build status: STARTED
[00:53:30.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:32:0) after 6m53s
[01:00:23.574] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:32:0)
[01:00:23.669] Build status: STARTED
[01:00:23.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:33:0) after 1m23s
[01:01:46.831] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:33:0)
[01:01:46.894] Build status: STARTED
[01:01:46.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:34:0) after 3m5s
[01:04:51.911] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:34:0)
[01:04:51.931] Build status: STARTED
[01:04:51.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:35:0) after 4m18s
[01:09:10.005] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:35:0)
[01:09:10.026] Build status: STARTED
[01:09:10.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:36:0) after 8m48s
[01:17:58.020] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:36:0)
[01:17:58.052] Build status: STARTED
[01:17:58.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:37:0) after 4m7s
[01:22:05.090] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:37:0)
[01:22:05.120] Build status: STARTED
[01:22:05.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:38:0) after 9m29s
[01:31:34.124] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:38:0)
[01:31:34.220] Build status: STARTED
[01:31:34.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:39:0) after 5m8s
[01:36:42.299] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:39:0)
[01:36:42.323] Build status: STARTED
[01:36:42.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:40:0) after 5m16s
[01:41:58.407] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:40:0)
[01:41:58.426] Build status: STARTED
[01:41:58.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:41:0) after 4m3s
[01:46:01.452] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:41:0)
[01:46:01.473] Build status: STARTED
[01:46:01.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:42:0) after 7m28s
[01:53:29.560] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:42:0)
[01:53:29.588] Build status: STARTED
[01:53:29.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:43:0) after 9m12s
[02:02:41.626] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:43:0)
[02:02:41.657] Build status: STARTED
[02:02:41.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:44:0) after 6m56s
[02:09:37.733] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:44:0)
[02:09:37.754] Build status: STARTED
[02:09:37.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:45:0) after 7m44s
[02:17:21.846] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:45:0)
[02:17:21.960] Build status: STARTED
[02:17:21.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:46:0) after 7m33s
[02:24:54.984] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:46:0)
[02:24:55.077] Build status: STARTED
[02:24:55.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8916344948057021920:47:0) after 6m7s
[02:30:45.555] Received PubSub notification, asking Buildbucket for the build status
[02:30:45.577] Build:
{
"id": "8750914885918033569",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 20364,
"createdBy": "project:chromium",
"createTime": "2024-04-11T22:24:10.450419762Z",
"startTime": "2024-04-11T22:25:40.507169439Z",
"endTime": "2024-04-12T02:30:45.283988250Z",
"updateTime": "2024-04-12T02:30:45.283988250Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8b906d5c6bc7404a173ff457d3e128cc2e4e33a3",
"ref": "refs/heads/main"
}
}
}
[02:30:45.577] Invocation finished in 4h6m36.549238048s with status FAILED