[20:42:28.656] New invocation is queued and will start shortly
[20:42:30.222] Starting the invocation (attempt 1)
[20:42:30.260] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/11bd4c71e1f22d72e63396f8b47ec3a5ab1957c7"
[20:42:30.260] Popped gitiles commit info from properties and tags
[20:42:30.260] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:42:30.261] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:42:30.261] Buildbucket request:
{
"requestId": "8900043890816225616",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "11bd4c71e1f22d72e63396f8b47ec3a5ab1957c7",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8900043890816225616"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:42:30.957] Scheduled build:
{
"id": "8734613828411190929",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 23033,
"createdBy": "project:chromium",
"createTime": "2024-10-08T20:42:30.325788572Z",
"updateTime": "2024-10-08T20:42:30.325788572Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "11bd4c71e1f22d72e63396f8b47ec3a5ab1957c7",
"ref": "refs/heads/main"
}
}
}
[20:42:30.957] Task URL: https://cr-buildbucket.appspot.com/build/8734613828411190929
[20:42:30.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:2:0) after 5m37s
[20:42:31.383] Received PubSub notification, asking Buildbucket for the build status
[20:42:31.410] Build status: SCHEDULED
[20:43:37.280] Received PubSub notification, asking Buildbucket for the build status
[20:43:37.346] Build status: STARTED
[20:48:08.026] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:2:0)
[20:48:08.077] Build status: STARTED
[20:48:08.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:5:0) after 7m7s
[20:55:15.119] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:5:0)
[20:55:15.197] Build status: STARTED
[20:55:15.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:6:0) after 1m0s
[20:56:15.232] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:6:0)
[20:56:15.275] Build status: STARTED
[20:56:15.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:7:0) after 9m23s
[21:05:38.327] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:7:0)
[21:05:38.346] Build status: STARTED
[21:05:38.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:8:0) after 8m49s
[21:14:27.375] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:8:0)
[21:14:27.396] Build status: STARTED
[21:14:27.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:9:0) after 7m27s
[21:21:54.421] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:9:0)
[21:21:54.440] Build status: STARTED
[21:21:54.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:10:0) after 7m41s
[21:29:35.510] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:10:0)
[21:29:35.529] Build status: STARTED
[21:29:35.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:11:0) after 5m19s
[21:34:54.552] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:11:0)
[21:34:54.615] Build status: STARTED
[21:34:54.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:12:0) after 2m32s
[21:37:26.651] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:12:0)
[21:37:26.671] Build status: STARTED
[21:37:26.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:13:0) after 9m15s
[21:46:41.714] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:13:0)
[21:46:41.742] Build status: STARTED
[21:46:41.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:14:0) after 5m38s
[21:52:19.824] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:14:0)
[21:52:19.841] Build status: STARTED
[21:52:19.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:15:0) after 8m25s
[22:00:44.953] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:15:0)
[22:00:45.049] Build status: STARTED
[22:00:45.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:16:0) after 2m7s
[22:02:52.099] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:16:0)
[22:02:52.119] Build status: STARTED
[22:02:52.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:17:0) after 6m28s
[22:09:20.186] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:17:0)
[22:09:20.214] Build status: STARTED
[22:09:20.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:18:0) after 8m59s
[22:18:19.232] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:18:0)
[22:18:19.255] Build status: STARTED
[22:18:19.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:19:0) after 7m0s
[22:25:19.290] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:19:0)
[22:25:19.354] Build status: STARTED
[22:25:19.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:20:0) after 5m58s
[22:31:17.379] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:20:0)
[22:31:17.401] Build status: STARTED
[22:31:17.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:21:0) after 9m53s
[22:41:10.514] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:21:0)
[22:41:10.535] Build status: STARTED
[22:41:10.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:22:0) after 2m1s
[22:43:11.607] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:22:0)
[22:43:11.623] Build status: STARTED
[22:43:11.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:23:0) after 6m7s
[22:49:18.644] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:23:0)
[22:49:18.708] Build status: STARTED
[22:49:18.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:24:0) after 2m58s
[22:52:16.732] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:24:0)
[22:52:16.759] Build status: STARTED
[22:52:16.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:25:0) after 5m27s
[22:57:43.784] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:25:0)
[22:57:43.803] Build status: STARTED
[22:57:43.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:26:0) after 5m14s
[23:02:57.834] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:26:0)
[23:02:57.857] Build status: STARTED
[23:02:57.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:27:0) after 1m16s
[23:04:13.855] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:27:0)
[23:04:13.877] Build status: STARTED
[23:04:13.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:28:0) after 8m37s
[23:12:50.903] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:28:0)
[23:12:50.919] Build status: STARTED
[23:12:50.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:29:0) after 2m19s
[23:15:09.956] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:29:0)
[23:15:09.973] Build status: STARTED
[23:15:09.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:30:0) after 4m51s
[23:20:01.073] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:30:0)
[23:20:01.212] Build status: STARTED
[23:20:01.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:31:0) after 3m33s
[23:23:34.234] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:31:0)
[23:23:34.255] Build status: STARTED
[23:23:34.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:32:0) after 2m4s
[23:25:38.416] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:32:0)
[23:25:38.451] Build status: STARTED
[23:25:38.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:33:0) after 1m50s
[23:27:28.473] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:33:0)
[23:27:28.505] Build status: STARTED
[23:27:28.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:34:0) after 6m46s
[23:34:14.489] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:34:0)
[23:34:14.509] Build status: STARTED
[23:34:14.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:35:0) after 3m19s
[23:37:33.532] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:35:0)
[23:37:33.551] Build status: STARTED
[23:37:33.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:36:0) after 1m4s
[23:38:37.553] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:36:0)
[23:38:37.571] Build status: STARTED
[23:38:37.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:37:0) after 8m28s
[23:47:05.645] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:37:0)
[23:47:05.667] Build status: STARTED
[23:47:05.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:38:0) after 2m47s
[23:49:52.699] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:38:0)
[23:49:52.725] Build status: STARTED
[23:49:52.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:39:0) after 1m19s
[23:51:11.760] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:39:0)
[23:51:11.865] Build status: STARTED
[23:51:11.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:40:0) after 4m53s
[23:56:04.846] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:40:0)
[23:56:04.865] Build status: STARTED
[23:56:04.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:41:0) after 6m11s
[00:02:15.893] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:41:0)
[00:02:15.910] Build status: STARTED
[00:02:15.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:42:0) after 5m42s
[00:07:57.958] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:42:0)
[00:07:58.021] Build status: STARTED
[00:07:58.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:43:0) after 9m19s
[00:17:17.166] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:43:0)
[00:17:17.235] Build status: STARTED
[00:17:17.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:44:0) after 6m56s
[00:24:13.297] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:44:0)
[00:24:13.316] Build status: STARTED
[00:24:13.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:45:0) after 9m30s
[00:33:43.340] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:45:0)
[00:33:43.360] Build status: STARTED
[00:33:43.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:46:0) after 9m38s
[00:43:21.382] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:46:0)
[00:43:21.401] Build status: STARTED
[00:43:21.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:47:0) after 8m44s
[00:52:05.465] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:47:0)
[00:52:05.480] Build status: STARTED
[00:52:05.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:48:0) after 8m40s
[01:00:45.505] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:48:0)
[01:00:45.562] Build status: STARTED
[01:00:45.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900043890816225616:49:0) after 9m52s
[01:04:59.098] Received PubSub notification, asking Buildbucket for the build status
[01:04:59.119] Build:
{
"id": "8734613828411190929",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 23033,
"createdBy": "project:chromium",
"createTime": "2024-10-08T20:42:30.325788572Z",
"startTime": "2024-10-08T20:43:37.042039506Z",
"endTime": "2024-10-09T01:04:58.654453827Z",
"updateTime": "2024-10-09T01:04:58.654453827Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "11bd4c71e1f22d72e63396f8b47ec3a5ab1957c7",
"ref": "refs/heads/main"
}
}
}
[01:04:59.119] Invocation finished in 4h22m30.470954507s with status FAILED