[14:21:56.890] New invocation is queued and will start shortly
[14:21:57.959] Starting the invocation (attempt 1)
[14:21:57.990] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/0b419ee486121e91b1f1566b56c4f0fb770e51fd"
[14:21:57.990] Popped gitiles commit info from properties and tags
[14:21:57.990] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:21:57.990] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:21:57.990] Buildbucket request:
{
"requestId": "8955331981161392128",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0b419ee486121e91b1f1566b56c4f0fb770e51fd",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8955331981161392128"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:21:58.855] Scheduled build:
{
"id": "8789901919172390289",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 19105,
"createdBy": "project:chromium",
"createTime": "2023-02-06T14:21:58.163305255Z",
"updateTime": "2023-02-06T14:21:58.163305255Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0b419ee486121e91b1f1566b56c4f0fb770e51fd",
"ref": "refs/heads/main"
}
}
}
[14:21:58.855] Task URL: https://cr-buildbucket.appspot.com/build/8789901919172390289
[14:21:58.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:2:0) after 6m11s
[14:23:18.562] Received PubSub notification, asking Buildbucket for the build status
[14:23:18.588] Build status: STARTED
[14:28:09.880] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:2:0)
[14:28:09.898] Build status: STARTED
[14:28:09.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:4:0) after 4m1s
[14:32:10.980] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:4:0)
[14:32:11.011] Build status: STARTED
[14:32:11.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:5:0) after 1m54s
[14:34:05.041] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:5:0)
[14:34:05.110] Build status: STARTED
[14:34:05.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:6:0) after 2m6s
[14:36:11.191] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:6:0)
[14:36:11.214] Build status: STARTED
[14:36:11.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:7:0) after 1m18s
[14:37:30.125] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:7:0)
[14:37:30.149] Build status: STARTED
[14:37:30.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:8:0) after 1m55s
[14:39:25.394] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:8:0)
[14:39:25.419] Build status: STARTED
[14:39:25.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:9:0) after 7m9s
[14:46:34.547] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:9:0)
[14:46:34.568] Build status: STARTED
[14:46:34.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:10:0) after 3m15s
[14:49:49.799] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:10:0)
[14:49:49.818] Build status: STARTED
[14:49:49.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:11:0) after 9m40s
[14:59:29.815] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:11:0)
[14:59:29.838] Build status: STARTED
[14:59:29.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:12:0) after 5m55s
[15:05:24.860] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:12:0)
[15:05:24.957] Build status: STARTED
[15:05:24.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:13:0) after 8m25s
[15:13:49.976] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:13:0)
[15:13:49.997] Build status: STARTED
[15:13:49.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:14:0) after 1m35s
[15:15:25.019] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:14:0)
[15:15:25.045] Build status: STARTED
[15:15:25.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:15:0) after 7m43s
[15:23:08.191] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:15:0)
[15:23:08.214] Build status: STARTED
[15:23:08.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:16:0) after 2m21s
[15:25:29.227] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:16:0)
[15:25:29.251] Build status: STARTED
[15:25:29.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:17:0) after 4m48s
[15:30:17.457] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:17:0)
[15:30:17.498] Build status: STARTED
[15:30:17.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:18:0) after 3m1s
[15:33:18.529] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:18:0)
[15:33:18.549] Build status: STARTED
[15:33:18.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:19:0) after 1m52s
[15:35:10.634] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:19:0)
[15:35:10.743] Build status: STARTED
[15:35:10.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:20:0) after 9m39s
[15:44:49.961] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:20:0)
[15:44:49.981] Build status: STARTED
[15:44:49.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:21:0) after 8m25s
[15:53:15.138] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:21:0)
[15:53:15.173] Build status: STARTED
[15:53:15.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:22:0) after 4m13s
[15:57:28.403] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:22:0)
[15:57:28.425] Build status: STARTED
[15:57:28.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:23:0) after 2m18s
[15:59:46.553] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:23:0)
[15:59:46.577] Build status: STARTED
[15:59:46.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:24:0) after 2m52s
[16:02:38.880] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:24:0)
[16:02:38.907] Build status: STARTED
[16:02:38.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:25:0) after 9m5s
[16:11:43.934] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:25:0)
[16:11:43.974] Build status: STARTED
[16:11:43.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:26:0) after 8m1s
[16:19:45.167] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:26:0)
[16:19:45.345] Build status: STARTED
[16:19:45.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:27:0) after 7m53s
[16:27:38.498] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:27:0)
[16:27:38.520] Build status: STARTED
[16:27:38.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:28:0) after 1m29s
[16:29:07.545] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:28:0)
[16:29:07.569] Build status: STARTED
[16:29:07.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:29:0) after 9m31s
[16:38:38.715] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:29:0)
[16:38:38.750] Build status: STARTED
[16:38:38.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:30:0) after 3m17s
[16:41:55.958] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:30:0)
[16:41:55.979] Build status: STARTED
[16:41:55.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:31:0) after 2m39s
[16:44:35.014] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:31:0)
[16:44:35.042] Build status: STARTED
[16:44:35.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:32:0) after 1m45s
[16:46:20.114] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:32:0)
[16:46:20.133] Build status: STARTED
[16:46:20.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:33:0) after 1m22s
[16:47:42.117] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:33:0)
[16:47:42.138] Build status: STARTED
[16:47:42.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:34:0) after 9m49s
[16:57:31.368] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:34:0)
[16:57:31.433] Build status: STARTED
[16:57:31.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:35:0) after 2m59s
[17:00:30.560] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:35:0)
[17:00:30.588] Build status: STARTED
[17:00:30.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:36:0) after 1m29s
[17:01:59.636] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:36:0)
[17:01:59.659] Build status: STARTED
[17:01:59.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:37:0) after 3m55s
[17:05:54.727] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:37:0)
[17:05:54.774] Build status: STARTED
[17:05:54.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:38:0) after 4m31s
[17:10:25.915] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:38:0)
[17:10:25.981] Build status: STARTED
[17:10:25.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:39:0) after 2m19s
[17:12:45.209] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:39:0)
[17:12:45.245] Build status: STARTED
[17:12:45.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:40:0) after 2m18s
[17:15:03.332] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:40:0)
[17:15:03.439] Build status: STARTED
[17:15:03.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:41:0) after 8m55s
[17:23:58.642] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:41:0)
[17:23:58.667] Build status: STARTED
[17:23:58.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:42:0) after 2m32s
[17:26:30.688] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:42:0)
[17:26:30.714] Build status: STARTED
[17:26:30.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:43:0) after 9m40s
[17:36:11.089] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:43:0)
[17:36:11.112] Build status: STARTED
[17:36:11.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:44:0) after 1m52s
[17:38:03.248] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:44:0)
[17:38:03.269] Build status: STARTED
[17:38:03.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:45:0) after 8m15s
[17:46:18.391] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:45:0)
[17:46:18.411] Build status: STARTED
[17:46:18.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:46:0) after 4m39s
[17:50:57.425] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:46:0)
[17:50:57.447] Build status: STARTED
[17:50:57.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:47:0) after 1m1s
[17:51:58.602] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:47:0)
[17:51:58.622] Build status: STARTED
[17:51:58.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:48:0) after 3m19s
[17:55:17.990] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:48:0)
[17:55:18.058] Build status: STARTED
[17:55:18.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:49:0) after 5m44s
[18:01:02.124] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:49:0)
[18:01:02.151] Build status: STARTED
[18:01:02.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:50:0) after 9m33s
[18:10:36.274] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:50:0)
[18:10:36.304] Build status: STARTED
[18:10:36.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:51:0) after 9m39s
[18:20:15.534] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:51:0)
[18:20:15.561] Build status: STARTED
[18:20:15.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:52:0) after 9m45s
[18:30:00.675] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:52:0)
[18:30:00.722] Build status: STARTED
[18:30:00.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:53:0) after 5m59s
[18:35:59.759] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:53:0)
[18:35:59.784] Build status: STARTED
[18:35:59.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:54:0) after 3m35s
[18:39:34.819] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:54:0)
[18:39:34.845] Build status: STARTED
[18:39:34.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:55:0) after 6m55s
[18:46:29.907] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:55:0)
[18:46:29.933] Build status: STARTED
[18:46:29.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955331981161392128:56:0) after 5m13s
[18:51:02.019] Received PubSub notification, asking Buildbucket for the build status
[18:51:02.123] Build:
{
"id": "8789901919172390289",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 19105,
"createdBy": "project:chromium",
"createTime": "2023-02-06T14:21:58.163305255Z",
"startTime": "2023-02-06T14:23:17.533205Z",
"endTime": "2023-02-06T18:51:01.688735599Z",
"updateTime": "2023-02-06T18:51:01.688735599Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0b419ee486121e91b1f1566b56c4f0fb770e51fd",
"ref": "refs/heads/main"
}
}
}
[18:51:02.123] Invocation finished in 4h29m5.241422834s with status FAILED