[11:14:02.202] New invocation is queued and will start shortly
[11:14:04.916] Starting the invocation (attempt 1)
[11:14:04.959] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9c5c55455412848412e40c50cb1c9e044978c502"
[11:14:04.959] Popped gitiles commit info from properties and tags
[11:14:04.959] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[11:14:04.959] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[11:14:04.959] Buildbucket request:
{
"requestId": "8981616923792498224",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9c5c55455412848412e40c50cb1c9e044978c502",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8981616923792498224"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[11:14:05.534] Scheduled build:
{
"id": "8816186860127185377",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 15975,
"createdBy": "project:chromium",
"createTime": "2022-04-22T11:14:05.066632363Z",
"updateTime": "2022-04-22T11:14:05.066632363Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9c5c55455412848412e40c50cb1c9e044978c502",
"ref": "refs/heads/main"
}
}
}
[11:14:05.534] Task URL: https://cr-buildbucket.appspot.com/build/8816186860127185377
[11:14:05.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:2:0) after 6m29s
[11:15:36.160] Received PubSub notification, asking Buildbucket for the build status
[11:15:36.185] Build status: STARTED
[11:20:34.661] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:2:0)
[11:20:34.681] Build status: STARTED
[11:20:34.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:4:0) after 3m23s
[11:23:58.075] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:4:0)
[11:23:58.094] Build status: STARTED
[11:23:58.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:5:0) after 2m49s
[11:26:47.110] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:5:0)
[11:26:47.130] Build status: STARTED
[11:26:47.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:6:0) after 8m11s
[11:34:58.729] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:6:0)
[11:34:58.764] Build status: STARTED
[11:34:58.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:7:0) after 2m15s
[11:37:13.809] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:7:0)
[11:37:13.841] Build status: STARTED
[11:37:13.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:8:0) after 4m23s
[11:41:36.866] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:8:0)
[11:41:36.898] Build status: STARTED
[11:41:36.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:9:0) after 7m29s
[11:49:05.918] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:9:0)
[11:49:05.937] Build status: STARTED
[11:49:05.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:10:0) after 6m18s
[11:55:23.933] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:10:0)
[11:55:23.959] Build status: STARTED
[11:55:23.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:11:0) after 3m51s
[11:59:15.165] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:11:0)
[11:59:15.188] Build status: STARTED
[11:59:15.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:12:0) after 6m46s
[12:06:01.210] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:12:0)
[12:06:01.263] Build status: STARTED
[12:06:01.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:13:0) after 1m28s
[12:07:29.297] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:13:0)
[12:07:29.315] Build status: STARTED
[12:07:29.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:14:0) after 7m38s
[12:15:07.428] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:14:0)
[12:15:07.449] Build status: STARTED
[12:15:07.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:15:0) after 5m55s
[12:21:02.688] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:15:0)
[12:21:02.711] Build status: STARTED
[12:21:02.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:16:0) after 3m26s
[12:24:28.729] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:16:0)
[12:24:28.758] Build status: STARTED
[12:24:28.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:17:0) after 4m35s
[12:29:03.780] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:17:0)
[12:29:03.812] Build status: STARTED
[12:29:03.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:18:0) after 7m34s
[12:36:37.948] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:18:0)
[12:36:37.969] Build status: STARTED
[12:36:37.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:19:0) after 9m57s
[12:46:34.990] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:19:0)
[12:46:35.017] Build status: STARTED
[12:46:35.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:20:0) after 9m16s
[12:55:51.109] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:20:0)
[12:55:51.147] Build status: STARTED
[12:55:51.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:21:0) after 6m23s
[13:02:14.339] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:21:0)
[13:02:14.368] Build status: STARTED
[13:02:14.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:22:0) after 8m29s
[13:10:43.625] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:22:0)
[13:10:43.650] Build status: STARTED
[13:10:43.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:23:0) after 2m30s
[13:13:13.821] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:23:0)
[13:13:13.843] Build status: STARTED
[13:13:13.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:24:0) after 8m28s
[13:21:42.014] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:24:0)
[13:21:42.035] Build status: STARTED
[13:21:42.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:25:0) after 8m51s
[13:30:33.037] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:25:0)
[13:30:33.066] Build status: STARTED
[13:30:33.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:26:0) after 8m13s
[13:38:46.097] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:26:0)
[13:38:46.129] Build status: STARTED
[13:38:46.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:27:0) after 2m37s
[13:41:23.316] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:27:0)
[13:41:23.344] Build status: STARTED
[13:41:23.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:28:0) after 4m14s
[13:45:37.472] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:28:0)
[13:45:37.505] Build status: STARTED
[13:45:37.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:29:0) after 5m13s
[13:50:50.529] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:29:0)
[13:50:50.550] Build status: STARTED
[13:50:50.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:30:0) after 4m45s
[13:55:35.620] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:30:0)
[13:55:35.751] Build status: STARTED
[13:55:35.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:31:0) after 8m35s
[14:04:10.991] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:31:0)
[14:04:11.012] Build status: STARTED
[14:04:11.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:32:0) after 4m27s
[14:08:38.052] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:32:0)
[14:08:38.076] Build status: STARTED
[14:08:38.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:33:0) after 4m10s
[14:12:48.109] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:33:0)
[14:12:48.164] Build status: STARTED
[14:12:48.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:34:0) after 9m15s
[14:22:03.352] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:34:0)
[14:22:03.374] Build status: STARTED
[14:22:03.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:35:0) after 5m34s
[14:27:37.396] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:35:0)
[14:27:37.418] Build status: STARTED
[14:27:37.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:36:0) after 5m45s
[14:33:22.514] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:36:0)
[14:33:22.537] Build status: STARTED
[14:33:22.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:37:0) after 8m9s
[14:41:31.559] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:37:0)
[14:41:31.598] Build status: STARTED
[14:41:31.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:38:0) after 5m32s
[14:47:03.628] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:38:0)
[14:47:03.651] Build status: STARTED
[14:47:03.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:39:0) after 9m35s
[14:56:38.734] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:39:0)
[14:56:38.756] Build status: STARTED
[14:56:38.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:40:0) after 7m13s
[15:03:51.787] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:40:0)
[15:03:51.807] Build status: STARTED
[15:03:51.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:41:0) after 1m49s
[15:05:40.930] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:41:0)
[15:05:40.961] Build status: STARTED
[15:05:40.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:42:0) after 6m24s
[15:12:05.071] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:42:0)
[15:12:05.101] Build status: STARTED
[15:12:05.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:43:0) after 7m5s
[15:19:10.125] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:43:0)
[15:19:10.152] Build status: STARTED
[15:19:10.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:44:0) after 2m13s
[15:21:23.181] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:44:0)
[15:21:23.245] Build status: STARTED
[15:21:23.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:45:0) after 6m20s
[15:27:43.269] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:45:0)
[15:27:43.289] Build status: STARTED
[15:27:43.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:46:0) after 6m49s
[15:34:32.689] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:46:0)
[15:34:32.726] Build status: STARTED
[15:34:32.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:47:0) after 8m36s
[15:43:09.396] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:47:0)
[15:43:09.423] Build status: STARTED
[15:43:09.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:48:0) after 3m22s
[15:46:31.581] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:48:0)
[15:46:31.607] Build status: STARTED
[15:46:31.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:49:0) after 6m6s
[15:52:37.630] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:49:0)
[15:52:37.664] Build status: STARTED
[15:52:37.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:50:0) after 3m32s
[15:56:09.756] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:50:0)
[15:56:09.776] Build status: STARTED
[15:56:09.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:51:0) after 1m15s
[15:57:25.048] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:51:0)
[15:57:25.074] Build status: STARTED
[15:57:25.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:52:0) after 8m0s
[16:05:25.393] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:52:0)
[16:05:25.438] Build status: STARTED
[16:05:25.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:53:0) after 1m11s
[16:06:36.688] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:53:0)
[16:06:36.715] Build status: STARTED
[16:06:36.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:54:0) after 5m52s
[16:12:28.723] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:54:0)
[16:12:28.764] Build status: STARTED
[16:12:28.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:55:0) after 7m3s
[16:19:31.789] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:55:0)
[16:19:31.808] Build status: STARTED
[16:19:31.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:56:0) after 5m59s
[16:25:30.931] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:56:0)
[16:25:30.961] Build status: STARTED
[16:25:30.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:57:0) after 9m21s
[16:34:51.984] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:57:0)
[16:34:52.005] Build status: STARTED
[16:34:52.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:58:0) after 6m38s
[16:41:30.179] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:58:0)
[16:41:30.200] Build status: STARTED
[16:41:30.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:59:0) after 3m55s
[16:45:25.522] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:59:0)
[16:45:25.556] Build status: STARTED
[16:45:25.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:60:0) after 4m22s
[16:49:47.895] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:60:0)
[16:49:47.934] Build status: STARTED
[16:49:47.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:61:0) after 7m54s
[16:57:42.266] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:61:0)
[16:57:42.297] Build status: STARTED
[16:57:42.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:62:0) after 5m45s
[17:03:27.336] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:62:0)
[17:03:27.360] Build status: STARTED
[17:03:27.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981616923792498224:63:0) after 2m59s
[17:06:14.436] Received PubSub notification, asking Buildbucket for the build status
[17:06:14.465] Build:
{
"id": "8816186860127185377",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 15975,
"createdBy": "project:chromium",
"createTime": "2022-04-22T11:14:05.066632363Z",
"startTime": "2022-04-22T11:15:35.595745Z",
"endTime": "2022-04-22T17:06:14.086082285Z",
"updateTime": "2022-04-22T17:06:14.086082285Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9c5c55455412848412e40c50cb1c9e044978c502",
"ref": "refs/heads/main"
}
}
}
[17:06:14.465] Invocation finished in 5h52m12.278049728s with status FAILED