[15:11:58.923] New invocation is queued and will start shortly
[15:12:00.195] Starting the invocation (attempt 1)
[15:12:00.228] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/982fe7290d507839408983a8b9c2241b81e99b82"
[15:12:00.228] Popped gitiles commit info from properties and tags
[15:12:00.228] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:12:00.229] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:12:00.229] Buildbucket request:
{
"requestId": "8955238236334662576",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "982fe7290d507839408983a8b9c2241b81e99b82",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8955238236334662576"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:12:00.801] Scheduled build:
{
"id": "8789808174175484737",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 19111,
"createdBy": "project:chromium",
"createTime": "2023-02-07T15:12:00.359885777Z",
"updateTime": "2023-02-07T15:12:00.359885777Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "982fe7290d507839408983a8b9c2241b81e99b82",
"ref": "refs/heads/main"
}
}
}
[15:12:00.801] Task URL: https://cr-buildbucket.appspot.com/build/8789808174175484737
[15:12:00.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:2:0) after 1m51s
[15:13:08.329] Received PubSub notification, asking Buildbucket for the build status
[15:13:08.415] Build status: STARTED
[15:13:51.959] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:2:0)
[15:13:51.982] Build status: STARTED
[15:13:51.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:4:0) after 7m5s
[15:20:56.999] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:4:0)
[15:20:57.028] Build status: STARTED
[15:20:57.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:5:0) after 1m38s
[15:22:35.041] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:5:0)
[15:22:35.062] Build status: STARTED
[15:22:35.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:6:0) after 4m26s
[15:27:01.153] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:6:0)
[15:27:01.172] Build status: STARTED
[15:27:01.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:7:0) after 3m47s
[15:30:48.191] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:7:0)
[15:30:48.213] Build status: STARTED
[15:30:48.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:8:0) after 2m58s
[15:33:46.305] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:8:0)
[15:33:46.325] Build status: STARTED
[15:33:46.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:9:0) after 5m35s
[15:39:21.353] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:9:0)
[15:39:21.378] Build status: STARTED
[15:39:21.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:10:0) after 3m48s
[15:43:09.781] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:10:0)
[15:43:09.812] Build status: STARTED
[15:43:09.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:11:0) after 8m26s
[15:51:35.983] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:11:0)
[15:51:36.003] Build status: STARTED
[15:51:36.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:12:0) after 8m13s
[15:59:49.124] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:12:0)
[15:59:49.146] Build status: STARTED
[15:59:49.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:13:0) after 1m50s
[16:01:39.278] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:13:0)
[16:01:39.302] Build status: STARTED
[16:01:39.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:14:0) after 4m20s
[16:05:59.427] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:14:0)
[16:05:59.473] Build status: STARTED
[16:05:59.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:15:0) after 8m10s
[16:14:09.496] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:15:0)
[16:14:09.516] Build status: STARTED
[16:14:09.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:16:0) after 2m37s
[16:16:46.776] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:16:0)
[16:16:46.805] Build status: STARTED
[16:16:46.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:17:0) after 1m33s
[16:18:19.864] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:17:0)
[16:18:19.886] Build status: STARTED
[16:18:19.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:18:0) after 1m11s
[16:19:31.052] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:18:0)
[16:19:31.071] Build status: STARTED
[16:19:31.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:19:0) after 9m20s
[16:28:51.216] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:19:0)
[16:28:51.235] Build status: STARTED
[16:28:51.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:20:0) after 8m14s
[16:37:05.252] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:20:0)
[16:37:05.277] Build status: STARTED
[16:37:05.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:21:0) after 6m0s
[16:43:05.463] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:21:0)
[16:43:05.483] Build status: STARTED
[16:43:05.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:22:0) after 6m7s
[16:49:12.535] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:22:0)
[16:49:12.554] Build status: STARTED
[16:49:12.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:23:0) after 4m27s
[16:53:39.575] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:23:0)
[16:53:39.597] Build status: STARTED
[16:53:39.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:24:0) after 8m19s
[17:01:58.634] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:24:0)
[17:01:58.664] Build status: STARTED
[17:01:58.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:25:0) after 1m37s
[17:03:35.841] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:25:0)
[17:03:35.883] Build status: STARTED
[17:03:35.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:26:0) after 2m54s
[17:06:29.904] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:26:0)
[17:06:29.924] Build status: STARTED
[17:06:29.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:27:0) after 5m34s
[17:12:03.950] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:27:0)
[17:12:03.969] Build status: STARTED
[17:12:03.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:28:0) after 9m2s
[17:21:06.176] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:28:0)
[17:21:06.195] Build status: STARTED
[17:21:06.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:29:0) after 7m20s
[17:28:26.819] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:29:0)
[17:28:26.842] Build status: STARTED
[17:28:26.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:30:0) after 1m48s
[17:30:15.270] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:30:0)
[17:30:15.324] Build status: STARTED
[17:30:15.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:31:0) after 8m58s
[17:39:13.768] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:31:0)
[17:39:13.797] Build status: STARTED
[17:39:13.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:32:0) after 1m45s
[17:40:59.010] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:32:0)
[17:40:59.041] Build status: STARTED
[17:40:59.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:33:0) after 6m27s
[17:47:26.161] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:33:0)
[17:47:26.189] Build status: STARTED
[17:47:26.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:34:0) after 4m35s
[17:52:01.284] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:34:0)
[17:52:01.306] Build status: STARTED
[17:52:01.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:35:0) after 7m6s
[17:59:07.618] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:35:0)
[17:59:07.638] Build status: STARTED
[17:59:07.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:36:0) after 5m47s
[18:04:54.927] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:36:0)
[18:04:54.966] Build status: STARTED
[18:04:54.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:37:0) after 2m16s
[18:07:11.110] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:37:0)
[18:07:11.130] Build status: STARTED
[18:07:11.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:38:0) after 4m46s
[18:11:57.324] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:38:0)
[18:11:57.343] Build status: STARTED
[18:11:57.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:39:0) after 9m3s
[18:21:00.455] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:39:0)
[18:21:00.478] Build status: STARTED
[18:21:00.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:40:0) after 7m56s
[18:28:56.536] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:40:0)
[18:28:56.563] Build status: STARTED
[18:28:56.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:41:0) after 5m55s
[18:34:51.980] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:41:0)
[18:34:52.022] Build status: STARTED
[18:34:52.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:42:0) after 8m3s
[18:42:55.044] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:42:0)
[18:42:55.111] Build status: STARTED
[18:42:55.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:43:0) after 2m26s
[18:45:21.151] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:43:0)
[18:45:21.170] Build status: STARTED
[18:45:21.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:44:0) after 5m24s
[18:50:45.144] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:44:0)
[18:50:45.180] Build status: STARTED
[18:50:45.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:45:0) after 1m16s
[18:52:01.469] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:45:0)
[18:52:01.505] Build status: STARTED
[18:52:01.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:46:0) after 2m44s
[18:54:45.481] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:46:0)
[18:54:45.561] Build status: STARTED
[18:54:45.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:47:0) after 4m28s
[18:59:13.632] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:47:0)
[18:59:13.655] Build status: STARTED
[18:59:13.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:48:0) after 5m49s
[19:05:03.103] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:48:0)
[19:05:03.134] Build status: STARTED
[19:05:03.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:49:0) after 9m12s
[19:14:15.173] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:49:0)
[19:14:15.296] Build status: STARTED
[19:14:15.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:50:0) after 1m15s
[19:15:30.865] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:50:0)
[19:15:30.929] Build status: STARTED
[19:15:30.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:51:0) after 7m7s
[19:22:38.079] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:51:0)
[19:22:38.142] Build status: STARTED
[19:22:38.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:52:0) after 9m42s
[19:32:20.168] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:52:0)
[19:32:20.258] Build status: STARTED
[19:32:20.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:53:0) after 4m33s
[19:36:53.313] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:53:0)
[19:36:53.337] Build status: STARTED
[19:36:53.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:54:0) after 4m11s
[19:41:04.360] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:54:0)
[19:41:04.383] Build status: STARTED
[19:41:04.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:55:0) after 5m2s
[19:46:06.414] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:55:0)
[19:46:06.439] Build status: STARTED
[19:46:06.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:56:0) after 5m58s
[19:52:04.526] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:56:0)
[19:52:04.557] Build status: STARTED
[19:52:04.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:57:0) after 7m8s
[19:59:12.662] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:57:0)
[19:59:12.715] Build status: STARTED
[19:59:12.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8955238236334662576:58:0) after 9m11s
[20:06:59.613] Received PubSub notification, asking Buildbucket for the build status
[20:06:59.682] Build:
{
"id": "8789808174175484737",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 19111,
"createdBy": "project:chromium",
"createTime": "2023-02-07T15:12:00.359885777Z",
"startTime": "2023-02-07T15:13:06.627190Z",
"endTime": "2023-02-07T20:06:59.192491230Z",
"updateTime": "2023-02-07T20:06:59.192491230Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "982fe7290d507839408983a8b9c2241b81e99b82",
"ref": "refs/heads/main"
}
}
}
[20:06:59.682] Invocation finished in 4h55m0.765926715s with status FAILED