[08:39:53.100] New invocation is queued and will start shortly
[08:39:54.182] Starting the invocation (attempt 1)
[08:39:54.221] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/3b4011e6b40c4ab15894623d15a1a1ee4a36e1ee"
[08:39:54.221] Popped gitiles commit info from properties and tags
[08:39:54.221] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:39:54.221] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:39:54.221] Buildbucket request:
{
"requestId": "9009711681763118096",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3b4011e6b40c4ab15894623d15a1a1ee4a36e1ee",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9009711681763118096"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:39:55.338] Scheduled build:
{
"id": "8844281619778459888",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 13684,
"createdBy": "project:chromium",
"createTime": "2021-06-16T08:39:54.361537Z",
"updateTime": "2021-06-16T08:39:55.252724Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3b4011e6b40c4ab15894623d15a1a1ee4a36e1ee",
"ref": "refs/heads/main"
}
}
}
[08:39:55.338] Task URL: https://cr-buildbucket.appspot.com/build/8844281619778459888
[08:39:55.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:2:0) after 6m19s
[08:42:21.649] Received PubSub notification, asking Buildbucket for the build status
[08:42:21.679] Build status: STARTED
[08:46:14.739] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:2:0)
[08:46:14.766] Build status: STARTED
[08:46:14.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:4:0) after 1m45s
[08:47:59.951] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:4:0)
[08:48:00.012] Build status: STARTED
[08:48:00.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:5:0) after 5m53s
[08:53:53.032] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:5:0)
[08:53:53.058] Build status: STARTED
[08:53:53.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:6:0) after 5m37s
[08:59:30.277] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:6:0)
[08:59:30.308] Build status: STARTED
[08:59:30.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:7:0) after 6m43s
[09:06:13.357] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:7:0)
[09:06:13.388] Build status: STARTED
[09:06:13.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:8:0) after 5m8s
[09:11:21.466] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:8:0)
[09:11:21.496] Build status: STARTED
[09:11:21.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:9:0) after 5m18s
[09:16:39.537] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:9:0)
[09:16:39.588] Build status: STARTED
[09:16:39.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:10:0) after 8m21s
[09:25:00.607] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:10:0)
[09:25:00.635] Build status: STARTED
[09:25:00.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:11:0) after 5m59s
[09:30:59.859] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:11:0)
[09:30:59.888] Build status: STARTED
[09:30:59.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:12:0) after 2m11s
[09:33:10.912] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:12:0)
[09:33:10.940] Build status: STARTED
[09:33:10.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:13:0) after 7m19s
[09:40:30.252] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:13:0)
[09:40:30.290] Build status: STARTED
[09:40:30.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:14:0) after 1m16s
[09:41:46.308] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:14:0)
[09:41:46.339] Build status: STARTED
[09:41:46.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:15:0) after 6m6s
[09:47:52.709] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:15:0)
[09:47:52.740] Build status: STARTED
[09:47:52.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:16:0) after 9m30s
[09:57:22.871] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:16:0)
[09:57:22.897] Build status: STARTED
[09:57:22.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:17:0) after 1m39s
[09:59:01.927] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:17:0)
[09:59:01.977] Build status: STARTED
[09:59:01.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:18:0) after 8m41s
[10:07:42.997] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:18:0)
[10:07:43.028] Build status: STARTED
[10:07:43.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:19:0) after 8m17s
[10:16:00.073] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:19:0)
[10:16:00.105] Build status: STARTED
[10:16:00.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:20:0) after 8m12s
[10:24:12.226] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:20:0)
[10:24:12.257] Build status: STARTED
[10:24:12.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:21:0) after 3m6s
[10:27:18.345] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:21:0)
[10:27:18.394] Build status: STARTED
[10:27:18.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:22:0) after 8m12s
[10:35:30.487] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:22:0)
[10:35:30.518] Build status: STARTED
[10:35:30.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:23:0) after 6m31s
[10:42:01.554] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:23:0)
[10:42:01.581] Build status: STARTED
[10:42:01.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:24:0) after 9m51s
[10:51:52.605] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:24:0)
[10:51:52.633] Build status: STARTED
[10:51:52.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:25:0) after 2m27s
[10:54:19.683] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:25:0)
[10:54:19.713] Build status: STARTED
[10:54:19.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:26:0) after 6m37s
[11:00:56.947] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:26:0)
[11:00:56.973] Build status: STARTED
[11:00:56.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:27:0) after 9m16s
[11:10:13.017] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:27:0)
[11:10:13.045] Build status: STARTED
[11:10:13.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:28:0) after 2m41s
[11:12:54.067] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:28:0)
[11:12:54.123] Build status: STARTED
[11:12:54.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:29:0) after 7m52s
[11:20:46.250] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:29:0)
[11:20:46.278] Build status: STARTED
[11:20:46.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:30:0) after 3m14s
[11:24:00.389] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:30:0)
[11:24:00.414] Build status: STARTED
[11:24:00.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:31:0) after 7m45s
[11:31:45.439] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:31:0)
[11:31:45.468] Build status: STARTED
[11:31:45.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:32:0) after 9m32s
[11:41:17.600] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:32:0)
[11:41:17.624] Build status: STARTED
[11:41:17.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:33:0) after 4m59s
[11:46:16.701] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:33:0)
[11:46:16.736] Build status: STARTED
[11:46:16.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:34:0) after 4m16s
[11:50:32.764] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:34:0)
[11:50:32.945] Build status: STARTED
[11:50:32.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:35:0) after 8m22s
[11:58:54.990] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:35:0)
[11:58:55.029] Build status: STARTED
[11:58:55.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:36:0) after 3m21s
[12:02:16.231] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:36:0)
[12:02:16.258] Build status: STARTED
[12:02:16.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:37:0) after 9m9s
[12:11:25.287] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:37:0)
[12:11:25.318] Build status: STARTED
[12:11:25.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:38:0) after 5m51s
[12:17:17.106] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:38:0)
[12:17:17.138] Build status: STARTED
[12:17:17.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:39:0) after 5m1s
[12:22:18.163] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:39:0)
[12:22:18.191] Build status: STARTED
[12:22:18.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:40:0) after 7m20s
[12:29:38.323] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:40:0)
[12:29:38.366] Build status: STARTED
[12:29:38.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:41:0) after 5m6s
[12:34:44.388] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:41:0)
[12:34:44.415] Build status: STARTED
[12:34:44.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:42:0) after 2m48s
[12:37:32.391] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:42:0)
[12:37:32.434] Build status: STARTED
[12:37:32.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:43:0) after 9m10s
[12:46:42.461] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:43:0)
[12:46:42.491] Build status: STARTED
[12:46:42.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:44:0) after 3m31s
[12:50:13.629] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:44:0)
[12:50:13.658] Build status: STARTED
[12:50:13.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:45:0) after 8m32s
[12:58:45.687] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:45:0)
[12:58:45.726] Build status: STARTED
[12:58:45.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:46:0) after 7m33s
[13:06:18.930] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:46:0)
[13:06:18.973] Build status: STARTED
[13:06:18.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:47:0) after 9m17s
[13:15:35.962] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:47:0)
[13:15:36.005] Build status: STARTED
[13:15:36.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:48:0) after 5m12s
[13:20:48.219] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:48:0)
[13:20:48.253] Build status: STARTED
[13:20:48.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:49:0) after 9m32s
[13:30:20.536] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:49:0)
[13:30:20.610] Build status: STARTED
[13:30:20.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:50:0) after 1m56s
[13:32:16.632] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:50:0)
[13:32:16.660] Build status: STARTED
[13:32:16.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:51:0) after 9m44s
[13:42:00.786] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:51:0)
[13:42:00.837] Build status: STARTED
[13:42:00.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:52:0) after 4m8s
[13:46:08.829] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:52:0)
[13:46:08.855] Build status: STARTED
[13:46:08.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:53:0) after 5m34s
[13:51:42.956] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:53:0)
[13:51:42.986] Build status: STARTED
[13:51:42.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:54:0) after 8m52s
[14:00:35.028] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:54:0)
[14:00:35.077] Build status: STARTED
[14:00:35.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:55:0) after 4m39s
[14:05:14.195] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:55:0)
[14:05:14.227] Build status: STARTED
[14:05:14.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:56:0) after 7m50s
[14:13:04.248] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:56:0)
[14:13:04.293] Build status: STARTED
[14:13:04.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:57:0) after 6m9s
[14:19:13.359] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:57:0)
[14:19:13.395] Build status: STARTED
[14:19:13.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:58:0) after 8m18s
[14:27:31.432] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:58:0)
[14:27:31.462] Build status: STARTED
[14:27:31.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:59:0) after 8m17s
[14:35:48.533] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:59:0)
[14:35:48.597] Build status: STARTED
[14:35:48.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:60:0) after 3m50s
[14:39:38.743] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:60:0)
[14:39:38.774] Build status: STARTED
[14:39:38.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:61:0) after 2m36s
[14:42:15.040] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:61:0)
[14:42:15.067] Build status: STARTED
[14:42:15.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:62:0) after 3m52s
[14:46:07.246] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:62:0)
[14:46:07.302] Build status: STARTED
[14:46:07.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:63:0) after 4m31s
[14:50:38.428] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:63:0)
[14:50:38.458] Build status: STARTED
[14:50:38.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:64:0) after 5m10s
[14:55:48.561] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:64:0)
[14:55:48.669] Build status: STARTED
[14:55:48.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:65:0) after 5m20s
[15:01:08.699] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:65:0)
[15:01:08.749] Build status: STARTED
[15:01:08.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9009711681763118096:66:0) after 7m44s
[15:08:44.930] Received PubSub notification, asking Buildbucket for the build status
[15:08:44.960] Build:
{
"id": "8844281619778459888",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 13684,
"createdBy": "project:chromium",
"createTime": "2021-06-16T08:39:54.361537Z",
"startTime": "2021-06-16T08:42:20.912781Z",
"endTime": "2021-06-16T15:08:44.155270299Z",
"updateTime": "2021-06-16T15:08:44.155624720Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3b4011e6b40c4ab15894623d15a1a1ee4a36e1ee",
"ref": "refs/heads/main"
}
}
}
[15:08:44.960] Invocation finished in 6h28m51.875235123s with status FAILED