[06:10:06.803] New invocation is queued and will start shortly
[06:10:08.057] Starting the invocation (attempt 1)
[06:10:08.189] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/ae0dc14df8f13643a804b4ce4c54f3c49d3affe7"
[06:10:08.189] Popped gitiles commit info from properties and tags
[06:10:08.189] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[06:10:08.190] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[06:10:08.190] Buildbucket request:
{
"requestId": "8958262027666997616",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ae0dc14df8f13643a804b4ce4c54f3c49d3affe7",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8958262027666997616"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[06:10:08.614] Scheduled build:
{
"id": "8792831965476038577",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 18820,
"createdBy": "project:chromium",
"createTime": "2023-01-05T06:10:08.257993402Z",
"updateTime": "2023-01-05T06:10:08.257993402Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ae0dc14df8f13643a804b4ce4c54f3c49d3affe7",
"ref": "refs/heads/main"
}
}
}
[06:10:08.614] Task URL: https://cr-buildbucket.appspot.com/build/8792831965476038577
[06:10:08.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:2:0) after 4m50s
[06:10:26.557] Received PubSub notification, asking Buildbucket for the build status
[06:10:26.590] Build status: STARTED
[06:14:58.631] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:2:0)
[06:14:58.653] Build status: STARTED
[06:14:58.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:4:0) after 5m24s
[06:20:22.697] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:4:0)
[06:20:22.730] Build status: STARTED
[06:20:22.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:5:0) after 8m10s
[06:28:32.770] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:5:0)
[06:28:32.803] Build status: STARTED
[06:28:32.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:6:0) after 3m34s
[06:32:06.800] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:6:0)
[06:32:06.826] Build status: STARTED
[06:32:06.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:7:0) after 2m27s
[06:34:33.855] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:7:0)
[06:34:33.878] Build status: STARTED
[06:34:33.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:8:0) after 7m34s
[06:42:07.896] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:8:0)
[06:42:07.921] Build status: STARTED
[06:42:07.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:9:0) after 8m40s
[06:50:48.039] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:9:0)
[06:50:48.059] Build status: STARTED
[06:50:48.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:10:0) after 1m14s
[06:52:02.099] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:10:0)
[06:52:02.121] Build status: STARTED
[06:52:02.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:11:0) after 9m19s
[07:01:21.144] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:11:0)
[07:01:21.169] Build status: STARTED
[07:01:21.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:12:0) after 2m32s
[07:03:53.192] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:12:0)
[07:03:53.258] Build status: STARTED
[07:03:53.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:13:0) after 1m6s
[07:04:59.274] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:13:0)
[07:04:59.302] Build status: STARTED
[07:04:59.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:14:0) after 6m13s
[07:11:12.324] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:14:0)
[07:11:12.345] Build status: STARTED
[07:11:12.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:15:0) after 9m1s
[07:20:13.335] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:15:0)
[07:20:13.360] Build status: STARTED
[07:20:13.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:16:0) after 6m41s
[07:26:54.773] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:16:0)
[07:26:54.793] Build status: STARTED
[07:26:54.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:17:0) after 7m16s
[07:34:10.825] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:17:0)
[07:34:10.850] Build status: STARTED
[07:34:10.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:18:0) after 6m44s
[07:40:54.877] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:18:0)
[07:40:54.900] Build status: STARTED
[07:40:54.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:19:0) after 4m17s
[07:45:11.996] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:19:0)
[07:45:12.028] Build status: STARTED
[07:45:12.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:20:0) after 7m16s
[07:52:28.149] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:20:0)
[07:52:28.172] Build status: STARTED
[07:52:28.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:21:0) after 8m23s
[08:00:51.213] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:21:0)
[08:00:51.266] Build status: STARTED
[08:00:51.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:22:0) after 7m34s
[08:08:25.331] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:22:0)
[08:08:25.358] Build status: STARTED
[08:08:25.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:23:0) after 5m7s
[08:13:32.402] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:23:0)
[08:13:32.426] Build status: STARTED
[08:13:32.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:24:0) after 2m6s
[08:15:38.432] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:24:0)
[08:15:38.454] Build status: STARTED
[08:15:38.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:25:0) after 1m31s
[08:17:09.515] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:25:0)
[08:17:09.545] Build status: STARTED
[08:17:09.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:26:0) after 4m40s
[08:21:49.584] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:26:0)
[08:21:49.611] Build status: STARTED
[08:21:49.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:27:0) after 3m43s
[08:25:32.677] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:27:0)
[08:25:32.708] Build status: STARTED
[08:25:32.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:28:0) after 8m43s
[08:34:15.743] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:28:0)
[08:34:15.769] Build status: STARTED
[08:34:15.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:29:0) after 4m17s
[08:38:33.274] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:29:0)
[08:38:33.295] Build status: STARTED
[08:38:33.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:30:0) after 9m52s
[08:48:25.295] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:30:0)
[08:48:25.318] Build status: STARTED
[08:48:25.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:31:0) after 4m18s
[08:52:43.348] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:31:0)
[08:52:43.372] Build status: STARTED
[08:52:43.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:32:0) after 3m52s
[08:56:35.422] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:32:0)
[08:56:35.444] Build status: STARTED
[08:56:35.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:33:0) after 6m27s
[09:03:02.512] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:33:0)
[09:03:02.553] Build status: STARTED
[09:03:02.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:34:0) after 1m43s
[09:04:45.573] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:34:0)
[09:04:45.614] Build status: STARTED
[09:04:45.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:35:0) after 4m14s
[09:08:59.770] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:35:0)
[09:08:59.858] Build status: STARTED
[09:08:59.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:36:0) after 1m8s
[09:10:07.876] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:36:0)
[09:10:07.903] Build status: STARTED
[09:10:07.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:37:0) after 2m17s
[09:12:24.942] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:37:0)
[09:12:24.967] Build status: STARTED
[09:12:24.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:38:0) after 7m59s
[09:20:24.058] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:38:0)
[09:20:24.082] Build status: STARTED
[09:20:24.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:39:0) after 9m49s
[09:30:13.102] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:39:0)
[09:30:13.127] Build status: STARTED
[09:30:13.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:40:0) after 5m24s
[09:35:37.108] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:40:0)
[09:35:37.153] Build status: STARTED
[09:35:37.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:41:0) after 9m36s
[09:45:13.573] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:41:0)
[09:45:13.593] Build status: STARTED
[09:45:13.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:42:0) after 1m37s
[09:46:50.620] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:42:0)
[09:46:50.643] Build status: STARTED
[09:46:50.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:43:0) after 7m30s
[09:54:21.033] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:43:0)
[09:54:21.061] Build status: STARTED
[09:54:21.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:44:0) after 2m11s
[09:56:32.177] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:44:0)
[09:56:32.201] Build status: STARTED
[09:56:32.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:45:0) after 2m48s
[09:59:20.244] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:45:0)
[09:59:20.268] Build status: STARTED
[09:59:20.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:46:0) after 8m4s
[10:07:24.373] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:46:0)
[10:07:24.512] Build status: STARTED
[10:07:24.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:47:0) after 4m12s
[10:11:36.736] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:47:0)
[10:11:36.791] Build status: STARTED
[10:11:36.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:48:0) after 9m52s
[10:21:28.976] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:48:0)
[10:21:28.998] Build status: STARTED
[10:21:28.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:49:0) after 7m28s
[10:28:57.024] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:49:0)
[10:28:57.046] Build status: STARTED
[10:28:57.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:50:0) after 2m21s
[10:31:18.067] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:50:0)
[10:31:18.091] Build status: STARTED
[10:31:18.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:51:0) after 5m1s
[10:36:19.177] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:51:0)
[10:36:19.199] Build status: STARTED
[10:36:19.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:52:0) after 1m43s
[10:38:02.276] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:52:0)
[10:38:02.297] Build status: STARTED
[10:38:02.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:53:0) after 2m31s
[10:40:33.512] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:53:0)
[10:40:33.534] Build status: STARTED
[10:40:33.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:54:0) after 7m33s
[10:48:06.646] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:54:0)
[10:48:06.668] Build status: STARTED
[10:48:06.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:55:0) after 8m3s
[10:56:09.795] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:55:0)
[10:56:09.822] Build status: STARTED
[10:56:09.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:56:0) after 4m59s
[11:01:08.957] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:56:0)
[11:01:08.986] Build status: STARTED
[11:01:08.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:57:0) after 7m15s
[11:08:24.241] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:57:0)
[11:08:24.294] Build status: STARTED
[11:08:24.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:58:0) after 5m50s
[11:14:14.278] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:58:0)
[11:14:14.304] Build status: STARTED
[11:14:14.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:59:0) after 8m45s
[11:22:59.398] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:59:0)
[11:22:59.421] Build status: STARTED
[11:22:59.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:60:0) after 6m29s
[11:29:28.547] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:60:0)
[11:29:28.602] Build status: STARTED
[11:29:28.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:61:0) after 5m17s
[11:34:45.632] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:61:0)
[11:34:45.666] Build status: STARTED
[11:34:45.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:62:0) after 8m34s
[11:43:19.692] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:62:0)
[11:43:19.728] Build status: STARTED
[11:43:19.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:63:0) after 6m34s
[11:49:53.751] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:63:0)
[11:49:53.771] Build status: STARTED
[11:49:53.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:64:0) after 9m1s
[11:58:54.998] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:64:0)
[11:58:55.105] Build status: STARTED
[11:58:55.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:65:0) after 5m9s
[12:04:04.145] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:65:0)
[12:04:04.187] Build status: STARTED
[12:04:04.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:66:0) after 6m39s
[12:10:43.463] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:66:0)
[12:10:43.599] Build status: STARTED
[12:10:43.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8958262027666997616:67:0) after 9m58s
[12:16:11.646] Received PubSub notification, asking Buildbucket for the build status
[12:16:11.686] Build:
{
"id": "8792831965476038577",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 18820,
"createdBy": "project:chromium",
"createTime": "2023-01-05T06:10:08.257993402Z",
"startTime": "2023-01-05T06:10:25.663616Z",
"endTime": "2023-01-05T12:16:11.359987904Z",
"updateTime": "2023-01-05T12:16:11.359987904Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ae0dc14df8f13643a804b4ce4c54f3c49d3affe7",
"ref": "refs/heads/main"
}
}
}
[12:16:11.686] Invocation finished in 6h6m4.901630921s with status FAILED