[03:18:32.710] New invocation is queued and will start shortly
[03:18:33.892] Starting the invocation (attempt 1)
[03:18:33.939] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/1658e92b8626f70cc7d18bb0e9493c572ca332af"
[03:18:33.939] Popped gitiles commit info from properties and tags
[03:18:33.939] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:18:33.939] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:18:33.939] Buildbucket request:
{
"requestId": "8967876100235449984",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1658e92b8626f70cc7d18bb0e9493c572ca332af",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8967876100235449984"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:18:34.739] Scheduled build:
{
"id": "8802446038182863073",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 17658,
"createdBy": "project:chromium",
"createTime": "2022-09-21T03:18:34.041388617Z",
"updateTime": "2022-09-21T03:18:34.041388617Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1658e92b8626f70cc7d18bb0e9493c572ca332af",
"ref": "refs/heads/main"
}
}
}
[03:18:34.739] Task URL: https://cr-buildbucket.appspot.com/build/8802446038182863073
[03:18:34.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:2:0) after 8m32s
[03:21:28.844] Received PubSub notification, asking Buildbucket for the build status
[03:21:28.870] Build status: STARTED
[03:27:06.725] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:2:0)
[03:27:06.754] Build status: STARTED
[03:27:06.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:4:0) after 8m51s
[03:35:58.170] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:4:0)
[03:35:58.201] Build status: STARTED
[03:35:58.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:5:0) after 2m18s
[03:38:16.173] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:5:0)
[03:38:16.218] Build status: STARTED
[03:38:16.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:6:0) after 5m40s
[03:43:56.351] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:6:0)
[03:43:56.376] Build status: STARTED
[03:43:56.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:7:0) after 6m36s
[03:50:32.401] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:7:0)
[03:50:32.437] Build status: STARTED
[03:50:32.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:8:0) after 9m48s
[04:00:20.462] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:8:0)
[04:00:20.504] Build status: STARTED
[04:00:20.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:9:0) after 9m33s
[04:09:53.890] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:9:0)
[04:09:53.937] Build status: STARTED
[04:09:53.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:10:0) after 9m2s
[04:18:56.118] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:10:0)
[04:18:56.142] Build status: STARTED
[04:18:56.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:11:0) after 5m13s
[04:24:09.188] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:11:0)
[04:24:09.227] Build status: STARTED
[04:24:09.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:12:0) after 1m24s
[04:25:33.392] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:12:0)
[04:25:33.424] Build status: STARTED
[04:25:33.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:13:0) after 8m38s
[04:34:11.484] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:13:0)
[04:34:11.513] Build status: STARTED
[04:34:11.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:14:0) after 3m35s
[04:37:46.534] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:14:0)
[04:37:46.558] Build status: STARTED
[04:37:46.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:15:0) after 9m14s
[04:47:00.655] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:15:0)
[04:47:00.740] Build status: STARTED
[04:47:00.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:16:0) after 5m56s
[04:52:56.825] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:16:0)
[04:52:56.853] Build status: STARTED
[04:52:56.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:17:0) after 2m35s
[04:55:32.029] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:17:0)
[04:55:32.052] Build status: STARTED
[04:55:32.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:18:0) after 9m31s
[05:05:03.223] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:18:0)
[05:05:03.281] Build status: STARTED
[05:05:03.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:19:0) after 6m44s
[05:11:47.409] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:19:0)
[05:11:47.607] Build status: STARTED
[05:11:47.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:20:0) after 3m38s
[05:15:25.656] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:20:0)
[05:15:25.681] Build status: STARTED
[05:15:25.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:21:0) after 4m17s
[05:19:42.960] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:21:0)
[05:19:42.994] Build status: STARTED
[05:19:42.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:22:0) after 5m44s
[05:25:27.288] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:22:0)
[05:25:27.361] Build status: STARTED
[05:25:27.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:23:0) after 4m40s
[05:30:07.397] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:23:0)
[05:30:07.423] Build status: STARTED
[05:30:07.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:24:0) after 2m11s
[05:32:18.748] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:24:0)
[05:32:18.777] Build status: STARTED
[05:32:18.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:25:0) after 7m50s
[05:40:08.810] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:25:0)
[05:40:08.839] Build status: STARTED
[05:40:08.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:26:0) after 7m59s
[05:48:07.936] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:26:0)
[05:48:07.967] Build status: STARTED
[05:48:07.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:27:0) after 4m28s
[05:52:36.419] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:27:0)
[05:52:36.453] Build status: STARTED
[05:52:36.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:28:0) after 9m3s
[06:01:39.586] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:28:0)
[06:01:39.614] Build status: STARTED
[06:01:39.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:29:0) after 4m28s
[06:06:07.640] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:29:0)
[06:06:07.713] Build status: STARTED
[06:06:07.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:30:0) after 2m45s
[06:08:52.734] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:30:0)
[06:08:52.803] Build status: STARTED
[06:08:52.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:31:0) after 4m11s
[06:13:03.943] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:31:0)
[06:13:03.968] Build status: STARTED
[06:13:03.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:32:0) after 9m16s
[06:22:20.110] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:32:0)
[06:22:20.142] Build status: STARTED
[06:22:20.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:33:0) after 4m50s
[06:27:10.399] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:33:0)
[06:27:10.430] Build status: STARTED
[06:27:10.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:34:0) after 3m50s
[06:31:00.695] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:34:0)
[06:31:00.723] Build status: STARTED
[06:31:00.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:35:0) after 5m24s
[06:36:24.754] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:35:0)
[06:36:24.780] Build status: STARTED
[06:36:24.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:36:0) after 1m16s
[06:37:40.812] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:36:0)
[06:37:40.837] Build status: STARTED
[06:37:40.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:37:0) after 8m1s
[06:45:42.003] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:37:0)
[06:45:42.043] Build status: STARTED
[06:45:42.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:38:0) after 4m27s
[06:50:09.208] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:38:0)
[06:50:09.239] Build status: STARTED
[06:50:09.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:39:0) after 9m48s
[06:59:57.345] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:39:0)
[06:59:57.371] Build status: STARTED
[06:59:57.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:40:0) after 1m50s
[07:01:47.594] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:40:0)
[07:01:47.624] Build status: STARTED
[07:01:47.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:41:0) after 5m50s
[07:07:37.662] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:41:0)
[07:07:37.690] Build status: STARTED
[07:07:37.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:42:0) after 8m16s
[07:15:53.816] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:42:0)
[07:15:53.841] Build status: STARTED
[07:15:53.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:43:0) after 6m45s
[07:22:38.862] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:43:0)
[07:22:38.947] Build status: STARTED
[07:22:38.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:44:0) after 6m18s
[07:28:56.978] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:44:0)
[07:28:57.008] Build status: STARTED
[07:28:57.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:45:0) after 2m56s
[07:31:53.041] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:45:0)
[07:31:53.067] Build status: STARTED
[07:31:53.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:46:0) after 9m12s
[07:41:05.193] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:46:0)
[07:41:05.224] Build status: STARTED
[07:41:05.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:47:0) after 8m5s
[07:49:10.463] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:47:0)
[07:49:10.493] Build status: STARTED
[07:49:10.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:48:0) after 5m19s
[07:54:29.514] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:48:0)
[07:54:29.545] Build status: STARTED
[07:54:29.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:49:0) after 6m56s
[08:01:25.578] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:49:0)
[08:01:25.612] Build status: STARTED
[08:01:25.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:50:0) after 8m11s
[08:09:36.642] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:50:0)
[08:09:36.669] Build status: STARTED
[08:09:36.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:51:0) after 5m26s
[08:15:02.828] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:51:0)
[08:15:02.858] Build status: STARTED
[08:15:02.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:52:0) after 8m5s
[08:23:07.879] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:52:0)
[08:23:07.906] Build status: STARTED
[08:23:07.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:53:0) after 9m30s
[08:32:38.057] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:53:0)
[08:32:38.084] Build status: STARTED
[08:32:38.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:54:0) after 9m34s
[08:42:12.123] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:54:0)
[08:42:12.151] Build status: STARTED
[08:42:12.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:55:0) after 2m48s
[08:45:00.307] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:55:0)
[08:45:00.335] Build status: STARTED
[08:45:00.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:56:0) after 5m5s
[08:50:05.623] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:56:0)
[08:50:05.656] Build status: STARTED
[08:50:05.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:57:0) after 6m33s
[08:56:38.756] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:57:0)
[08:56:38.785] Build status: STARTED
[08:56:38.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:58:0) after 4m34s
[09:01:12.808] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:58:0)
[09:01:12.845] Build status: STARTED
[09:01:12.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:59:0) after 8m18s
[09:09:31.202] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:59:0)
[09:09:31.238] Build status: STARTED
[09:09:31.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:60:0) after 1m35s
[09:11:06.319] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:60:0)
[09:11:06.344] Build status: STARTED
[09:11:06.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:61:0) after 7m35s
[09:18:41.411] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:61:0)
[09:18:41.441] Build status: STARTED
[09:18:41.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8967876100235449984:62:0) after 9m39s
[09:26:29.741] Received PubSub notification, asking Buildbucket for the build status
[09:26:29.767] Build:
{
"id": "8802446038182863073",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 17658,
"createdBy": "project:chromium",
"createTime": "2022-09-21T03:18:34.041388617Z",
"startTime": "2022-09-21T03:21:27.634402Z",
"endTime": "2022-09-21T09:26:29.166681330Z",
"updateTime": "2022-09-21T09:26:29.166681330Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1658e92b8626f70cc7d18bb0e9493c572ca332af",
"ref": "refs/heads/main"
}
}
}
[09:26:29.767] Invocation finished in 6h7m57.06613478s with status FAILED