[01:12:06.497] New invocation is queued and will start shortly
[01:12:07.568] Starting the invocation (attempt 1)
[01:12:07.596] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/462963ae71d967027094b59e7d9249f8bd6a9ec2"
[01:12:07.596] Popped gitiles commit info from properties and tags
[01:12:07.596] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:12:07.596] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:12:07.596] Buildbucket request:
{
"requestId": "8931735865357068352",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "462963ae71d967027094b59e7d9249f8bd6a9ec2",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8931735865357068352"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:12:08.166] Scheduled build:
{
"id": "8766305803491641361",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 21014,
"createdBy": "project:chromium",
"createTime": "2023-10-25T01:12:07.654256652Z",
"updateTime": "2023-10-25T01:12:07.654256652Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "462963ae71d967027094b59e7d9249f8bd6a9ec2",
"ref": "refs/heads/main"
}
}
}
[01:12:08.166] Task URL: https://cr-buildbucket.appspot.com/build/8766305803491641361
[01:12:08.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:2:0) after 4m3s
[01:12:09.097] Received PubSub notification, asking Buildbucket for the build status
[01:12:09.124] Build status: SCHEDULED
[01:12:09.496] Received PubSub notification, asking Buildbucket for the build status
[01:12:09.513] Build status: STARTED
[01:16:11.229] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:2:0)
[01:16:11.245] Build status: STARTED
[01:16:11.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:5:0) after 4m39s
[01:20:50.271] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:5:0)
[01:20:50.291] Build status: STARTED
[01:20:50.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:6:0) after 9m18s
[01:30:08.310] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:6:0)
[01:30:08.334] Build status: STARTED
[01:30:08.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:7:0) after 3m59s
[01:34:07.397] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:7:0)
[01:34:07.471] Build status: STARTED
[01:34:07.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:8:0) after 8m0s
[01:42:07.794] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:8:0)
[01:42:07.814] Build status: STARTED
[01:42:07.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:9:0) after 5m4s
[01:47:11.843] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:9:0)
[01:47:11.860] Build status: STARTED
[01:47:11.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:10:0) after 7m50s
[01:55:02.780] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:10:0)
[01:55:02.798] Build status: STARTED
[01:55:02.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:11:0) after 9m16s
[02:04:19.020] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:11:0)
[02:04:19.038] Build status: STARTED
[02:04:19.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:12:0) after 9m35s
[02:13:54.385] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:12:0)
[02:13:54.408] Build status: STARTED
[02:13:54.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:13:0) after 8m22s
[02:22:16.480] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:13:0)
[02:22:16.499] Build status: STARTED
[02:22:16.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:14:0) after 3m10s
[02:25:26.569] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:14:0)
[02:25:26.637] Build status: STARTED
[02:25:26.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:15:0) after 9m18s
[02:34:44.984] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:15:0)
[02:34:45.012] Build status: STARTED
[02:34:45.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:16:0) after 8m30s
[02:43:15.092] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:16:0)
[02:43:15.133] Build status: STARTED
[02:43:15.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:17:0) after 3m32s
[02:46:47.217] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:17:0)
[02:46:47.238] Build status: STARTED
[02:46:47.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:18:0) after 5m1s
[02:51:48.255] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:18:0)
[02:51:48.333] Build status: STARTED
[02:51:48.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:19:0) after 1m23s
[02:53:11.354] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:19:0)
[02:53:11.374] Build status: STARTED
[02:53:11.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:20:0) after 9m33s
[03:02:44.391] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:20:0)
[03:02:44.408] Build status: STARTED
[03:02:44.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:21:0) after 5m19s
[03:08:03.489] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:21:0)
[03:08:03.508] Build status: STARTED
[03:08:03.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:22:0) after 7m15s
[03:15:18.526] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:22:0)
[03:15:18.546] Build status: STARTED
[03:15:18.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:23:0) after 2m8s
[03:17:26.674] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:23:0)
[03:17:26.713] Build status: STARTED
[03:17:26.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:24:0) after 8m40s
[03:26:07.154] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:24:0)
[03:26:07.172] Build status: STARTED
[03:26:07.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:25:0) after 5m17s
[03:31:24.300] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:25:0)
[03:31:24.320] Build status: STARTED
[03:31:24.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:26:0) after 5m45s
[03:37:09.447] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:26:0)
[03:37:09.468] Build status: STARTED
[03:37:09.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:27:0) after 7m17s
[03:44:26.717] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:27:0)
[03:44:26.742] Build status: STARTED
[03:44:26.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:28:0) after 9m43s
[03:54:09.862] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:28:0)
[03:54:10.001] Build status: STARTED
[03:54:10.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:29:0) after 6m39s
[04:00:49.448] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:29:0)
[04:00:49.477] Build status: STARTED
[04:00:49.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:30:0) after 6m6s
[04:06:55.520] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:30:0)
[04:06:55.579] Build status: STARTED
[04:06:55.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:31:0) after 1m24s
[04:08:19.980] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:31:0)
[04:08:19.999] Build status: STARTED
[04:08:19.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:32:0) after 3m51s
[04:12:11.025] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:32:0)
[04:12:11.056] Build status: STARTED
[04:12:11.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:33:0) after 5m1s
[04:17:12.131] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:33:0)
[04:17:12.314] Build status: STARTED
[04:17:12.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:34:0) after 5m46s
[04:22:58.531] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:34:0)
[04:22:58.565] Build status: STARTED
[04:22:58.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:35:0) after 6m38s
[04:29:36.579] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:35:0)
[04:29:36.607] Build status: STARTED
[04:29:36.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:36:0) after 6m22s
[04:35:58.664] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:36:0)
[04:35:58.751] Build status: STARTED
[04:35:58.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:37:0) after 4m11s
[04:40:09.819] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:37:0)
[04:40:09.856] Build status: STARTED
[04:40:09.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:38:0) after 6m57s
[04:47:07.161] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:38:0)
[04:47:07.308] Build status: STARTED
[04:47:07.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:39:0) after 5m0s
[04:52:07.370] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:39:0)
[04:52:07.388] Build status: STARTED
[04:52:07.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:40:0) after 6m41s
[04:58:48.493] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:40:0)
[04:58:48.513] Build status: STARTED
[04:58:48.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:41:0) after 3m58s
[05:02:46.576] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:41:0)
[05:02:46.609] Build status: STARTED
[05:02:46.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:42:0) after 7m28s
[05:10:14.639] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:42:0)
[05:10:14.662] Build status: STARTED
[05:10:14.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:43:0) after 9m16s
[05:19:31.269] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:43:0)
[05:19:31.288] Build status: STARTED
[05:19:31.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:44:0) after 4m34s
[05:24:05.815] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:44:0)
[05:24:05.839] Build status: STARTED
[05:24:05.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:45:0) after 1m40s
[05:25:45.928] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:45:0)
[05:25:45.947] Build status: STARTED
[05:25:45.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:46:0) after 5m49s
[05:31:34.972] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:46:0)
[05:31:34.990] Build status: STARTED
[05:31:34.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:47:0) after 1m11s
[05:32:46.317] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:47:0)
[05:32:46.493] Build status: STARTED
[05:32:46.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:48:0) after 3m23s
[05:36:09.887] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:48:0)
[05:36:09.903] Build status: STARTED
[05:36:09.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:49:0) after 5m43s
[05:41:53.530] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:49:0)
[05:41:53.660] Build status: STARTED
[05:41:53.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:50:0) after 8m44s
[05:50:37.859] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:50:0)
[05:50:37.920] Build status: STARTED
[05:50:37.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:51:0) after 7m31s
[05:58:09.269] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:51:0)
[05:58:09.324] Build status: STARTED
[05:58:09.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:52:0) after 2m9s
[06:00:18.483] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:52:0)
[06:00:18.505] Build status: STARTED
[06:00:18.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:53:0) after 8m41s
[06:08:59.521] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:53:0)
[06:08:59.540] Build status: STARTED
[06:08:59.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:54:0) after 4m11s
[06:13:10.567] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:54:0)
[06:13:10.583] Build status: STARTED
[06:13:10.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:55:0) after 5m51s
[06:19:01.599] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:55:0)
[06:19:01.623] Build status: STARTED
[06:19:01.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:56:0) after 9m49s
[06:28:50.852] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:56:0)
[06:28:50.874] Build status: STARTED
[06:28:50.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:57:0) after 2m21s
[06:31:11.896] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:57:0)
[06:31:11.919] Build status: STARTED
[06:31:11.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:58:0) after 1m4s
[06:32:16.158] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:58:0)
[06:32:16.179] Build status: STARTED
[06:32:16.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931735865357068352:59:0) after 9m45s
[06:38:28.088] Received PubSub notification, asking Buildbucket for the build status
[06:38:28.108] Build:
{
"id": "8766305803491641361",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 21014,
"createdBy": "project:chromium",
"createTime": "2023-10-25T01:12:07.654256652Z",
"startTime": "2023-10-25T01:12:08.749557Z",
"endTime": "2023-10-25T06:38:27.841894268Z",
"updateTime": "2023-10-25T06:38:27.841894268Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "462963ae71d967027094b59e7d9249f8bd6a9ec2",
"ref": "refs/heads/main"
}
}
}
[06:38:28.108] Invocation finished in 5h26m21.61601294s with status FAILED