[05:56:32.693] New invocation is queued and will start shortly
[05:56:33.815] Starting the invocation (attempt 1)
[05:56:33.847] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/b046535101771c477765001659fce5c73054b305"
[05:56:33.847] Popped gitiles commit info from properties and tags
[05:56:33.847] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:56:33.847] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:56:33.848] Buildbucket request:
{
"requestId": "8981727495619244016",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b046535101771c477765001659fce5c73054b305",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8981727495619244016"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[05:56:34.356] Scheduled build:
{
"id": "8816297433673434385",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 15970,
"createdBy": "project:chromium",
"createTime": "2022-04-21T05:56:33.915164615Z",
"updateTime": "2022-04-21T05:56:33.915164615Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b046535101771c477765001659fce5c73054b305",
"ref": "refs/heads/main"
}
}
}
[05:56:34.356] Task URL: https://cr-buildbucket.appspot.com/build/8816297433673434385
[05:56:34.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:2:0) after 5m46s
[05:58:01.095] Received PubSub notification, asking Buildbucket for the build status
[05:58:01.124] Build status: STARTED
[06:02:20.517] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:2:0)
[06:02:20.535] Build status: STARTED
[06:02:20.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:4:0) after 9m31s
[06:11:51.704] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:4:0)
[06:11:51.725] Build status: STARTED
[06:11:51.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:5:0) after 2m18s
[06:14:10.068] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:5:0)
[06:14:10.099] Build status: STARTED
[06:14:10.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:6:0) after 8m21s
[06:22:31.075] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:6:0)
[06:22:31.095] Build status: STARTED
[06:22:31.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:7:0) after 7m44s
[06:30:15.225] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:7:0)
[06:30:15.252] Build status: STARTED
[06:30:15.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:8:0) after 4m27s
[06:34:42.397] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:8:0)
[06:34:42.429] Build status: STARTED
[06:34:42.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:9:0) after 6m40s
[06:41:22.552] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:9:0)
[06:41:22.574] Build status: STARTED
[06:41:22.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:10:0) after 2m26s
[06:43:48.694] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:10:0)
[06:43:48.718] Build status: STARTED
[06:43:48.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:11:0) after 7m40s
[06:51:28.744] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:11:0)
[06:51:28.766] Build status: STARTED
[06:51:28.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:12:0) after 1m54s
[06:53:22.785] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:12:0)
[06:53:22.806] Build status: STARTED
[06:53:22.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:13:0) after 8m39s
[07:02:01.869] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:13:0)
[07:02:01.925] Build status: STARTED
[07:02:01.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:14:0) after 8m35s
[07:10:37.058] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:14:0)
[07:10:37.080] Build status: STARTED
[07:10:37.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:15:0) after 2m15s
[07:12:52.202] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:15:0)
[07:12:52.267] Build status: STARTED
[07:12:52.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:16:0) after 4m40s
[07:17:32.593] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:16:0)
[07:17:32.615] Build status: STARTED
[07:17:32.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:17:0) after 9m15s
[07:26:47.647] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:17:0)
[07:26:47.671] Build status: STARTED
[07:26:47.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:18:0) after 2m41s
[07:29:28.795] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:18:0)
[07:29:28.821] Build status: STARTED
[07:29:28.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:19:0) after 8m26s
[07:37:54.847] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:19:0)
[07:37:54.872] Build status: STARTED
[07:37:54.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:20:0) after 7m24s
[07:45:19.077] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:20:0)
[07:45:19.109] Build status: STARTED
[07:45:19.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:21:0) after 1m25s
[07:46:44.334] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:21:0)
[07:46:44.374] Build status: STARTED
[07:46:44.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:22:0) after 3m37s
[07:50:21.428] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:22:0)
[07:50:21.536] Build status: STARTED
[07:50:21.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:23:0) after 4m3s
[07:54:24.556] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:23:0)
[07:54:24.584] Build status: STARTED
[07:54:24.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:24:0) after 1m47s
[07:56:11.698] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:24:0)
[07:56:11.746] Build status: STARTED
[07:56:11.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:25:0) after 6m10s
[08:02:21.780] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:25:0)
[08:02:21.826] Build status: STARTED
[08:02:21.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:26:0) after 8m13s
[08:10:34.847] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:26:0)
[08:10:34.880] Build status: STARTED
[08:10:34.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:27:0) after 2m34s
[08:13:09.014] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:27:0)
[08:13:09.038] Build status: STARTED
[08:13:09.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:28:0) after 8m36s
[08:21:45.118] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:28:0)
[08:21:45.154] Build status: STARTED
[08:21:45.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:29:0) after 8m34s
[08:30:19.330] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:29:0)
[08:30:19.371] Build status: STARTED
[08:30:19.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:30:0) after 4m5s
[08:34:24.421] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:30:0)
[08:34:24.451] Build status: STARTED
[08:34:24.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:31:0) after 5m29s
[08:39:53.652] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:31:0)
[08:39:53.676] Build status: STARTED
[08:39:53.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:32:0) after 3m37s
[08:43:30.816] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:32:0)
[08:43:30.866] Build status: STARTED
[08:43:30.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:33:0) after 7m53s
[08:51:23.888] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:33:0)
[08:51:23.930] Build status: STARTED
[08:51:23.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:34:0) after 2m58s
[08:54:21.985] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:34:0)
[08:54:22.025] Build status: STARTED
[08:54:22.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:35:0) after 8m55s
[09:03:17.072] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:35:0)
[09:03:17.147] Build status: STARTED
[09:03:17.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:36:0) after 3m45s
[09:07:02.170] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:36:0)
[09:07:02.196] Build status: STARTED
[09:07:02.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:37:0) after 9m11s
[09:16:13.584] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:37:0)
[09:16:13.605] Build status: STARTED
[09:16:13.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:38:0) after 2m48s
[09:19:01.850] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:38:0)
[09:19:01.869] Build status: STARTED
[09:19:01.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:39:0) after 3m17s
[09:22:18.992] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:39:0)
[09:22:19.015] Build status: STARTED
[09:22:19.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:40:0) after 6m37s
[09:28:56.326] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:40:0)
[09:28:56.363] Build status: STARTED
[09:28:56.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:41:0) after 6m43s
[09:35:39.386] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:41:0)
[09:35:39.408] Build status: STARTED
[09:35:39.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:42:0) after 6m55s
[09:42:34.473] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:42:0)
[09:42:34.495] Build status: STARTED
[09:42:34.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:43:0) after 3m9s
[09:45:43.576] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:43:0)
[09:45:43.613] Build status: STARTED
[09:45:43.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:44:0) after 4m12s
[09:49:55.648] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:44:0)
[09:49:55.670] Build status: STARTED
[09:49:55.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:45:0) after 6m2s
[09:55:57.699] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:45:0)
[09:55:57.784] Build status: STARTED
[09:55:57.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:46:0) after 4m44s
[10:00:42.040] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:46:0)
[10:00:42.065] Build status: STARTED
[10:00:42.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:47:0) after 1m53s
[10:02:35.260] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:47:0)
[10:02:35.291] Build status: STARTED
[10:02:35.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:48:0) after 8m1s
[10:10:36.314] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:48:0)
[10:10:36.339] Build status: STARTED
[10:10:36.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:49:0) after 9m47s
[10:20:23.390] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:49:0)
[10:20:23.409] Build status: STARTED
[10:20:23.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:50:0) after 9m25s
[10:29:48.413] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:50:0)
[10:29:48.433] Build status: STARTED
[10:29:48.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:51:0) after 7m44s
[10:37:32.513] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:51:0)
[10:37:32.537] Build status: STARTED
[10:37:32.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:52:0) after 7m50s
[10:45:22.715] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:52:0)
[10:45:22.757] Build status: STARTED
[10:45:22.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:53:0) after 4m2s
[10:49:24.894] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:53:0)
[10:49:24.927] Build status: STARTED
[10:49:24.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:54:0) after 8m47s
[10:58:11.950] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:54:0)
[10:58:11.982] Build status: STARTED
[10:58:11.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:55:0) after 1m33s
[10:59:45.253] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:55:0)
[10:59:45.274] Build status: STARTED
[10:59:45.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:56:0) after 6m44s
[11:06:29.403] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:56:0)
[11:06:29.424] Build status: STARTED
[11:06:29.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:57:0) after 9m27s
[11:15:56.447] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:57:0)
[11:15:56.475] Build status: STARTED
[11:15:56.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:58:0) after 9m8s
[11:25:04.553] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:58:0)
[11:25:04.589] Build status: STARTED
[11:25:04.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:59:0) after 6m2s
[11:31:06.723] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:59:0)
[11:31:06.751] Build status: STARTED
[11:31:06.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:60:0) after 9m2s
[11:40:08.848] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:60:0)
[11:40:08.896] Build status: STARTED
[11:40:08.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:61:0) after 3m12s
[11:43:20.973] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:61:0)
[11:43:21.009] Build status: STARTED
[11:43:21.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:62:0) after 3m26s
[11:46:47.030] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:62:0)
[11:46:47.056] Build status: STARTED
[11:46:47.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981727495619244016:63:0) after 6m23s
[11:48:07.580] Received PubSub notification, asking Buildbucket for the build status
[11:48:07.600] Build:
{
"id": "8816297433673434385",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 15970,
"createdBy": "project:chromium",
"createTime": "2022-04-21T05:56:33.915164615Z",
"startTime": "2022-04-21T05:58:00.398617Z",
"endTime": "2022-04-21T11:48:07.318218117Z",
"updateTime": "2022-04-21T11:48:07.318218117Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b046535101771c477765001659fce5c73054b305",
"ref": "refs/heads/main"
}
}
}
[11:48:07.600] Invocation finished in 5h51m34.923928639s with status FAILED