[13:05:34.607] New invocation is queued and will start shortly
[13:05:35.683] Starting the invocation (attempt 1)
[13:05:35.716] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2ee89b3eb57b816e021ed095b71ccc5b06a04ab2"
[13:05:35.716] Popped gitiles commit info from properties and tags
[13:05:35.716] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:05:35.716] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:05:35.716] Buildbucket request:
{
"requestId": "8997464375419728272",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2ee89b3eb57b816e021ed095b71ccc5b06a04ab2",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8997464375419728272"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:05:36.468] Scheduled build:
{
"id": "8832034313522319217",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 14833,
"createdBy": "project:chromium",
"createTime": "2021-10-29T13:05:35.783186985Z",
"updateTime": "2021-10-29T13:05:35.783186985Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2ee89b3eb57b816e021ed095b71ccc5b06a04ab2",
"ref": "refs/heads/main"
}
}
}
[13:05:36.468] Task URL: https://cr-buildbucket.appspot.com/build/8832034313522319217
[13:05:36.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:2:0) after 5m28s
[13:07:41.043] Received PubSub notification, asking Buildbucket for the build status
[13:07:41.071] Build status: STARTED
[13:11:04.492] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:2:0)
[13:11:04.603] Build status: STARTED
[13:11:04.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:4:0) after 8m6s
[13:19:10.676] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:4:0)
[13:19:10.709] Build status: STARTED
[13:19:10.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:5:0) after 3m10s
[13:22:20.754] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:5:0)
[13:22:20.786] Build status: STARTED
[13:22:20.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:6:0) after 9m33s
[13:31:53.810] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:6:0)
[13:31:53.852] Build status: STARTED
[13:31:53.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:7:0) after 6m16s
[13:38:09.876] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:7:0)
[13:38:09.925] Build status: STARTED
[13:38:09.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:8:0) after 1m35s
[13:39:44.946] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:8:0)
[13:39:44.977] Build status: STARTED
[13:39:44.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:9:0) after 2m45s
[13:42:30.033] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:9:0)
[13:42:30.065] Build status: STARTED
[13:42:30.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:10:0) after 8m59s
[13:51:29.092] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:10:0)
[13:51:29.125] Build status: STARTED
[13:51:29.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:11:0) after 5m44s
[13:57:13.147] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:11:0)
[13:57:13.216] Build status: STARTED
[13:57:13.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:12:0) after 9m57s
[14:07:10.330] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:12:0)
[14:07:10.363] Build status: STARTED
[14:07:10.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:13:0) after 7m20s
[14:14:30.386] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:13:0)
[14:14:30.477] Build status: STARTED
[14:14:30.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:14:0) after 3m39s
[14:18:09.554] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:14:0)
[14:18:09.589] Build status: STARTED
[14:18:09.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:15:0) after 8m35s
[14:26:44.873] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:15:0)
[14:26:45.921] Build status: STARTED
[14:26:45.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:16:0) after 2m19s
[14:29:04.921] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:16:0)
[14:29:04.950] Build status: STARTED
[14:29:04.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:17:0) after 9m3s
[14:38:07.974] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:17:0)
[14:38:08.038] Build status: STARTED
[14:38:08.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:18:0) after 4m13s
[14:42:21.060] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:18:0)
[14:42:21.091] Build status: STARTED
[14:42:21.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:19:0) after 6m24s
[14:48:45.193] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:19:0)
[14:48:45.239] Build status: STARTED
[14:48:45.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:20:0) after 7m18s
[14:56:03.281] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:20:0)
[14:56:03.370] Build status: STARTED
[14:56:03.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:21:0) after 7m14s
[15:03:17.518] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:21:0)
[15:03:17.587] Build status: STARTED
[15:03:17.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:22:0) after 5m48s
[15:09:05.914] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:22:0)
[15:09:05.948] Build status: STARTED
[15:09:05.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:23:0) after 5m17s
[15:14:23.378] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:23:0)
[15:14:23.462] Build status: STARTED
[15:14:23.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:24:0) after 6m55s
[15:21:18.643] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:24:0)
[15:21:18.673] Build status: STARTED
[15:21:18.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:25:0) after 3m54s
[15:25:12.787] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:25:0)
[15:25:12.815] Build status: STARTED
[15:25:12.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:26:0) after 9m6s
[15:34:18.861] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:26:0)
[15:34:18.895] Build status: STARTED
[15:34:18.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:27:0) after 8m33s
[15:42:52.261] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:27:0)
[15:42:52.292] Build status: STARTED
[15:42:52.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:28:0) after 2m14s
[15:45:06.304] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:28:0)
[15:45:06.335] Build status: STARTED
[15:45:06.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:29:0) after 6m42s
[15:51:48.497] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:29:0)
[15:51:48.530] Build status: STARTED
[15:51:48.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:30:0) after 9m4s
[16:00:52.551] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:30:0)
[16:00:52.579] Build status: STARTED
[16:00:52.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:31:0) after 9m30s
[16:10:22.610] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:31:0)
[16:10:22.642] Build status: STARTED
[16:10:22.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:32:0) after 2m42s
[16:13:04.795] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:32:0)
[16:13:04.886] Build status: STARTED
[16:13:04.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:33:0) after 2m40s
[16:15:44.959] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:33:0)
[16:15:44.988] Build status: STARTED
[16:15:44.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:34:0) after 5m12s
[16:20:57.211] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:34:0)
[16:20:57.241] Build status: STARTED
[16:20:57.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:35:0) after 4m18s
[16:25:15.641] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:35:0)
[16:25:15.743] Build status: STARTED
[16:25:15.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:36:0) after 1m3s
[16:26:19.095] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:36:0)
[16:26:19.127] Build status: STARTED
[16:26:19.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:37:0) after 6m21s
[16:32:40.303] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:37:0)
[16:32:40.340] Build status: STARTED
[16:32:40.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:38:0) after 4m54s
[16:37:34.363] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:38:0)
[16:37:34.402] Build status: STARTED
[16:37:34.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:39:0) after 8m54s
[16:46:28.464] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:39:0)
[16:46:28.497] Build status: STARTED
[16:46:28.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:40:0) after 4m27s
[16:50:55.709] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:40:0)
[16:50:55.775] Build status: STARTED
[16:50:55.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:41:0) after 3m22s
[16:54:17.914] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:41:0)
[16:54:17.944] Build status: STARTED
[16:54:17.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:42:0) after 4m34s
[16:58:51.969] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:42:0)
[16:58:52.178] Build status: STARTED
[16:58:52.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:43:0) after 3m25s
[17:02:17.200] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:43:0)
[17:02:17.252] Build status: STARTED
[17:02:17.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:44:0) after 7m7s
[17:09:24.392] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:44:0)
[17:09:24.425] Build status: STARTED
[17:09:24.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:45:0) after 8m14s
[17:17:38.515] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:45:0)
[17:17:38.563] Build status: STARTED
[17:17:38.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:46:0) after 2m43s
[17:20:21.587] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:46:0)
[17:20:21.667] Build status: STARTED
[17:20:21.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:47:0) after 3m56s
[17:24:17.692] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:47:0)
[17:24:17.803] Build status: STARTED
[17:24:17.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:48:0) after 2m41s
[17:26:58.842] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:48:0)
[17:26:58.883] Build status: STARTED
[17:26:58.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:49:0) after 3m39s
[17:30:38.026] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:49:0)
[17:30:38.057] Build status: STARTED
[17:30:38.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:50:0) after 7m23s
[17:38:01.149] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:50:0)
[17:38:01.181] Build status: STARTED
[17:38:01.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:51:0) after 1m43s
[17:39:44.304] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:51:0)
[17:39:44.337] Build status: STARTED
[17:39:44.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:52:0) after 5m25s
[17:45:09.469] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:52:0)
[17:45:09.499] Build status: STARTED
[17:45:09.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:53:0) after 4m52s
[17:50:01.613] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:53:0)
[17:50:01.643] Build status: STARTED
[17:50:01.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:54:0) after 3m43s
[17:53:44.902] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:54:0)
[17:53:44.946] Build status: STARTED
[17:53:44.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:55:0) after 8m16s
[18:02:00.946] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:55:0)
[18:02:01.073] Build status: STARTED
[18:02:01.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:56:0) after 2m42s
[18:04:43.135] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:56:0)
[18:04:43.203] Build status: STARTED
[18:04:43.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:57:0) after 5m5s
[18:09:48.233] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:57:0)
[18:09:48.260] Build status: STARTED
[18:09:48.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8997464375419728272:58:0) after 6m28s
[18:12:14.153] Received PubSub notification, asking Buildbucket for the build status
[18:12:14.275] Build:
{
"id": "8832034313522319217",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 14833,
"createdBy": "project:chromium",
"createTime": "2021-10-29T13:05:35.783186985Z",
"startTime": "2021-10-29T13:07:40.166562Z",
"endTime": "2021-10-29T18:12:13.883114905Z",
"updateTime": "2021-10-29T18:12:13.883114905Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2ee89b3eb57b816e021ed095b71ccc5b06a04ab2",
"ref": "refs/heads/main"
}
}
}
[18:12:14.275] Invocation finished in 5h6m39.685009945s with status FAILED