[09:17:29.082] New invocation is queued and will start shortly
[09:17:30.329] Starting the invocation (attempt 1)
[09:17:30.361] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/50f0179a98b58860512236984337fc847d07eae5"
[09:17:30.361] Popped gitiles commit info from properties and tags
[09:17:30.361] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[09:17:30.361] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[09:17:30.361] Buildbucket request:
{
"requestId": "8997297531798305616",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Deterministic Linux"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "50f0179a98b58860512236984337fc847d07eae5",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8997297531798305616"
},
{
"key": "scheduler_job_id",
"value": "chromium/Deterministic Linux"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[09:17:30.921] Scheduled build:
{
"id": "8831867469713848017",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Deterministic Linux"
},
"number": 32011,
"createdBy": "project:chromium",
"createTime": "2021-10-31T09:17:30.438931115Z",
"updateTime": "2021-10-31T09:17:30.438931115Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "50f0179a98b58860512236984337fc847d07eae5",
"ref": "refs/heads/main"
}
}
}
[09:17:30.921] Task URL: https://cr-buildbucket.appspot.com/build/8831867469713848017
[09:17:30.921] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:2:0) after 3m42s
[09:21:12.939] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:2:0)
[09:21:12.974] Build status: SCHEDULED
[09:21:12.974] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:3:0) after 5m5s
[09:23:24.504] Received PubSub notification, asking Buildbucket for the build status
[09:23:24.531] Build status: STARTED
[09:26:17.998] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:3:0)
[09:26:18.027] Build status: STARTED
[09:26:18.027] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:5:0) after 3m44s
[09:30:02.170] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:5:0)
[09:30:02.202] Build status: STARTED
[09:30:02.202] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:6:0) after 5m39s
[09:35:41.217] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:6:0)
[09:35:41.246] Build status: STARTED
[09:35:41.246] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:7:0) after 8m50s
[09:44:31.270] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:7:0)
[09:44:31.292] Build status: STARTED
[09:44:31.292] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:8:0) after 2m33s
[09:47:04.307] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:8:0)
[09:47:04.494] Build status: STARTED
[09:47:04.494] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:9:0) after 7m10s
[09:54:14.516] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:9:0)
[09:54:14.545] Build status: STARTED
[09:54:14.545] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:10:0) after 1m10s
[09:55:24.548] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:10:0)
[09:55:24.578] Build status: STARTED
[09:55:24.579] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:11:0) after 3m56s
[09:59:20.633] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:11:0)
[09:59:20.667] Build status: STARTED
[09:59:20.667] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:12:0) after 4m44s
[10:04:04.785] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:12:0)
[10:04:04.819] Build status: STARTED
[10:04:04.819] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:13:0) after 8m31s
[10:12:35.835] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:13:0)
[10:12:35.869] Build status: STARTED
[10:12:35.869] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:14:0) after 2m12s
[10:14:47.845] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:14:0)
[10:14:47.873] Build status: STARTED
[10:14:47.873] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:15:0) after 1m24s
[10:16:11.890] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:15:0)
[10:16:11.916] Build status: STARTED
[10:16:11.916] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:16:0) after 4m19s
[10:20:30.989] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:16:0)
[10:20:31.083] Build status: STARTED
[10:20:31.083] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:17:0) after 6m0s
[10:26:31.102] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:17:0)
[10:26:31.158] Build status: STARTED
[10:26:31.158] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:18:0) after 9m46s
[10:36:17.178] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:18:0)
[10:36:17.205] Build status: STARTED
[10:36:17.206] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:19:0) after 1m28s
[10:37:45.326] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:19:0)
[10:37:45.363] Build status: STARTED
[10:37:45.364] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:20:0) after 9m13s
[10:46:58.843] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:20:0)
[10:46:58.882] Build status: STARTED
[10:46:58.882] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:21:0) after 4m10s
[10:51:09.066] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:21:0)
[10:51:09.112] Build status: STARTED
[10:51:09.112] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:22:0) after 2m31s
[10:53:40.284] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:22:0)
[10:53:40.316] Build status: STARTED
[10:53:40.316] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:23:0) after 2m22s
[10:56:02.388] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:23:0)
[10:56:02.440] Build status: STARTED
[10:56:02.440] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:24:0) after 7m25s
[11:03:27.458] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:24:0)
[11:03:27.495] Build status: STARTED
[11:03:27.495] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:25:0) after 8m57s
[11:12:24.712] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:25:0)
[11:12:24.741] Build status: STARTED
[11:12:24.741] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:26:0) after 6m8s
[11:18:32.772] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:26:0)
[11:18:32.812] Build status: STARTED
[11:18:32.812] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:27:0) after 9m52s
[11:28:24.831] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:27:0)
[11:28:24.863] Build status: STARTED
[11:28:24.863] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:28:0) after 5m5s
[11:33:29.881] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:28:0)
[11:33:29.912] Build status: STARTED
[11:33:29.912] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:29:0) after 9m11s
[11:42:41.092] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:29:0)
[11:42:41.122] Build status: STARTED
[11:42:41.122] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:30:0) after 9m46s
[11:52:27.262] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:30:0)
[11:52:27.296] Build status: STARTED
[11:52:27.296] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:31:0) after 9m13s
[12:01:40.315] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:31:0)
[12:01:40.389] Build status: STARTED
[12:01:40.389] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:32:0) after 5m52s
[12:07:32.719] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:32:0)
[12:07:32.745] Build status: STARTED
[12:07:32.745] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:33:0) after 5m44s
[12:13:17.342] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:33:0)
[12:13:17.381] Build status: STARTED
[12:13:17.381] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:34:0) after 4m15s
[12:17:32.478] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:34:0)
[12:17:32.514] Build status: STARTED
[12:17:32.514] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:35:0) after 6m13s
[12:23:45.539] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:35:0)
[12:23:45.607] Build status: STARTED
[12:23:45.607] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:36:0) after 5m43s
[12:29:28.766] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:36:0)
[12:29:28.793] Build status: STARTED
[12:29:28.793] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:37:0) after 6m7s
[12:35:35.810] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:37:0)
[12:35:35.841] Build status: STARTED
[12:35:35.841] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:38:0) after 9m44s
[12:45:20.183] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:38:0)
[12:45:20.220] Build status: STARTED
[12:45:20.220] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:39:0) after 8m5s
[12:53:25.402] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:39:0)
[12:53:25.493] Build status: STARTED
[12:53:25.493] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:40:0) after 9m38s
[13:03:03.502] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:40:0)
[13:03:03.540] Build status: STARTED
[13:03:03.540] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:41:0) after 7m50s
[13:10:53.849] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:41:0)
[13:10:53.880] Build status: STARTED
[13:10:53.880] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:42:0) after 5m32s
[13:16:26.096] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:42:0)
[13:16:26.162] Build status: STARTED
[13:16:26.162] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:43:0) after 3m54s
[13:20:20.183] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:43:0)
[13:20:20.220] Build status: STARTED
[13:20:20.220] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:44:0) after 3m43s
[13:24:03.252] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:44:0)
[13:24:03.285] Build status: STARTED
[13:24:03.285] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:45:0) after 3m25s
[13:27:28.325] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:45:0)
[13:27:28.353] Build status: STARTED
[13:27:28.353] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:46:0) after 3m20s
[13:30:48.372] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:46:0)
[13:30:48.396] Build status: STARTED
[13:30:48.396] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:47:0) after 4m1s
[13:34:49.586] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:47:0)
[13:34:49.632] Build status: STARTED
[13:34:49.632] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:48:0) after 1m47s
[13:36:37.475] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:48:0)
[13:36:37.506] Build status: STARTED
[13:36:37.506] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:49:0) after 6m20s
[13:42:57.526] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:49:0)
[13:42:57.570] Build status: STARTED
[13:42:57.570] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:50:0) after 5m5s
[13:48:02.589] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:50:0)
[13:48:02.619] Build status: STARTED
[13:48:02.619] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:51:0) after 9m37s
[13:57:39.648] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:51:0)
[13:57:39.679] Build status: STARTED
[13:57:39.679] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:52:0) after 1m3s
[13:58:42.702] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:52:0)
[13:58:42.730] Build status: STARTED
[13:58:42.730] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:53:0) after 5m18s
[14:04:00.920] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:53:0)
[14:04:00.945] Build status: STARTED
[14:04:00.945] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:54:0) after 5m12s
[14:09:13.019] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:54:0)
[14:09:13.101] Build status: STARTED
[14:09:13.101] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:55:0) after 1m4s
[14:10:17.121] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:55:0)
[14:10:17.152] Build status: STARTED
[14:10:17.152] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:56:0) after 3m0s
[14:13:17.178] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:56:0)
[14:13:17.214] Build status: STARTED
[14:13:17.214] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:57:0) after 9m12s
[14:22:29.762] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:57:0)
[14:22:29.788] Build status: STARTED
[14:22:29.788] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:58:0) after 1m3s
[14:23:32.809] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:58:0)
[14:23:32.838] Build status: STARTED
[14:23:32.838] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:59:0) after 2m41s
[14:26:14.602] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:59:0)
[14:26:14.632] Build status: STARTED
[14:26:14.632] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:60:0) after 8m11s
[14:34:26.008] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:60:0)
[14:34:26.036] Build status: STARTED
[14:34:26.036] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:61:0) after 5m28s
[14:39:54.220] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:61:0)
[14:39:54.252] Build status: STARTED
[14:39:54.252] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:62:0) after 8m52s
[14:48:46.344] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:62:0)
[14:48:46.373] Build status: STARTED
[14:48:46.373] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:63:0) after 8m9s
[14:56:55.485] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:63:0)
[14:56:55.517] Build status: STARTED
[14:56:55.517] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:64:0) after 3m10s
[15:00:06.138] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:64:0)
[15:00:06.171] Build status: STARTED
[15:00:06.171] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:65:0) after 7m12s
[15:07:18.750] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:65:0)
[15:07:18.782] Build status: STARTED
[15:07:18.782] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:66:0) after 7m6s
[15:14:24.809] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:66:0)
[15:14:24.837] Build status: STARTED
[15:14:24.837] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:67:0) after 6m3s
[15:20:28.083] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:67:0)
[15:20:28.114] Build status: STARTED
[15:20:28.115] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:68:0) after 4m27s
[15:24:55.222] Handling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:68:0)
[15:24:55.252] Build status: STARTED
[15:24:55.252] Scheduling timer "check-buildbucket-build-status" (chromium/Deterministic Linux:8997297531798305616:69:0) after 8m46s
[15:28:34.565] Received PubSub notification, asking Buildbucket for the build status
[15:28:34.608] Build:
{
"id": "8831867469713848017",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Deterministic Linux"
},
"number": 32011,
"createdBy": "project:chromium",
"createTime": "2021-10-31T09:17:30.438931115Z",
"startTime": "2021-10-31T09:23:23.533379Z",
"endTime": "2021-10-31T15:28:33.368192Z",
"updateTime": "2021-10-31T15:28:33.872171Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "50f0179a98b58860512236984337fc847d07eae5",
"ref": "refs/heads/main"
}
}
}
[15:28:34.608] Invocation finished in 6h11m5.542323265s with status FAILED