[15:00:29.163] New invocation is queued and will start shortly
[15:00:30.291] Starting the invocation (attempt 1)
[15:00:30.344] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/5a2f58d4725bf81769c9d128fe811a63e6466afe"
[15:00:30.344] Popped gitiles commit info from properties and tags
[15:00:30.344] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:00:30.344] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:00:30.344] Buildbucket request:
{
"requestId": "8926157333390418496",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5a2f58d4725bf81769c9d128fe811a63e6466afe",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8926157333390418496"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:00:31.367] Scheduled build:
{
"id": "8760727271324391377",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 30882,
"createdBy": "project:chromium",
"createTime": "2023-12-25T15:00:30.506058655Z",
"updateTime": "2023-12-25T15:00:30.506058655Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5a2f58d4725bf81769c9d128fe811a63e6466afe",
"ref": "refs/heads/main"
}
},
"canary": true
}
[15:00:31.367] Task URL: https://cr-buildbucket.appspot.com/build/8760727271324391377
[15:00:31.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:2:0) after 1m52s
[15:00:32.396] Received PubSub notification, asking Buildbucket for the build status
[15:00:32.475] Build status: SCHEDULED
[15:00:34.219] Received PubSub notification, asking Buildbucket for the build status
[15:00:34.238] Build status: STARTED
[15:02:23.389] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:2:0)
[15:02:23.439] Build status: STARTED
[15:02:23.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:5:0) after 5m16s
[15:07:39.629] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:5:0)
[15:07:39.707] Build status: STARTED
[15:07:39.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:6:0) after 5m17s
[15:12:56.721] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:6:0)
[15:12:56.752] Build status: STARTED
[15:12:56.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:7:0) after 2m41s
[15:15:37.778] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:7:0)
[15:15:37.805] Build status: STARTED
[15:15:37.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:8:0) after 1m34s
[15:17:12.027] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:8:0)
[15:17:12.047] Build status: STARTED
[15:17:12.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:9:0) after 5m32s
[15:22:44.075] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:9:0)
[15:22:44.190] Build status: STARTED
[15:22:44.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:10:0) after 2m4s
[15:24:48.218] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:10:0)
[15:24:48.250] Build status: STARTED
[15:24:48.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:11:0) after 1m17s
[15:26:05.264] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:11:0)
[15:26:05.283] Build status: STARTED
[15:26:05.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:12:0) after 2m9s
[15:28:14.465] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:12:0)
[15:28:14.492] Build status: STARTED
[15:28:14.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:13:0) after 8m24s
[15:36:38.509] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:13:0)
[15:36:38.530] Build status: STARTED
[15:36:38.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:14:0) after 9m57s
[15:46:35.642] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:14:0)
[15:46:35.667] Build status: STARTED
[15:46:35.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:15:0) after 7m3s
[15:53:38.780] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:15:0)
[15:53:38.807] Build status: STARTED
[15:53:38.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:16:0) after 7m37s
[16:01:15.833] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:16:0)
[16:01:15.856] Build status: STARTED
[16:01:15.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:17:0) after 2m3s
[16:03:18.973] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:17:0)
[16:03:19.047] Build status: STARTED
[16:03:19.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:18:0) after 7m44s
[16:11:03.084] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:18:0)
[16:11:03.115] Build status: STARTED
[16:11:03.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:19:0) after 4m24s
[16:15:27.198] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:19:0)
[16:15:27.234] Build status: STARTED
[16:15:27.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:20:0) after 1m17s
[16:16:44.329] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:20:0)
[16:16:44.352] Build status: STARTED
[16:16:44.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:21:0) after 8m11s
[16:24:55.432] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:21:0)
[16:24:55.458] Build status: STARTED
[16:24:55.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:22:0) after 4m7s
[16:29:02.510] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:22:0)
[16:29:02.528] Build status: STARTED
[16:29:02.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:23:0) after 1m31s
[16:30:33.501] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:23:0)
[16:30:33.520] Build status: STARTED
[16:30:33.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:24:0) after 9m34s
[16:40:07.546] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:24:0)
[16:40:07.595] Build status: STARTED
[16:40:07.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:25:0) after 8m59s
[16:49:06.592] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:25:0)
[16:49:06.613] Build status: STARTED
[16:49:06.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:26:0) after 1m17s
[16:50:23.638] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:26:0)
[16:50:23.722] Build status: STARTED
[16:50:23.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:27:0) after 7m42s
[16:58:05.738] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:27:0)
[16:58:05.764] Build status: STARTED
[16:58:05.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:28:0) after 5m21s
[17:03:26.779] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:28:0)
[17:03:26.812] Build status: STARTED
[17:03:26.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:29:0) after 9m12s
[17:12:39.249] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:29:0)
[17:12:39.275] Build status: STARTED
[17:12:39.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:30:0) after 9m45s
[17:22:24.305] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:30:0)
[17:22:24.343] Build status: STARTED
[17:22:24.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:31:0) after 8m9s
[17:30:33.367] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:31:0)
[17:30:33.386] Build status: STARTED
[17:30:33.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:32:0) after 3m5s
[17:33:38.403] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:32:0)
[17:33:38.467] Build status: STARTED
[17:33:38.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:33:0) after 5m38s
[17:39:16.593] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:33:0)
[17:39:16.614] Build status: STARTED
[17:39:16.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:34:0) after 6m22s
[17:45:38.632] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:34:0)
[17:45:38.654] Build status: STARTED
[17:45:38.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:35:0) after 9m7s
[17:54:45.717] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:35:0)
[17:54:45.741] Build status: STARTED
[17:54:45.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:36:0) after 7m20s
[18:02:05.827] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:36:0)
[18:02:05.848] Build status: STARTED
[18:02:05.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:37:0) after 9m11s
[18:11:16.874] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:37:0)
[18:11:16.932] Build status: STARTED
[18:11:16.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:38:0) after 2m9s
[18:13:25.951] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:38:0)
[18:13:25.972] Build status: STARTED
[18:13:25.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:39:0) after 1m0s
[18:14:25.993] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:39:0)
[18:14:26.023] Build status: STARTED
[18:14:26.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:40:0) after 9m36s
[18:24:02.140] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:40:0)
[18:24:02.156] Build status: STARTED
[18:24:02.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:41:0) after 7m0s
[18:31:02.180] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:41:0)
[18:31:02.230] Build status: STARTED
[18:31:02.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:42:0) after 9m33s
[18:40:35.430] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:42:0)
[18:40:35.449] Build status: STARTED
[18:40:35.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:43:0) after 4m52s
[18:45:27.479] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:43:0)
[18:45:27.506] Build status: STARTED
[18:45:27.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:44:0) after 8m59s
[18:54:26.530] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:44:0)
[18:54:26.546] Build status: STARTED
[18:54:26.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:45:0) after 9m13s
[19:03:39.571] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:45:0)
[19:03:39.592] Build status: STARTED
[19:03:39.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:46:0) after 7m4s
[19:10:43.809] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:46:0)
[19:10:43.840] Build status: STARTED
[19:10:43.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:47:0) after 9m48s
[19:20:31.816] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:47:0)
[19:20:31.850] Build status: STARTED
[19:20:31.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:48:0) after 7m59s
[19:28:30.874] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:48:0)
[19:28:30.906] Build status: STARTED
[19:28:30.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:49:0) after 2m7s
[19:30:38.008] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:49:0)
[19:30:38.081] Build status: STARTED
[19:30:38.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:50:0) after 3m46s
[19:34:24.080] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:50:0)
[19:34:24.096] Build status: STARTED
[19:34:24.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:51:0) after 6m47s
[19:41:11.124] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:51:0)
[19:41:11.147] Build status: STARTED
[19:41:11.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:52:0) after 5m1s
[19:46:12.165] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:52:0)
[19:46:12.184] Build status: STARTED
[19:46:12.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:53:0) after 4m20s
[19:50:32.214] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:53:0)
[19:50:32.309] Build status: STARTED
[19:50:32.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:54:0) after 8m21s
[19:58:53.374] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:54:0)
[19:58:53.401] Build status: STARTED
[19:58:53.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:55:0) after 1m13s
[20:00:06.500] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:55:0)
[20:00:06.528] Build status: STARTED
[20:00:06.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:56:0) after 8m3s
[20:08:09.604] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:56:0)
[20:08:09.671] Build status: STARTED
[20:08:09.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:57:0) after 9m30s
[20:17:39.801] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:57:0)
[20:17:39.818] Build status: STARTED
[20:17:39.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:58:0) after 4m34s
[20:22:13.834] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:58:0)
[20:22:13.857] Build status: STARTED
[20:22:13.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:59:0) after 3m10s
[20:25:23.889] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:59:0)
[20:25:23.907] Build status: STARTED
[20:25:23.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:60:0) after 4m26s
[20:29:49.928] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:60:0)
[20:29:49.945] Build status: STARTED
[20:29:49.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:61:0) after 6m25s
[20:36:15.014] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:61:0)
[20:36:15.036] Build status: STARTED
[20:36:15.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:62:0) after 8m48s
[20:45:03.154] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:62:0)
[20:45:03.188] Build status: STARTED
[20:45:03.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:63:0) after 7m39s
[20:52:42.315] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:63:0)
[20:52:42.401] Build status: STARTED
[20:52:42.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:64:0) after 6m35s
[20:59:17.428] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:64:0)
[20:59:17.446] Build status: STARTED
[20:59:17.446] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:65:0) after 2m51s
[21:02:08.472] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:65:0)
[21:02:08.491] Build status: STARTED
[21:02:08.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8926157333390418496:66:0) after 6m42s
[21:06:54.216] Received PubSub notification, asking Buildbucket for the build status
[21:06:54.237] Build:
{
"id": "8760727271324391377",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 30882,
"createdBy": "project:chromium",
"createTime": "2023-12-25T15:00:30.506058655Z",
"startTime": "2023-12-25T15:00:33.089705Z",
"endTime": "2023-12-25T21:06:53.055062Z",
"updateTime": "2023-12-25T21:06:53.055062Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5a2f58d4725bf81769c9d128fe811a63e6466afe",
"ref": "refs/heads/main"
}
},
"canary": true
}
[21:06:54.237] Invocation finished in 6h6m25.085297518s with status FAILED