[12:35:28.584] New invocation is queued and will start shortly
[12:35:29.660] Starting the invocation (attempt 1)
[12:35:29.693] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/248da4b920ec31e99194028191f51b3cbded68f5"
[12:35:29.693] Popped gitiles commit info from properties and tags
[12:35:29.693] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[12:35:29.693] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[12:35:29.693] Buildbucket request:
{
"requestId": "8927344217165363104",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "248da4b920ec31e99194028191f51b3cbded68f5",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8927344217165363104"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[12:35:30.462] Scheduled build:
{
"id": "8761914155267076577",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 30826,
"createdBy": "project:chromium",
"createTime": "2023-12-12T12:35:29.773427907Z",
"updateTime": "2023-12-12T12:35:29.773427907Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "248da4b920ec31e99194028191f51b3cbded68f5",
"ref": "refs/heads/main"
}
}
}
[12:35:30.462] Task URL: https://cr-buildbucket.appspot.com/build/8761914155267076577
[12:35:30.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:2:0) after 3m2s
[12:35:31.539] Received PubSub notification, asking Buildbucket for the build status
[12:35:31.564] Build status: STARTED
[12:35:31.703] Received PubSub notification, asking Buildbucket for the build status
[12:35:31.913] Build status: STARTED
[12:38:32.593] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:2:0)
[12:38:32.612] Build status: STARTED
[12:38:32.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:5:0) after 8m34s
[12:47:06.908] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:5:0)
[12:47:06.937] Build status: STARTED
[12:47:06.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:6:0) after 7m22s
[12:54:28.954] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:6:0)
[12:54:29.005] Build status: STARTED
[12:54:29.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:7:0) after 6m25s
[13:00:54.780] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:7:0)
[13:00:54.814] Build status: STARTED
[13:00:54.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:8:0) after 2m7s
[13:03:01.943] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:8:0)
[13:03:02.091] Build status: STARTED
[13:03:02.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:9:0) after 9m45s
[13:12:47.168] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:9:0)
[13:12:47.315] Build status: STARTED
[13:12:47.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:10:0) after 3m1s
[13:15:48.350] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:10:0)
[13:15:48.381] Build status: STARTED
[13:15:48.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:11:0) after 9m28s
[13:25:16.693] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:11:0)
[13:25:16.731] Build status: STARTED
[13:25:16.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:12:0) after 5m20s
[13:30:36.786] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:12:0)
[13:30:36.815] Build status: STARTED
[13:30:36.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:13:0) after 6m56s
[13:37:32.841] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:13:0)
[13:37:32.868] Build status: STARTED
[13:37:32.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:14:0) after 9m52s
[13:47:25.227] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:14:0)
[13:47:25.261] Build status: STARTED
[13:47:25.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:15:0) after 3m48s
[13:51:13.348] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:15:0)
[13:51:13.372] Build status: STARTED
[13:51:13.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:16:0) after 3m54s
[13:55:07.485] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:16:0)
[13:55:07.513] Build status: STARTED
[13:55:07.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:17:0) after 6m30s
[14:01:37.567] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:17:0)
[14:01:37.614] Build status: STARTED
[14:01:37.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:18:0) after 9m28s
[14:11:05.632] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:18:0)
[14:11:05.666] Build status: STARTED
[14:11:05.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:19:0) after 6m51s
[14:17:56.782] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:19:0)
[14:17:56.841] Build status: STARTED
[14:17:56.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:20:0) after 6m44s
[14:24:41.026] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:20:0)
[14:24:41.047] Build status: STARTED
[14:24:41.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:21:0) after 7m27s
[14:32:08.338] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:21:0)
[14:32:08.359] Build status: STARTED
[14:32:08.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:22:0) after 1m18s
[14:33:26.456] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:22:0)
[14:33:26.523] Build status: STARTED
[14:33:26.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:23:0) after 2m48s
[14:36:14.560] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:23:0)
[14:36:14.583] Build status: STARTED
[14:36:14.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:24:0) after 2m46s
[14:39:00.625] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:24:0)
[14:39:00.663] Build status: STARTED
[14:39:00.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:25:0) after 8m43s
[14:47:43.681] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:25:0)
[14:47:43.702] Build status: STARTED
[14:47:43.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:26:0) after 9m45s
[14:57:28.728] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:26:0)
[14:57:28.755] Build status: STARTED
[14:57:28.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:27:0) after 5m20s
[15:02:48.780] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:27:0)
[15:02:48.801] Build status: STARTED
[15:02:48.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:28:0) after 4m44s
[15:07:32.923] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:28:0)
[15:07:32.948] Build status: STARTED
[15:07:32.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:29:0) after 2m14s
[15:09:47.068] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:29:0)
[15:09:47.094] Build status: STARTED
[15:09:47.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:30:0) after 9m5s
[15:18:52.372] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:30:0)
[15:18:52.393] Build status: STARTED
[15:18:52.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:31:0) after 4m12s
[15:23:04.613] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:31:0)
[15:23:04.655] Build status: STARTED
[15:23:04.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:32:0) after 3m6s
[15:26:10.929] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:32:0)
[15:26:10.948] Build status: STARTED
[15:26:10.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:33:0) after 1m28s
[15:27:40.014] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:33:0)
[15:27:40.048] Build status: STARTED
[15:27:40.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:34:0) after 5m14s
[15:32:54.448] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:34:0)
[15:32:54.480] Build status: STARTED
[15:32:54.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:35:0) after 2m1s
[15:34:55.530] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:35:0)
[15:34:55.575] Build status: STARTED
[15:34:55.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:36:0) after 2m28s
[15:37:23.597] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:36:0)
[15:37:23.671] Build status: STARTED
[15:37:23.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:37:0) after 8m56s
[15:46:19.688] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:37:0)
[15:46:19.714] Build status: STARTED
[15:46:19.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:38:0) after 6m26s
[15:52:45.738] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:38:0)
[15:52:45.771] Build status: STARTED
[15:52:45.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:39:0) after 3m21s
[15:56:06.952] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:39:0)
[15:56:06.978] Build status: STARTED
[15:56:06.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:40:0) after 2m48s
[15:58:54.973] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:40:0)
[15:58:55.032] Build status: STARTED
[15:58:55.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:41:0) after 1m5s
[16:00:00.099] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:41:0)
[16:00:00.118] Build status: STARTED
[16:00:00.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:42:0) after 7m28s
[16:07:28.183] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:42:0)
[16:07:28.210] Build status: STARTED
[16:07:28.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:43:0) after 5m54s
[16:13:22.262] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:43:0)
[16:13:22.284] Build status: STARTED
[16:13:22.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:44:0) after 9m14s
[16:22:36.318] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:44:0)
[16:22:36.343] Build status: STARTED
[16:22:36.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:45:0) after 7m42s
[16:30:18.360] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:45:0)
[16:30:18.469] Build status: STARTED
[16:30:18.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:46:0) after 4m33s
[16:34:51.626] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:46:0)
[16:34:51.700] Build status: STARTED
[16:34:51.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:47:0) after 3m44s
[16:38:35.720] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:47:0)
[16:38:35.742] Build status: STARTED
[16:38:35.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:48:0) after 7m20s
[16:45:55.762] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:48:0)
[16:45:55.816] Build status: STARTED
[16:45:55.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:49:0) after 5m1s
[16:50:56.842] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:49:0)
[16:50:57.031] Build status: STARTED
[16:50:57.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:50:0) after 4m5s
[16:55:02.133] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:50:0)
[16:55:02.184] Build status: STARTED
[16:55:02.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:51:0) after 2m27s
[16:57:29.204] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:51:0)
[16:57:29.226] Build status: STARTED
[16:57:29.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:52:0) after 3m31s
[17:01:00.205] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:52:0)
[17:01:00.251] Build status: STARTED
[17:01:00.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:53:0) after 4m49s
[17:05:49.271] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:53:0)
[17:05:49.292] Build status: STARTED
[17:05:49.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:54:0) after 8m35s
[17:14:24.327] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:54:0)
[17:14:24.346] Build status: STARTED
[17:14:24.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:55:0) after 8m2s
[17:22:26.365] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:55:0)
[17:22:26.383] Build status: STARTED
[17:22:26.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:56:0) after 3m38s
[17:26:04.405] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:56:0)
[17:26:04.511] Build status: STARTED
[17:26:04.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:57:0) after 1m6s
[17:27:10.549] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:57:0)
[17:27:10.569] Build status: STARTED
[17:27:10.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:58:0) after 8m42s
[17:35:52.598] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:58:0)
[17:35:52.620] Build status: STARTED
[17:35:52.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:59:0) after 2m37s
[17:38:29.702] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:59:0)
[17:38:29.771] Build status: STARTED
[17:38:29.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:60:0) after 4m41s
[17:43:10.890] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:60:0)
[17:43:11.624] Build status: STARTED
[17:43:11.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:61:0) after 3m52s
[17:47:03.671] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:61:0)
[17:47:03.865] Build status: STARTED
[17:47:03.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:62:0) after 9m20s
[17:56:23.939] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:62:0)
[17:56:23.962] Build status: STARTED
[17:56:23.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:63:0) after 2m47s
[17:59:10.988] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:63:0)
[17:59:11.006] Build status: STARTED
[17:59:11.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:64:0) after 2m4s
[18:01:15.034] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:64:0)
[18:01:15.055] Build status: STARTED
[18:01:15.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:65:0) after 2m12s
[18:03:27.077] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:65:0)
[18:03:27.095] Build status: STARTED
[18:03:27.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:66:0) after 9m26s
[18:12:53.088] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:66:0)
[18:12:53.176] Build status: STARTED
[18:12:53.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:67:0) after 4m21s
[18:17:14.209] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:67:0)
[18:17:14.227] Build status: STARTED
[18:17:14.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:68:0) after 1m3s
[18:18:17.260] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:68:0)
[18:18:17.358] Build status: STARTED
[18:18:17.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927344217165363104:69:0) after 8m32s
[18:25:51.452] Received PubSub notification, asking Buildbucket for the build status
[18:25:51.468] Build:
{
"id": "8761914155267076577",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 30826,
"createdBy": "project:chromium",
"createTime": "2023-12-12T12:35:29.773427907Z",
"startTime": "2023-12-12T12:35:31.080278Z",
"endTime": "2023-12-12T18:25:50.817641Z",
"updateTime": "2023-12-12T18:25:50.817641Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "248da4b920ec31e99194028191f51b3cbded68f5",
"ref": "refs/heads/main"
}
}
}
[18:25:51.468] Invocation finished in 5h50m22.888429459s with status FAILED