[18:49:44.232] New invocation is queued and will start shortly
[18:49:45.362] Starting the invocation (attempt 1)
[18:49:45.393] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/4ed61c3109d0ac36c94e728e4651bb5758aeb28a"
[18:49:45.393] Popped gitiles commit info from properties and tags
[18:49:45.393] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:49:45.394] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:49:45.394] Buildbucket request:
{
"requestId": "8918985749811845248",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4ed61c3109d0ac36c94e728e4651bb5758aeb28a",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8918985749811845248"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:49:45.991] Scheduled build:
{
"id": "8753555687861369441",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 31427,
"createdBy": "project:chromium",
"createTime": "2024-03-13T18:49:45.462022568Z",
"updateTime": "2024-03-13T18:49:45.462022568Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4ed61c3109d0ac36c94e728e4651bb5758aeb28a",
"ref": "refs/heads/main"
}
}
}
[18:49:45.991] Task URL: https://cr-buildbucket.appspot.com/build/8753555687861369441
[18:49:45.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:2:0) after 6m21s
[18:49:46.959] Received PubSub notification, asking Buildbucket for the build status
[18:49:47.008] Build status: SCHEDULED
[18:49:48.695] Received PubSub notification, asking Buildbucket for the build status
[18:49:48.711] Build status: STARTED
[18:56:07.437] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:2:0)
[18:56:07.467] Build status: STARTED
[18:56:07.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:5:0) after 3m18s
[18:59:25.493] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:5:0)
[18:59:25.516] Build status: STARTED
[18:59:25.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:6:0) after 1m3s
[19:00:28.782] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:6:0)
[19:00:29.008] Build status: STARTED
[19:00:29.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:7:0) after 5m59s
[19:06:28.281] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:7:0)
[19:06:28.324] Build status: STARTED
[19:06:28.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:8:0) after 5m33s
[19:12:01.344] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:8:0)
[19:12:01.360] Build status: STARTED
[19:12:01.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:9:0) after 2m37s
[19:14:38.378] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:9:0)
[19:14:38.408] Build status: STARTED
[19:14:38.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:10:0) after 5m44s
[19:20:22.514] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:10:0)
[19:20:22.544] Build status: STARTED
[19:20:22.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:11:0) after 2m38s
[19:23:00.667] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:11:0)
[19:23:00.696] Build status: STARTED
[19:23:00.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:12:0) after 6m23s
[19:29:23.737] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:12:0)
[19:29:23.833] Build status: STARTED
[19:29:23.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:13:0) after 2m59s
[19:32:22.948] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:13:0)
[19:32:22.973] Build status: STARTED
[19:32:22.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:14:0) after 5m2s
[19:37:24.969] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:14:0)
[19:37:25.008] Build status: STARTED
[19:37:25.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:15:0) after 6m57s
[19:44:22.381] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:15:0)
[19:44:22.408] Build status: STARTED
[19:44:22.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:16:0) after 4m18s
[19:48:40.445] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:16:0)
[19:48:40.476] Build status: STARTED
[19:48:40.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:17:0) after 5m37s
[19:54:17.555] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:17:0)
[19:54:17.583] Build status: STARTED
[19:54:17.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:18:0) after 4m4s
[19:58:21.604] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:18:0)
[19:58:21.929] Build status: STARTED
[19:58:21.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:19:0) after 4m24s
[20:02:45.981] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:19:0)
[20:02:46.008] Build status: STARTED
[20:02:46.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:20:0) after 2m9s
[20:04:55.056] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:20:0)
[20:04:55.140] Build status: STARTED
[20:04:55.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:21:0) after 3m16s
[20:08:11.145] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:21:0)
[20:08:11.209] Build status: STARTED
[20:08:11.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:22:0) after 7m44s
[20:15:55.287] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:22:0)
[20:15:55.326] Build status: STARTED
[20:15:55.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:23:0) after 2m20s
[20:18:15.340] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:23:0)
[20:18:15.361] Build status: STARTED
[20:18:15.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:24:0) after 1m0s
[20:19:15.433] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:24:0)
[20:19:15.459] Build status: STARTED
[20:19:15.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:25:0) after 2m15s
[20:21:30.485] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:25:0)
[20:21:30.515] Build status: STARTED
[20:21:30.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:26:0) after 7m18s
[20:28:48.542] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:26:0)
[20:28:48.569] Build status: STARTED
[20:28:48.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:27:0) after 6m3s
[20:34:51.593] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:27:0)
[20:34:51.617] Build status: STARTED
[20:34:51.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:28:0) after 9m4s
[20:43:55.636] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:28:0)
[20:43:55.686] Build status: STARTED
[20:43:55.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:29:0) after 4m51s
[20:48:46.838] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:29:0)
[20:48:46.881] Build status: STARTED
[20:48:46.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:30:0) after 6m33s
[20:55:19.874] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:30:0)
[20:55:19.901] Build status: STARTED
[20:55:19.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:31:0) after 3m20s
[20:58:40.218] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:31:0)
[20:58:40.284] Build status: STARTED
[20:58:40.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:32:0) after 6m40s
[21:05:20.443] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:32:0)
[21:05:20.549] Build status: STARTED
[21:05:20.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:33:0) after 5m31s
[21:10:51.568] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:33:0)
[21:10:51.612] Build status: STARTED
[21:10:51.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:34:0) after 5m1s
[21:15:52.643] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:34:0)
[21:15:52.664] Build status: STARTED
[21:15:52.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:35:0) after 8m55s
[21:24:47.736] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:35:0)
[21:24:47.775] Build status: STARTED
[21:24:47.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:36:0) after 6m34s
[21:31:21.998] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:36:0)
[21:31:22.016] Build status: STARTED
[21:31:22.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:37:0) after 3m2s
[21:34:24.144] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:37:0)
[21:34:24.165] Build status: STARTED
[21:34:24.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:38:0) after 1m27s
[21:35:51.285] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:38:0)
[21:35:51.460] Build status: STARTED
[21:35:51.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:39:0) after 8m23s
[21:44:14.514] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:39:0)
[21:44:14.549] Build status: STARTED
[21:44:14.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:40:0) after 2m23s
[21:46:37.581] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:40:0)
[21:46:37.616] Build status: STARTED
[21:46:37.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:41:0) after 2m1s
[21:48:38.648] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:41:0)
[21:48:38.664] Build status: STARTED
[21:48:38.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:42:0) after 2m32s
[21:51:10.683] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:42:0)
[21:51:10.728] Build status: STARTED
[21:51:10.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:43:0) after 1m47s
[21:52:57.753] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:43:0)
[21:52:57.776] Build status: STARTED
[21:52:57.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:44:0) after 7m48s
[22:00:45.801] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:44:0)
[22:00:45.832] Build status: STARTED
[22:00:45.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:45:0) after 7m25s
[22:08:11.347] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:45:0)
[22:08:11.374] Build status: STARTED
[22:08:11.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:46:0) after 7m14s
[22:15:25.402] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:46:0)
[22:15:25.421] Build status: STARTED
[22:15:25.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:47:0) after 6m20s
[22:21:45.684] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:47:0)
[22:21:45.741] Build status: STARTED
[22:21:45.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:48:0) after 7m50s
[22:29:35.845] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:48:0)
[22:29:35.872] Build status: STARTED
[22:29:35.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:49:0) after 7m0s
[22:36:36.105] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:49:0)
[22:36:36.134] Build status: STARTED
[22:36:36.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:50:0) after 9m42s
[22:46:18.651] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:50:0)
[22:46:18.679] Build status: STARTED
[22:46:18.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:51:0) after 2m44s
[22:49:02.765] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:51:0)
[22:49:02.820] Build status: STARTED
[22:49:02.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:52:0) after 8m24s
[22:57:26.900] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:52:0)
[22:57:26.972] Build status: STARTED
[22:57:26.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:53:0) after 7m39s
[23:05:06.391] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:53:0)
[23:05:06.410] Build status: STARTED
[23:05:06.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:54:0) after 8m54s
[23:14:00.438] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:54:0)
[23:14:00.481] Build status: STARTED
[23:14:00.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:55:0) after 4m15s
[23:18:15.711] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:55:0)
[23:18:15.766] Build status: STARTED
[23:18:15.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:56:0) after 6m16s
[23:24:31.791] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:56:0)
[23:24:31.817] Build status: STARTED
[23:24:31.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:57:0) after 5m49s
[23:30:20.869] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:57:0)
[23:30:20.989] Build status: STARTED
[23:30:20.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:58:0) after 6m21s
[23:36:42.307] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:58:0)
[23:36:42.332] Build status: STARTED
[23:36:42.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:59:0) after 3m48s
[23:40:30.707] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:59:0)
[23:40:30.725] Build status: STARTED
[23:40:30.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918985749811845248:60:0) after 3m6s
[23:43:15.592] Received PubSub notification, asking Buildbucket for the build status
[23:43:15.611] Build:
{
"id": "8753555687861369441",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 31427,
"createdBy": "project:chromium",
"createTime": "2024-03-13T18:49:45.462022568Z",
"startTime": "2024-03-13T18:49:47.120429Z",
"endTime": "2024-03-13T23:43:04.333675Z",
"updateTime": "2024-03-13T23:43:04.333675Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4ed61c3109d0ac36c94e728e4651bb5758aeb28a",
"ref": "refs/heads/main"
}
}
}
[23:43:15.611] Invocation finished in 4h53m31.39197677s with status FAILED