[21:27:54.952] New invocation is queued and will start shortly
[21:27:56.198] Starting the invocation (attempt 1)
[21:27:56.232] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/61967f21fc280d4bece3f357bb7f1c45c87a9b14"
[21:27:56.232] Popped gitiles commit info from properties and tags
[21:27:56.232] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:27:56.232] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:27:56.233] Buildbucket request:
{
"requestId": "8882102832738223120",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "61967f21fc280d4bece3f357bb7f1c45c87a9b14",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8882102832738223120"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:27:56.721] Scheduled build:
{
"id": "8716672770674966881",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 35956,
"createdBy": "project:chromium",
"createTime": "2025-04-24T21:27:56.297412022Z",
"updateTime": "2025-04-24T21:27:56.297412022Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "61967f21fc280d4bece3f357bb7f1c45c87a9b14",
"ref": "refs/heads/main"
}
}
}
[21:27:56.721] Task URL: https://cr-buildbucket.appspot.com/build/8716672770674966881
[21:27:56.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:2:0) after 1m1s
[21:27:57.723] Received PubSub notification, asking Buildbucket for the build status
[21:27:57.746] Build status: SCHEDULED
[21:28:00.077] Received PubSub notification, asking Buildbucket for the build status
[21:28:00.107] Build status: STARTED
[21:28:57.751] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:2:0)
[21:28:57.779] Build status: STARTED
[21:28:57.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:5:0) after 6m38s
[21:35:35.848] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:5:0)
[21:35:35.868] Build status: STARTED
[21:35:35.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:6:0) after 9m20s
[21:44:56.000] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:6:0)
[21:44:56.018] Build status: STARTED
[21:44:56.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:7:0) after 6m19s
[21:51:15.050] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:7:0)
[21:51:15.071] Build status: STARTED
[21:51:15.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:8:0) after 1m39s
[21:52:54.072] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:8:0)
[21:52:54.092] Build status: STARTED
[21:52:54.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:9:0) after 7m7s
[22:00:01.112] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:9:0)
[22:00:01.139] Build status: STARTED
[22:00:01.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:10:0) after 8m1s
[22:08:02.209] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:10:0)
[22:08:02.263] Build status: STARTED
[22:08:02.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:11:0) after 2m6s
[22:10:08.324] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:11:0)
[22:10:08.431] Build status: STARTED
[22:10:08.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:12:0) after 5m27s
[22:15:35.494] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:12:0)
[22:15:35.521] Build status: STARTED
[22:15:35.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:13:0) after 3m10s
[22:18:45.543] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:13:0)
[22:18:45.557] Build status: STARTED
[22:18:45.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:14:0) after 7m27s
[22:26:12.656] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:14:0)
[22:26:12.673] Build status: STARTED
[22:26:12.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:15:0) after 6m14s
[22:32:26.765] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:15:0)
[22:32:26.785] Build status: STARTED
[22:32:26.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:16:0) after 6m57s
[22:39:23.844] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:16:0)
[22:39:23.859] Build status: STARTED
[22:39:23.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:17:0) after 2m57s
[22:42:20.904] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:17:0)
[22:42:20.929] Build status: STARTED
[22:42:20.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:18:0) after 9m15s
[22:51:35.964] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:18:0)
[22:51:36.029] Build status: STARTED
[22:51:36.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:19:0) after 7m6s
[22:58:42.039] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:19:0)
[22:58:42.059] Build status: STARTED
[22:58:42.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:20:0) after 2m56s
[23:01:38.185] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:20:0)
[23:01:38.205] Build status: STARTED
[23:01:38.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:21:0) after 7m8s
[23:08:46.450] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:21:0)
[23:08:46.466] Build status: STARTED
[23:08:46.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:22:0) after 1m28s
[23:10:15.034] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:22:0)
[23:10:15.048] Build status: STARTED
[23:10:15.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:23:0) after 7m44s
[23:17:59.124] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:23:0)
[23:17:59.142] Build status: STARTED
[23:17:59.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:24:0) after 5m49s
[23:23:48.150] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:24:0)
[23:23:48.168] Build status: STARTED
[23:23:48.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:25:0) after 6m39s
[23:30:27.257] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:25:0)
[23:30:27.273] Build status: STARTED
[23:30:27.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:26:0) after 1m59s
[23:32:26.387] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:26:0)
[23:32:26.403] Build status: STARTED
[23:32:26.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:27:0) after 8m1s
[23:40:27.447] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:27:0)
[23:40:27.467] Build status: STARTED
[23:40:27.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:28:0) after 6m3s
[23:46:30.552] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:28:0)
[23:46:30.565] Build status: STARTED
[23:46:30.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:29:0) after 7m30s
[23:54:00.613] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:29:0)
[23:54:00.631] Build status: STARTED
[23:54:00.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:30:0) after 9m47s
[00:03:47.949] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:30:0)
[00:03:47.966] Build status: STARTED
[00:03:47.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:31:0) after 5m4s
[00:08:52.003] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:31:0)
[00:08:52.028] Build status: STARTED
[00:08:52.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:32:0) after 7m8s
[00:16:00.052] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:32:0)
[00:16:00.068] Build status: STARTED
[00:16:00.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:33:0) after 2m19s
[00:18:19.105] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:33:0)
[00:18:19.123] Build status: STARTED
[00:18:19.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:34:0) after 8m51s
[00:27:10.242] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:34:0)
[00:27:10.261] Build status: STARTED
[00:27:10.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:35:0) after 7m11s
[00:34:21.297] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:35:0)
[00:34:21.365] Build status: STARTED
[00:34:21.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:36:0) after 9m3s
[00:43:24.475] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:36:0)
[00:43:24.498] Build status: STARTED
[00:43:24.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:37:0) after 4m17s
[00:47:41.644] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:37:0)
[00:47:41.659] Build status: STARTED
[00:47:41.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:38:0) after 5m50s
[00:53:31.684] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:38:0)
[00:53:31.708] Build status: STARTED
[00:53:31.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:39:0) after 4m0s
[00:57:31.770] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:39:0)
[00:57:31.790] Build status: STARTED
[00:57:31.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:40:0) after 3m59s
[01:01:30.821] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:40:0)
[01:01:30.944] Build status: STARTED
[01:01:30.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:41:0) after 5m6s
[01:06:37.053] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:41:0)
[01:06:37.071] Build status: STARTED
[01:06:37.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:42:0) after 5m40s
[01:12:17.072] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:42:0)
[01:12:17.087] Build status: STARTED
[01:12:17.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:43:0) after 1m49s
[01:14:06.172] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:43:0)
[01:14:06.191] Build status: STARTED
[01:14:06.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:44:0) after 5m13s
[01:19:19.267] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:44:0)
[01:19:19.284] Build status: STARTED
[01:19:19.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:45:0) after 3m20s
[01:22:39.313] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:45:0)
[01:22:39.330] Build status: STARTED
[01:22:39.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:46:0) after 7m38s
[01:30:17.370] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:46:0)
[01:30:17.386] Build status: STARTED
[01:30:17.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:47:0) after 9m9s
[01:39:26.579] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:47:0)
[01:39:26.593] Build status: STARTED
[01:39:26.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:48:0) after 2m15s
[01:41:41.631] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:48:0)
[01:41:41.652] Build status: STARTED
[01:41:41.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:49:0) after 9m17s
[01:50:58.709] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:49:0)
[01:50:58.819] Build status: STARTED
[01:50:58.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:50:0) after 8m40s
[01:59:38.850] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:50:0)
[01:59:38.866] Build status: STARTED
[01:59:38.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:51:0) after 7m36s
[02:07:14.885] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:51:0)
[02:07:14.916] Build status: STARTED
[02:07:14.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:52:0) after 4m38s
[02:11:52.941] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:52:0)
[02:11:52.960] Build status: STARTED
[02:11:52.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:53:0) after 7m46s
[02:19:39.133] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:53:0)
[02:19:39.149] Build status: STARTED
[02:19:39.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:54:0) after 6m31s
[02:26:10.180] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:54:0)
[02:26:10.204] Build status: STARTED
[02:26:10.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:55:0) after 3m53s
[02:30:03.248] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:55:0)
[02:30:03.266] Build status: STARTED
[02:30:03.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:56:0) after 8m44s
[02:38:47.403] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:56:0)
[02:38:47.418] Build status: STARTED
[02:38:47.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:57:0) after 4m36s
[02:43:23.458] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:57:0)
[02:43:23.481] Build status: STARTED
[02:43:23.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:58:0) after 9m30s
[02:52:53.755] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:58:0)
[02:52:53.776] Build status: STARTED
[02:52:53.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:59:0) after 2m32s
[02:55:25.915] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:59:0)
[02:55:25.936] Build status: STARTED
[02:55:25.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:60:0) after 8m45s
[03:04:10.969] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:60:0)
[03:04:10.985] Build status: STARTED
[03:04:10.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:61:0) after 3m59s
[03:08:10.068] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:61:0)
[03:08:10.085] Build status: STARTED
[03:08:10.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:62:0) after 7m42s
[03:15:52.110] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:62:0)
[03:15:52.158] Build status: STARTED
[03:15:52.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8882102832738223120:63:0) after 2m46s
[03:17:02.487] Received PubSub notification, asking Buildbucket for the build status
[03:17:02.524] Build:
{
"id": "8716672770674966881",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 35956,
"createdBy": "project:chromium",
"createTime": "2025-04-24T21:27:56.297412022Z",
"startTime": "2025-04-24T21:27:59.875256059Z",
"endTime": "2025-04-25T03:17:02.231387202Z",
"updateTime": "2025-04-25T03:17:02.231387202Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "61967f21fc280d4bece3f357bb7f1c45c87a9b14",
"ref": "refs/heads/main"
}
}
}
[03:17:02.524] Invocation finished in 5h49m7.578327237s with status FAILED