[05:04:26.234] New invocation is queued and will start shortly
[05:04:27.383] Starting the invocation (attempt 1)
[05:04:27.418] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a27d965ef73199c7ce8badccbdeff1d1d078ab28"
[05:04:27.418] Popped gitiles commit info from properties and tags
[05:04:27.418] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:04:27.418] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:04:27.418] Buildbucket request:
{
"requestId": "8885516795630162096",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a27d965ef73199c7ce8badccbdeff1d1d078ab28",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8885516795630162096"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[05:04:27.912] Scheduled build:
{
"id": "8720086733657513025",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 35027,
"createdBy": "project:chromium",
"createTime": "2025-03-18T05:04:27.483322195Z",
"updateTime": "2025-03-18T05:04:27.483322195Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a27d965ef73199c7ce8badccbdeff1d1d078ab28",
"ref": "refs/heads/main"
}
}
}
[05:04:27.912] Task URL: https://cr-buildbucket.appspot.com/build/8720086733657513025
[05:04:27.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:2:0) after 3m29s
[05:04:28.895] Received PubSub notification, asking Buildbucket for the build status
[05:04:28.917] Build status: SCHEDULED
[05:04:32.390] Received PubSub notification, asking Buildbucket for the build status
[05:04:32.549] Build status: STARTED
[05:07:57.004] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:2:0)
[05:07:57.025] Build status: STARTED
[05:07:57.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:5:0) after 5m17s
[05:13:14.094] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:5:0)
[05:13:14.119] Build status: STARTED
[05:13:14.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:6:0) after 4m8s
[05:17:22.145] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:6:0)
[05:17:22.509] Build status: STARTED
[05:17:22.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:7:0) after 7m40s
[05:25:02.565] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:7:0)
[05:25:02.590] Build status: STARTED
[05:25:02.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:8:0) after 2m54s
[05:27:56.608] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:8:0)
[05:27:56.682] Build status: STARTED
[05:27:56.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:9:0) after 2m20s
[05:30:16.707] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:9:0)
[05:30:16.736] Build status: STARTED
[05:30:16.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:10:0) after 5m5s
[05:35:21.731] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:10:0)
[05:35:21.765] Build status: STARTED
[05:35:21.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:11:0) after 1m8s
[05:36:29.790] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:11:0)
[05:36:30.116] Build status: STARTED
[05:36:30.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:12:0) after 9m14s
[05:45:44.151] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:12:0)
[05:45:44.170] Build status: STARTED
[05:45:44.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:13:0) after 4m32s
[05:50:16.198] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:13:0)
[05:50:16.225] Build status: STARTED
[05:50:16.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:14:0) after 4m44s
[05:55:00.250] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:14:0)
[05:55:00.271] Build status: STARTED
[05:55:00.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:15:0) after 6m33s
[06:01:33.442] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:15:0)
[06:01:33.465] Build status: STARTED
[06:01:33.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:16:0) after 5m33s
[06:07:06.572] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:16:0)
[06:07:06.593] Build status: STARTED
[06:07:06.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:17:0) after 9m14s
[06:16:21.376] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:17:0)
[06:16:21.438] Build status: STARTED
[06:16:21.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:18:0) after 5m33s
[06:21:54.461] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:18:0)
[06:21:54.478] Build status: STARTED
[06:21:54.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:19:0) after 8m40s
[06:30:34.732] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:19:0)
[06:30:34.753] Build status: STARTED
[06:30:34.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:20:0) after 4m41s
[06:35:16.050] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:20:0)
[06:35:16.081] Build status: STARTED
[06:35:16.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:21:0) after 9m13s
[06:44:29.100] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:21:0)
[06:44:29.117] Build status: STARTED
[06:44:29.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:22:0) after 5m20s
[06:49:49.204] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:22:0)
[06:49:49.239] Build status: STARTED
[06:49:49.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:23:0) after 2m18s
[06:52:07.516] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:23:0)
[06:52:07.534] Build status: STARTED
[06:52:07.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:24:0) after 3m18s
[06:55:25.698] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:24:0)
[06:55:25.722] Build status: STARTED
[06:55:25.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:25:0) after 2m7s
[06:57:32.779] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:25:0)
[06:57:32.800] Build status: STARTED
[06:57:32.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:26:0) after 8m11s
[07:05:44.042] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:26:0)
[07:05:44.089] Build status: STARTED
[07:05:44.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:27:0) after 2m51s
[07:08:35.480] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:27:0)
[07:08:35.497] Build status: STARTED
[07:08:35.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:28:0) after 2m5s
[07:10:40.481] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:28:0)
[07:10:40.496] Build status: STARTED
[07:10:40.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:29:0) after 1m10s
[07:11:50.526] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:29:0)
[07:11:50.589] Build status: STARTED
[07:11:50.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:30:0) after 1m42s
[07:13:32.793] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:30:0)
[07:13:32.810] Build status: STARTED
[07:13:32.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:31:0) after 8m16s
[07:21:50.252] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:31:0)
[07:21:50.303] Build status: STARTED
[07:21:50.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:32:0) after 8m1s
[07:29:51.331] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:32:0)
[07:29:51.350] Build status: STARTED
[07:29:51.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:33:0) after 1m16s
[07:31:07.424] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:33:0)
[07:31:07.439] Build status: STARTED
[07:31:07.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:34:0) after 8m11s
[07:39:18.564] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:34:0)
[07:39:18.582] Build status: STARTED
[07:39:18.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:35:0) after 4m18s
[07:43:36.611] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:35:0)
[07:43:36.625] Build status: STARTED
[07:43:36.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:36:0) after 4m29s
[07:48:05.669] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:36:0)
[07:48:05.696] Build status: STARTED
[07:48:05.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:37:0) after 7m33s
[07:55:38.722] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:37:0)
[07:55:38.735] Build status: STARTED
[07:55:38.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:38:0) after 6m27s
[08:02:05.821] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:38:0)
[08:02:05.836] Build status: STARTED
[08:02:05.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:39:0) after 7m57s
[08:10:02.858] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:39:0)
[08:10:02.877] Build status: STARTED
[08:10:02.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:40:0) after 6m56s
[08:16:58.947] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:40:0)
[08:16:58.963] Build status: STARTED
[08:16:58.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:41:0) after 6m47s
[08:23:45.991] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:41:0)
[08:23:46.007] Build status: STARTED
[08:23:46.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:42:0) after 9m20s
[08:33:06.028] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:42:0)
[08:33:06.051] Build status: STARTED
[08:33:06.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:43:0) after 3m46s
[08:36:52.339] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:43:0)
[08:36:52.358] Build status: STARTED
[08:36:52.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:44:0) after 2m1s
[08:38:53.384] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:44:0)
[08:38:53.399] Build status: STARTED
[08:38:53.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:45:0) after 2m38s
[08:41:31.869] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:45:0)
[08:41:31.891] Build status: STARTED
[08:41:31.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:46:0) after 2m2s
[08:43:34.015] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:46:0)
[08:43:34.031] Build status: STARTED
[08:43:34.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:47:0) after 1m25s
[08:44:59.153] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:47:0)
[08:44:59.216] Build status: STARTED
[08:44:59.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:48:0) after 2m33s
[08:47:32.343] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:48:0)
[08:47:32.369] Build status: STARTED
[08:47:32.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:49:0) after 9m37s
[08:57:09.575] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:49:0)
[08:57:09.598] Build status: STARTED
[08:57:09.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:50:0) after 4m31s
[09:01:40.714] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:50:0)
[09:01:40.731] Build status: STARTED
[09:01:40.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:51:0) after 9m2s
[09:10:42.809] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:51:0)
[09:10:42.825] Build status: STARTED
[09:10:42.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:52:0) after 5m9s
[09:15:51.956] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:52:0)
[09:15:51.972] Build status: STARTED
[09:15:51.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:53:0) after 2m14s
[09:18:06.007] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:53:0)
[09:18:06.087] Build status: STARTED
[09:18:06.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:54:0) after 3m40s
[09:21:46.388] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:54:0)
[09:21:46.471] Build status: STARTED
[09:21:46.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:55:0) after 2m12s
[09:23:58.491] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:55:0)
[09:23:58.509] Build status: STARTED
[09:23:58.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:56:0) after 5m18s
[09:29:16.548] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:56:0)
[09:29:16.565] Build status: STARTED
[09:29:16.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:57:0) after 9m14s
[09:38:30.644] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:57:0)
[09:38:30.659] Build status: STARTED
[09:38:30.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:58:0) after 4m17s
[09:42:47.723] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:58:0)
[09:42:47.740] Build status: STARTED
[09:42:47.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:59:0) after 7m48s
[09:50:35.768] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:59:0)
[09:50:35.784] Build status: STARTED
[09:50:35.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:60:0) after 6m0s
[09:56:35.864] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:60:0)
[09:56:35.885] Build status: STARTED
[09:56:35.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:61:0) after 6m32s
[10:03:07.889] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:61:0)
[10:03:07.980] Build status: STARTED
[10:03:07.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:62:0) after 7m8s
[10:10:16.085] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:62:0)
[10:10:16.108] Build status: STARTED
[10:10:16.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:63:0) after 1m46s
[10:12:02.131] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:63:0)
[10:12:02.146] Build status: STARTED
[10:12:02.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:64:0) after 3m28s
[10:15:30.170] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:64:0)
[10:15:30.189] Build status: STARTED
[10:15:30.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:65:0) after 3m1s
[10:18:31.657] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:65:0)
[10:18:31.673] Build status: STARTED
[10:18:31.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:66:0) after 5m12s
[10:23:43.701] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:66:0)
[10:23:43.717] Build status: STARTED
[10:23:43.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:67:0) after 3m13s
[10:26:56.775] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:67:0)
[10:26:56.800] Build status: STARTED
[10:26:56.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:68:0) after 9m8s
[10:36:04.832] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:68:0)
[10:36:04.845] Build status: STARTED
[10:36:04.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885516795630162096:69:0) after 6m38s
[10:42:15.952] Received PubSub notification, asking Buildbucket for the build status
[10:42:15.974] Build:
{
"id": "8720086733657513025",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 35027,
"createdBy": "project:chromium",
"createTime": "2025-03-18T05:04:27.483322195Z",
"startTime": "2025-03-18T05:04:30.860174635Z",
"endTime": "2025-03-18T10:42:15.520200256Z",
"updateTime": "2025-03-18T10:42:15.520200256Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a27d965ef73199c7ce8badccbdeff1d1d078ab28",
"ref": "refs/heads/main"
}
}
}
[10:42:15.974] Invocation finished in 5h37m49.754708839s with status FAILED