[06:31:02.265] New invocation is queued and will start shortly
[06:31:03.425] Starting the invocation (attempt 1)
[06:31:03.449] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f9fada98083846bfbb4cffaa7483595740b93806"
[06:31:03.449] Popped gitiles commit info from properties and tags
[06:31:03.449] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[06:31:03.451] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[06:31:03.451] Buildbucket request:
{
"requestId": "8885601944159783968",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f9fada98083846bfbb4cffaa7483595740b93806",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8885601944159783968"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[06:31:04.086] Scheduled build:
{
"id": "8720171882161395441",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 35023,
"createdBy": "project:chromium",
"createTime": "2025-03-17T06:31:03.542482955Z",
"updateTime": "2025-03-17T06:31:03.542482955Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f9fada98083846bfbb4cffaa7483595740b93806",
"ref": "refs/heads/main"
}
}
}
[06:31:04.086] Task URL: https://cr-buildbucket.appspot.com/build/8720171882161395441
[06:31:04.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:2:0) after 4m53s
[06:31:05.073] Received PubSub notification, asking Buildbucket for the build status
[06:31:05.098] Build status: SCHEDULED
[06:31:08.166] Received PubSub notification, asking Buildbucket for the build status
[06:31:08.235] Build status: STARTED
[06:35:57.116] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:2:0)
[06:35:57.142] Build status: STARTED
[06:35:57.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:5:0) after 6m40s
[06:42:37.370] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:5:0)
[06:42:37.398] Build status: STARTED
[06:42:37.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:6:0) after 5m23s
[06:48:00.533] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:6:0)
[06:48:00.548] Build status: STARTED
[06:48:00.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:7:0) after 2m20s
[06:50:20.709] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:7:0)
[06:50:20.723] Build status: STARTED
[06:50:20.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:8:0) after 4m12s
[06:54:32.743] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:8:0)
[06:54:32.771] Build status: STARTED
[06:54:32.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:9:0) after 6m19s
[07:00:51.931] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:9:0)
[07:00:51.961] Build status: STARTED
[07:00:51.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:10:0) after 1m21s
[07:02:13.021] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:10:0)
[07:02:13.045] Build status: STARTED
[07:02:13.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:11:0) after 9m15s
[07:11:28.078] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:11:0)
[07:11:28.096] Build status: STARTED
[07:11:28.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:12:0) after 4m18s
[07:15:46.214] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:12:0)
[07:15:46.249] Build status: STARTED
[07:15:46.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:13:0) after 5m10s
[07:20:56.293] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:13:0)
[07:20:56.314] Build status: STARTED
[07:20:56.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:14:0) after 8m43s
[07:29:39.436] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:14:0)
[07:29:39.461] Build status: STARTED
[07:29:39.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:15:0) after 7m57s
[07:37:36.496] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:15:0)
[07:37:36.520] Build status: STARTED
[07:37:36.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:16:0) after 2m59s
[07:40:35.980] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:16:0)
[07:40:36.009] Build status: STARTED
[07:40:36.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:17:0) after 3m28s
[07:44:04.048] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:17:0)
[07:44:04.065] Build status: STARTED
[07:44:04.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:18:0) after 8m47s
[07:52:51.277] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:18:0)
[07:52:51.355] Build status: STARTED
[07:52:51.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:19:0) after 4m19s
[07:57:10.377] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:19:0)
[07:57:10.468] Build status: STARTED
[07:57:10.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:20:0) after 7m26s
[08:04:36.488] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:20:0)
[08:04:36.511] Build status: STARTED
[08:04:36.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:21:0) after 2m27s
[08:07:03.533] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:21:0)
[08:07:03.551] Build status: STARTED
[08:07:03.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:22:0) after 1m43s
[08:08:46.576] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:22:0)
[08:08:46.597] Build status: STARTED
[08:08:46.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:23:0) after 3m55s
[08:12:41.662] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:23:0)
[08:12:41.677] Build status: STARTED
[08:12:41.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:24:0) after 6m50s
[08:19:31.991] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:24:0)
[08:19:32.056] Build status: STARTED
[08:19:32.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:25:0) after 6m57s
[08:26:29.080] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:25:0)
[08:26:29.125] Build status: STARTED
[08:26:29.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:26:0) after 6m57s
[08:33:26.152] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:26:0)
[08:33:26.168] Build status: STARTED
[08:33:26.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:27:0) after 3m8s
[08:36:34.187] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:27:0)
[08:36:34.222] Build status: STARTED
[08:36:34.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:28:0) after 4m48s
[08:41:22.248] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:28:0)
[08:41:22.272] Build status: STARTED
[08:41:22.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:29:0) after 6m48s
[08:48:10.383] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:29:0)
[08:48:10.406] Build status: STARTED
[08:48:10.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:30:0) after 5m40s
[08:53:50.458] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:30:0)
[08:53:50.539] Build status: STARTED
[08:53:50.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:31:0) after 2m16s
[08:56:06.661] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:31:0)
[08:56:06.680] Build status: STARTED
[08:56:06.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:32:0) after 1m7s
[08:57:13.799] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:32:0)
[08:57:13.825] Build status: STARTED
[08:57:13.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:33:0) after 4m27s
[09:01:41.036] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:33:0)
[09:01:41.053] Build status: STARTED
[09:01:41.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:34:0) after 7m24s
[09:09:05.082] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:34:0)
[09:09:05.101] Build status: STARTED
[09:09:05.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:35:0) after 8m12s
[09:17:17.226] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:35:0)
[09:17:17.250] Build status: STARTED
[09:17:17.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:36:0) after 1m1s
[09:18:18.285] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:36:0)
[09:18:18.302] Build status: STARTED
[09:18:18.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:37:0) after 8m44s
[09:27:02.464] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:37:0)
[09:27:02.534] Build status: STARTED
[09:27:02.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:38:0) after 8m8s
[09:35:11.103] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:38:0)
[09:35:11.119] Build status: STARTED
[09:35:11.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:39:0) after 2m57s
[09:38:08.144] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:39:0)
[09:38:08.170] Build status: STARTED
[09:38:08.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:40:0) after 9m10s
[09:47:18.195] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:40:0)
[09:47:18.239] Build status: STARTED
[09:47:18.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:41:0) after 3m5s
[09:50:23.219] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:41:0)
[09:50:23.234] Build status: STARTED
[09:50:23.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:42:0) after 5m10s
[09:55:33.442] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:42:0)
[09:55:33.496] Build status: STARTED
[09:55:33.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:43:0) after 1m12s
[09:56:45.702] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:43:0)
[09:56:45.733] Build status: STARTED
[09:56:45.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:44:0) after 9m44s
[10:06:29.958] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:44:0)
[10:06:30.015] Build status: STARTED
[10:06:30.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:45:0) after 2m43s
[10:09:13.033] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:45:0)
[10:09:13.050] Build status: STARTED
[10:09:13.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:46:0) after 4m18s
[10:13:31.111] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:46:0)
[10:13:31.126] Build status: STARTED
[10:13:31.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:47:0) after 8m51s
[10:22:22.887] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:47:0)
[10:22:22.907] Build status: STARTED
[10:22:22.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:48:0) after 9m46s
[10:32:08.969] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:48:0)
[10:32:08.999] Build status: STARTED
[10:32:08.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:49:0) after 1m32s
[10:33:41.025] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:49:0)
[10:33:41.080] Build status: STARTED
[10:33:41.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:50:0) after 7m52s
[10:41:33.311] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:50:0)
[10:41:33.331] Build status: STARTED
[10:41:33.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:51:0) after 6m16s
[10:47:49.476] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:51:0)
[10:47:49.494] Build status: STARTED
[10:47:49.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:52:0) after 8m27s
[10:56:16.819] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:52:0)
[10:56:16.832] Build status: STARTED
[10:56:16.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:53:0) after 5m20s
[11:01:36.887] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:53:0)
[11:01:36.904] Build status: STARTED
[11:01:36.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:54:0) after 6m34s
[11:08:10.942] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:54:0)
[11:08:10.966] Build status: STARTED
[11:08:10.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:55:0) after 9m58s
[11:18:08.987] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:55:0)
[11:18:09.005] Build status: STARTED
[11:18:09.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:56:0) after 4m31s
[11:22:40.016] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:56:0)
[11:22:40.033] Build status: STARTED
[11:22:40.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:57:0) after 1m43s
[11:24:23.354] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:57:0)
[11:24:23.369] Build status: STARTED
[11:24:23.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:58:0) after 4m26s
[11:28:49.654] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:58:0)
[11:28:49.675] Build status: STARTED
[11:28:49.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:59:0) after 1m14s
[11:30:03.738] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:59:0)
[11:30:03.764] Build status: STARTED
[11:30:03.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:60:0) after 2m16s
[11:32:19.924] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:60:0)
[11:32:19.961] Build status: STARTED
[11:32:19.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:61:0) after 6m52s
[11:39:12.031] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:61:0)
[11:39:12.052] Build status: STARTED
[11:39:12.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:62:0) after 2m11s
[11:41:23.180] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:62:0)
[11:41:23.202] Build status: STARTED
[11:41:23.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:63:0) after 3m31s
[11:44:54.536] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:63:0)
[11:44:54.567] Build status: STARTED
[11:44:54.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:64:0) after 3m21s
[11:48:15.645] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:64:0)
[11:48:15.665] Build status: STARTED
[11:48:15.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:65:0) after 7m52s
[11:56:07.685] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:65:0)
[11:56:07.703] Build status: STARTED
[11:56:07.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:66:0) after 7m34s
[12:03:41.789] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:66:0)
[12:03:41.826] Build status: STARTED
[12:03:41.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:67:0) after 1m52s
[12:05:33.849] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:67:0)
[12:05:33.884] Build status: STARTED
[12:05:33.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885601944159783968:68:0) after 8m30s
[12:05:46.263] Received PubSub notification, asking Buildbucket for the build status
[12:05:46.281] Build:
{
"id": "8720171882161395441",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 35023,
"createdBy": "project:chromium",
"createTime": "2025-03-17T06:31:03.542482955Z",
"startTime": "2025-03-17T06:31:07.205873961Z",
"endTime": "2025-03-17T12:05:44.079456005Z",
"updateTime": "2025-03-17T12:05:44.079456005Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f9fada98083846bfbb4cffaa7483595740b93806",
"ref": "refs/heads/main"
}
}
}
[12:05:46.281] Invocation finished in 5h34m44.028837627s with status FAILED