[21:52:04.502] New invocation is queued and will start shortly
[21:52:05.645] Starting the invocation (attempt 1)
[21:52:05.674] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9b48fd0c7048c43e3e1523222b17f1537edb52a3"
[21:52:05.674] Popped gitiles commit info from properties and tags
[21:52:05.674] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:52:05.674] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:52:05.674] Buildbucket request:
{
"requestId": "8876846688731752752",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9b48fd0c7048c43e3e1523222b17f1537edb52a3",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8876846688731752752"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:52:06.406] Scheduled build:
{
"id": "8711416626755473665",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 36908,
"createdBy": "project:chromium",
"createTime": "2025-06-21T21:52:05.756540190Z",
"updateTime": "2025-06-21T21:52:05.756540190Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9b48fd0c7048c43e3e1523222b17f1537edb52a3",
"ref": "refs/heads/main"
}
},
"canary": true
}
[21:52:06.406] Task URL: https://cr-buildbucket.appspot.com/build/8711416626755473665
[21:52:06.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:2:0) after 3m48s
[21:52:07.185] Received PubSub notification, asking Buildbucket for the build status
[21:52:07.211] Build status: SCHEDULED
[21:52:09.382] Received PubSub notification, asking Buildbucket for the build status
[21:52:09.400] Build status: STARTED
[21:55:54.426] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:2:0)
[21:55:54.444] Build status: STARTED
[21:55:54.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:5:0) after 8m47s
[22:04:41.632] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:5:0)
[22:04:41.671] Build status: STARTED
[22:04:41.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:6:0) after 2m43s
[22:07:24.997] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:6:0)
[22:07:25.019] Build status: STARTED
[22:07:25.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:7:0) after 5m39s
[22:13:04.181] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:7:0)
[22:13:04.201] Build status: STARTED
[22:13:04.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:8:0) after 6m19s
[22:19:23.223] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:8:0)
[22:19:23.245] Build status: STARTED
[22:19:23.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:9:0) after 3m56s
[22:23:19.327] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:9:0)
[22:23:19.346] Build status: STARTED
[22:23:19.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:10:0) after 2m2s
[22:25:21.398] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:10:0)
[22:25:21.418] Build status: STARTED
[22:25:21.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:11:0) after 2m13s
[22:27:34.531] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:11:0)
[22:27:34.554] Build status: STARTED
[22:27:34.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:12:0) after 1m2s
[22:28:36.768] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:12:0)
[22:28:36.806] Build status: STARTED
[22:28:36.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:13:0) after 7m26s
[22:36:02.918] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:13:0)
[22:36:02.954] Build status: STARTED
[22:36:02.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:14:0) after 9m39s
[22:45:42.051] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:14:0)
[22:45:42.075] Build status: STARTED
[22:45:42.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:15:0) after 6m50s
[22:52:32.293] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:15:0)
[22:52:32.354] Build status: STARTED
[22:52:32.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:16:0) after 8m45s
[23:01:17.557] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:16:0)
[23:01:17.575] Build status: STARTED
[23:01:17.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:17:0) after 8m20s
[23:09:37.925] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:17:0)
[23:09:37.954] Build status: STARTED
[23:09:37.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:18:0) after 1m14s
[23:10:51.977] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:18:0)
[23:10:52.003] Build status: STARTED
[23:10:52.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:19:0) after 3m27s
[23:14:19.040] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:19:0)
[23:14:19.059] Build status: STARTED
[23:14:19.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:20:0) after 8m1s
[23:22:20.202] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:20:0)
[23:22:20.280] Build status: STARTED
[23:22:20.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:21:0) after 5m33s
[23:27:53.279] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:21:0)
[23:27:53.309] Build status: STARTED
[23:27:53.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:22:0) after 8m52s
[23:36:45.294] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:22:0)
[23:36:45.312] Build status: STARTED
[23:36:45.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:23:0) after 9m56s
[23:46:41.331] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:23:0)
[23:46:41.352] Build status: STARTED
[23:46:41.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:24:0) after 3m35s
[23:50:16.376] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:24:0)
[23:50:16.395] Build status: STARTED
[23:50:16.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:25:0) after 8m2s
[23:58:18.525] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:25:0)
[23:58:18.544] Build status: STARTED
[23:58:18.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:26:0) after 8m40s
[00:06:58.591] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:26:0)
[00:06:58.607] Build status: STARTED
[00:06:58.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:27:0) after 8m34s
[00:15:32.631] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:27:0)
[00:15:32.676] Build status: STARTED
[00:15:32.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:28:0) after 1m2s
[00:16:34.879] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:28:0)
[00:16:34.905] Build status: STARTED
[00:16:34.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:29:0) after 1m6s
[00:17:40.944] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:29:0)
[00:17:40.959] Build status: STARTED
[00:17:40.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:30:0) after 1m10s
[00:18:50.984] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:30:0)
[00:18:51.124] Build status: STARTED
[00:18:51.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:31:0) after 5m40s
[00:24:31.193] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:31:0)
[00:24:31.212] Build status: STARTED
[00:24:31.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:32:0) after 4m28s
[00:28:59.574] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:32:0)
[00:28:59.596] Build status: STARTED
[00:28:59.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:33:0) after 3m47s
[00:32:46.649] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:33:0)
[00:32:46.683] Build status: STARTED
[00:32:46.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:34:0) after 6m51s
[00:39:37.689] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:34:0)
[00:39:37.708] Build status: STARTED
[00:39:37.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:35:0) after 3m36s
[00:43:13.963] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:35:0)
[00:43:14.064] Build status: STARTED
[00:43:14.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:36:0) after 5m58s
[00:49:12.090] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:36:0)
[00:49:12.145] Build status: STARTED
[00:49:12.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:37:0) after 8m21s
[00:57:33.629] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:37:0)
[00:57:33.648] Build status: STARTED
[00:57:33.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:38:0) after 3m18s
[01:00:51.681] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:38:0)
[01:00:51.697] Build status: STARTED
[01:00:51.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:39:0) after 6m45s
[01:07:36.715] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:39:0)
[01:07:36.737] Build status: STARTED
[01:07:36.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:40:0) after 5m25s
[01:13:01.760] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:40:0)
[01:13:01.778] Build status: STARTED
[01:13:01.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:41:0) after 8m21s
[01:21:22.838] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:41:0)
[01:21:22.858] Build status: STARTED
[01:21:22.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:42:0) after 5m30s
[01:26:52.877] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:42:0)
[01:26:52.894] Build status: STARTED
[01:26:52.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:43:0) after 5m18s
[01:32:11.037] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:43:0)
[01:32:11.085] Build status: STARTED
[01:32:11.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:44:0) after 3m50s
[01:36:01.116] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:44:0)
[01:36:01.136] Build status: STARTED
[01:36:01.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:45:0) after 5m11s
[01:41:12.568] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:45:0)
[01:41:12.603] Build status: STARTED
[01:41:12.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:46:0) after 5m8s
[01:46:20.691] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:46:0)
[01:46:20.712] Build status: STARTED
[01:46:20.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:47:0) after 4m27s
[01:50:47.733] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:47:0)
[01:50:47.773] Build status: STARTED
[01:50:47.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:48:0) after 5m52s
[01:56:39.787] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:48:0)
[01:56:39.805] Build status: STARTED
[01:56:39.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:49:0) after 6m49s
[02:03:28.984] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:49:0)
[02:03:29.100] Build status: STARTED
[02:03:29.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:50:0) after 9m40s
[02:13:09.120] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:50:0)
[02:13:09.144] Build status: STARTED
[02:13:09.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:51:0) after 2m21s
[02:15:30.155] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:51:0)
[02:15:30.168] Build status: STARTED
[02:15:30.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:52:0) after 9m47s
[02:25:17.224] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:52:0)
[02:25:17.240] Build status: STARTED
[02:25:17.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:53:0) after 8m23s
[02:33:40.392] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:53:0)
[02:33:40.410] Build status: STARTED
[02:33:40.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:54:0) after 3m48s
[02:37:28.598] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:54:0)
[02:37:28.652] Build status: STARTED
[02:37:28.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:55:0) after 4m23s
[02:41:51.774] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:55:0)
[02:41:51.795] Build status: STARTED
[02:41:51.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:56:0) after 7m41s
[02:49:32.909] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:56:0)
[02:49:33.044] Build status: STARTED
[02:49:33.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:57:0) after 7m45s
[02:57:18.089] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:57:0)
[02:57:18.107] Build status: STARTED
[02:57:18.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:58:0) after 4m26s
[03:01:44.253] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:58:0)
[03:01:44.274] Build status: STARTED
[03:01:44.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:59:0) after 9m45s
[03:11:29.362] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:59:0)
[03:11:29.474] Build status: STARTED
[03:11:29.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:60:0) after 3m55s
[03:15:24.494] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:60:0)
[03:15:24.583] Build status: STARTED
[03:15:24.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:61:0) after 7m13s
[03:22:37.620] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:61:0)
[03:22:37.638] Build status: STARTED
[03:22:37.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:62:0) after 5m28s
[03:28:05.663] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:62:0)
[03:28:05.677] Build status: STARTED
[03:28:05.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:63:0) after 8m40s
[03:36:45.796] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:63:0)
[03:36:45.811] Build status: STARTED
[03:36:45.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8876846688731752752:64:0) after 4m47s
[03:37:49.801] Received PubSub notification, asking Buildbucket for the build status
[03:37:49.826] Build:
{
"id": "8711416626755473665",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 36908,
"createdBy": "project:chromium",
"createTime": "2025-06-21T21:52:05.756540190Z",
"startTime": "2025-06-21T21:52:09.065208229Z",
"endTime": "2025-06-22T03:37:49.354303248Z",
"updateTime": "2025-06-22T03:37:49.354303248Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9b48fd0c7048c43e3e1523222b17f1537edb52a3",
"ref": "refs/heads/main"
}
},
"canary": true
}
[03:37:49.826] Invocation finished in 5h45m45.33842202s with status FAILED