[02:28:32.268] New invocation is queued and will start shortly
[02:28:34.263] Starting the invocation (attempt 1)
[02:28:34.314] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/203c63f789880f48de47155a3c220ae7cb672f4d"
[02:28:34.314] Popped gitiles commit info from properties and tags
[02:28:34.314] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:28:34.314] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:28:34.314] Buildbucket request:
{
"requestId": "8841134090427494192",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "linux-arm64-rel-fyi"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "203c63f789880f48de47155a3c220ae7cb672f4d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8841134090427494192"
},
{
"key": "scheduler_job_id",
"value": "chromium/linux-arm64-rel-fyi"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:28:35.136] Scheduled build:
{
"id": "8675704027556571857",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "linux-arm64-rel-fyi"
},
"number": 994,
"createdBy": "project:chromium",
"createTime": "2026-07-21T02:28:34.385687169Z",
"updateTime": "2026-07-21T02:28:34.385687169Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "203c63f789880f48de47155a3c220ae7cb672f4d",
"ref": "refs/heads/main"
}
},
"canary": true
}
[02:28:35.136] Task URL: https://cr-buildbucket.appspot.com/build/8675704027556571857
[02:28:35.136] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:2:0) after 4m20s
[02:28:36.019] Received PubSub notification, asking Buildbucket for the build status
[02:28:36.046] Build status: SCHEDULED
[02:29:31.624] Received PubSub notification, asking Buildbucket for the build status
[02:29:31.649] Build status: STARTED
[02:32:55.167] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:2:0)
[02:32:55.190] Build status: STARTED
[02:32:55.190] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:5:0) after 8m24s
[02:41:19.264] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:5:0)
[02:41:19.293] Build status: STARTED
[02:41:19.293] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:6:0) after 1m26s
[02:42:45.379] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:6:0)
[02:42:45.402] Build status: STARTED
[02:42:45.406] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:7:0) after 2m11s
[02:44:56.432] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:7:0)
[02:44:56.483] Build status: STARTED
[02:44:56.483] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:8:0) after 7m30s
[02:52:26.500] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:8:0)
[02:52:26.545] Build status: STARTED
[02:52:26.545] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:9:0) after 4m30s
[02:56:56.654] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:9:0)
[02:56:56.675] Build status: STARTED
[02:56:56.675] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:10:0) after 6m2s
[03:02:58.724] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:10:0)
[03:02:58.744] Build status: STARTED
[03:02:58.744] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:11:0) after 7m42s
[03:10:40.810] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:11:0)
[03:10:40.835] Build status: STARTED
[03:10:40.835] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:12:0) after 1m27s
[03:12:07.915] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:12:0)
[03:12:07.957] Build status: STARTED
[03:12:07.958] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:13:0) after 6m54s
[03:19:02.114] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:13:0)
[03:19:02.137] Build status: STARTED
[03:19:02.137] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:14:0) after 8m10s
[03:27:12.205] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:14:0)
[03:27:12.289] Build status: STARTED
[03:27:12.289] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:15:0) after 3m57s
[03:31:09.331] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:15:0)
[03:31:09.351] Build status: STARTED
[03:31:09.351] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:16:0) after 5m34s
[03:36:43.431] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:16:0)
[03:36:43.487] Build status: STARTED
[03:36:43.487] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:17:0) after 1m22s
[03:38:05.511] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:17:0)
[03:38:05.589] Build status: STARTED
[03:38:05.589] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:18:0) after 7m36s
[03:45:41.645] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:18:0)
[03:45:41.658] Build status: STARTED
[03:45:41.658] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:19:0) after 4m57s
[03:50:38.698] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:19:0)
[03:50:38.717] Build status: STARTED
[03:50:38.717] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:20:0) after 8m10s
[03:58:48.835] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:20:0)
[03:58:48.857] Build status: STARTED
[03:58:48.857] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:21:0) after 7m53s
[04:06:41.992] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:21:0)
[04:06:42.011] Build status: STARTED
[04:06:42.011] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:22:0) after 7m0s
[04:13:42.001] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:22:0)
[04:13:42.017] Build status: STARTED
[04:13:42.017] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:23:0) after 3m13s
[04:16:54.986] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:23:0)
[04:16:55.008] Build status: STARTED
[04:16:55.008] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:24:0) after 9m52s
[04:26:47.024] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:24:0)
[04:26:47.041] Build status: STARTED
[04:26:47.042] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:25:0) after 6m56s
[04:33:43.272] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:25:0)
[04:33:43.304] Build status: STARTED
[04:33:43.304] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:26:0) after 9m17s
[04:43:00.376] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:26:0)
[04:43:00.396] Build status: STARTED
[04:43:00.396] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:27:0) after 1m19s
[04:44:19.443] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:27:0)
[04:44:19.464] Build status: STARTED
[04:44:19.465] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:28:0) after 6m34s
[04:50:53.485] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:28:0)
[04:50:53.510] Build status: STARTED
[04:50:53.510] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:29:0) after 8m46s
[04:59:39.531] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:29:0)
[04:59:39.553] Build status: STARTED
[04:59:39.554] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:30:0) after 2m4s
[05:01:43.600] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:30:0)
[05:01:43.617] Build status: STARTED
[05:01:43.617] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:31:0) after 8m44s
[05:10:27.737] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:31:0)
[05:10:27.758] Build status: STARTED
[05:10:27.758] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:32:0) after 1m45s
[05:12:12.782] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:32:0)
[05:12:12.804] Build status: STARTED
[05:12:12.804] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:33:0) after 2m59s
[05:15:11.872] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:33:0)
[05:15:11.905] Build status: STARTED
[05:15:11.905] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:34:0) after 8m15s
[05:23:26.926] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:34:0)
[05:23:26.945] Build status: STARTED
[05:23:26.945] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:35:0) after 9m19s
[05:32:45.964] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:35:0)
[05:32:45.982] Build status: STARTED
[05:32:45.982] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:36:0) after 1m19s
[05:34:05.013] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:36:0)
[05:34:05.134] Build status: STARTED
[05:34:05.134] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:37:0) after 4m51s
[05:38:56.199] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:37:0)
[05:38:56.310] Build status: STARTED
[05:38:56.310] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:38:0) after 5m42s
[05:44:38.328] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:38:0)
[05:44:38.347] Build status: STARTED
[05:44:38.348] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:39:0) after 7m52s
[05:52:30.326] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:39:0)
[05:52:30.360] Build status: STARTED
[05:52:30.360] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:40:0) after 2m59s
[05:55:29.477] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:40:0)
[05:55:29.494] Build status: STARTED
[05:55:29.494] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:41:0) after 7m7s
[06:02:36.562] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:41:0)
[06:02:36.609] Build status: STARTED
[06:02:36.609] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:42:0) after 2m53s
[06:05:29.680] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:42:0)
[06:05:29.802] Build status: STARTED
[06:05:29.802] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:43:0) after 1m57s
[06:07:26.861] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:43:0)
[06:07:26.878] Build status: STARTED
[06:07:26.878] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:44:0) after 9m30s
[06:16:56.901] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:44:0)
[06:16:56.924] Build status: STARTED
[06:16:56.924] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:45:0) after 9m25s
[06:26:21.956] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:45:0)
[06:26:21.973] Build status: STARTED
[06:26:21.973] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:46:0) after 1m21s
[06:27:42.951] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:46:0)
[06:27:42.973] Build status: STARTED
[06:27:42.973] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:47:0) after 7m56s
[06:35:39.034] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:47:0)
[06:35:39.061] Build status: STARTED
[06:35:39.061] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:48:0) after 7m18s
[06:42:57.088] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:48:0)
[06:42:57.110] Build status: STARTED
[06:42:57.111] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:49:0) after 2m19s
[06:45:16.130] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:49:0)
[06:45:16.218] Build status: STARTED
[06:45:16.219] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:50:0) after 5m37s
[06:50:53.251] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:50:0)
[06:50:53.274] Build status: STARTED
[06:50:53.274] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:51:0) after 4m8s
[06:55:01.306] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:51:0)
[06:55:01.325] Build status: STARTED
[06:55:01.325] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:52:0) after 7m43s
[07:02:44.370] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:52:0)
[07:02:44.390] Build status: STARTED
[07:02:44.390] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:53:0) after 3m12s
[07:05:56.482] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:53:0)
[07:05:56.510] Build status: STARTED
[07:05:56.510] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:54:0) after 7m0s
[07:12:56.512] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:54:0)
[07:12:56.531] Build status: STARTED
[07:12:56.531] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:55:0) after 8m33s
[07:21:29.535] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:55:0)
[07:21:29.557] Build status: STARTED
[07:21:29.557] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:56:0) after 2m29s
[07:23:58.685] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:56:0)
[07:23:58.747] Build status: STARTED
[07:23:58.748] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:57:0) after 8m39s
[07:32:37.727] Handling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:57:0)
[07:32:37.744] Build status: STARTED
[07:32:37.744] Scheduling timer "check-buildbucket-build-status" (chromium/linux-arm64-rel-fyi:8841134090427494192:58:0) after 6m8s
[07:37:10.839] Received PubSub notification, asking Buildbucket for the build status
[07:37:10.861] Build:
{
"id": "8675704027556571857",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "linux-arm64-rel-fyi"
},
"number": 994,
"createdBy": "project:chromium",
"createTime": "2026-07-21T02:28:34.385687169Z",
"startTime": "2026-07-21T02:29:31.418725830Z",
"endTime": "2026-07-21T07:37:10.358821575Z",
"updateTime": "2026-07-21T07:37:10.358821575Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "203c63f789880f48de47155a3c220ae7cb672f4d",
"ref": "refs/heads/main"
}
},
"canary": true
}
[07:37:10.861] Invocation finished in 5h8m38.598278412s with status FAILED