[10:00:42.627] New invocation is queued and will start shortly
[10:00:44.013] Starting the invocation (attempt 1)
[10:00:44.039] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/6fb1f4315499853f4f7b6cba18ffefbed05c1b0e"
[10:00:44.039] Popped gitiles commit info from properties and tags
[10:00:44.039] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:00:44.039] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:00:44.039] Buildbucket request:
{
"requestId": "8850890114554117600",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6fb1f4315499853f4f7b6cba18ffefbed05c1b0e",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8850890114554117600"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:00:44.997] Scheduled build:
{
"id": "8685460052290689137",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 40126,
"createdBy": "project:chromium",
"createTime": "2026-04-04T10:00:44.165738121Z",
"updateTime": "2026-04-04T10:00:44.165738121Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6fb1f4315499853f4f7b6cba18ffefbed05c1b0e",
"ref": "refs/heads/main"
}
}
}
[10:00:44.997] Task URL: https://cr-buildbucket.appspot.com/build/8685460052290689137
[10:00:44.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:2:0) after 4m46s
[10:00:45.744] Received PubSub notification, asking Buildbucket for the build status
[10:00:45.787] Build status: SCHEDULED
[10:01:32.576] Received PubSub notification, asking Buildbucket for the build status
[10:01:32.623] Build status: STARTED
[10:05:31.566] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:2:0)
[10:05:31.596] Build status: STARTED
[10:05:31.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:5:0) after 7m26s
[10:12:57.685] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:5:0)
[10:12:57.706] Build status: STARTED
[10:12:57.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:6:0) after 7m42s
[10:20:39.821] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:6:0)
[10:20:39.874] Build status: STARTED
[10:20:39.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:7:0) after 6m1s
[10:26:40.889] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:7:0)
[10:26:40.906] Build status: STARTED
[10:26:40.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:8:0) after 8m48s
[10:35:28.928] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:8:0)
[10:35:28.943] Build status: STARTED
[10:35:28.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:9:0) after 2m56s
[10:38:25.123] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:9:0)
[10:38:25.142] Build status: STARTED
[10:38:25.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:10:0) after 6m56s
[10:45:21.161] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:10:0)
[10:45:21.180] Build status: STARTED
[10:45:21.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:11:0) after 6m9s
[10:51:30.198] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:11:0)
[10:51:30.252] Build status: STARTED
[10:51:30.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:12:0) after 2m20s
[10:53:50.267] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:12:0)
[10:53:50.290] Build status: STARTED
[10:53:50.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:13:0) after 2m43s
[10:56:33.419] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:13:0)
[10:56:33.435] Build status: STARTED
[10:56:33.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:14:0) after 1m34s
[10:58:07.446] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:14:0)
[10:58:07.464] Build status: STARTED
[10:58:07.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:15:0) after 9m48s
[11:07:55.575] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:15:0)
[11:07:55.592] Build status: STARTED
[11:07:55.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:16:0) after 9m23s
[11:17:18.609] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:16:0)
[11:17:18.629] Build status: STARTED
[11:17:18.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:17:0) after 7m10s
[11:24:28.756] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:17:0)
[11:24:28.810] Build status: STARTED
[11:24:28.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:18:0) after 3m57s
[11:28:25.828] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:18:0)
[11:28:25.850] Build status: STARTED
[11:28:25.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:19:0) after 5m22s
[11:33:47.830] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:19:0)
[11:33:47.851] Build status: STARTED
[11:33:47.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:20:0) after 9m37s
[11:43:24.906] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:20:0)
[11:43:24.923] Build status: STARTED
[11:43:24.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:21:0) after 4m10s
[11:47:34.939] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:21:0)
[11:47:34.961] Build status: STARTED
[11:47:34.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:22:0) after 8m21s
[11:55:55.939] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:22:0)
[11:55:55.957] Build status: STARTED
[11:55:55.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:23:0) after 6m33s
[12:02:28.975] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:23:0)
[12:02:28.994] Build status: STARTED
[12:02:28.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:24:0) after 5m50s
[12:08:19.380] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:24:0)
[12:08:19.396] Build status: STARTED
[12:08:19.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:25:0) after 8m55s
[12:17:14.854] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:25:0)
[12:17:14.872] Build status: STARTED
[12:17:14.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:26:0) after 4m20s
[12:21:34.947] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:26:0)
[12:21:34.973] Build status: STARTED
[12:21:34.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:27:0) after 6m10s
[12:27:46.286] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:27:0)
[12:27:46.320] Build status: STARTED
[12:27:46.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:28:0) after 3m2s
[12:30:48.784] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:28:0)
[12:30:48.802] Build status: STARTED
[12:30:48.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:29:0) after 3m49s
[12:34:37.821] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:29:0)
[12:34:37.870] Build status: STARTED
[12:34:37.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:30:0) after 8m43s
[12:43:20.889] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:30:0)
[12:43:20.917] Build status: STARTED
[12:43:20.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:31:0) after 2m57s
[12:46:17.944] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:31:0)
[12:46:17.965] Build status: STARTED
[12:46:17.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:32:0) after 4m13s
[12:50:31.079] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:32:0)
[12:50:31.102] Build status: STARTED
[12:50:31.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:33:0) after 5m37s
[12:56:08.122] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:33:0)
[12:56:08.142] Build status: STARTED
[12:56:08.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:34:0) after 7m19s
[13:03:27.275] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:34:0)
[13:03:27.299] Build status: STARTED
[13:03:27.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:35:0) after 2m7s
[13:05:34.467] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:35:0)
[13:05:34.491] Build status: STARTED
[13:05:34.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:36:0) after 3m1s
[13:08:36.095] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:36:0)
[13:08:36.110] Build status: STARTED
[13:08:36.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:37:0) after 5m30s
[13:14:06.411] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:37:0)
[13:14:06.428] Build status: STARTED
[13:14:06.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:38:0) after 7m10s
[13:21:16.603] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:38:0)
[13:21:16.619] Build status: STARTED
[13:21:16.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:39:0) after 6m7s
[13:27:23.633] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:39:0)
[13:27:23.653] Build status: STARTED
[13:27:23.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:40:0) after 8m53s
[13:36:16.676] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:40:0)
[13:36:16.693] Build status: STARTED
[13:36:16.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:41:0) after 8m22s
[13:44:38.707] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:41:0)
[13:44:38.725] Build status: STARTED
[13:44:38.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:42:0) after 6m52s
[13:51:30.788] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:42:0)
[13:51:30.807] Build status: STARTED
[13:51:30.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:43:0) after 4m33s
[13:56:03.917] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:43:0)
[13:56:03.936] Build status: STARTED
[13:56:03.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:44:0) after 1m21s
[13:57:25.032] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:44:0)
[13:57:25.053] Build status: STARTED
[13:57:25.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:45:0) after 3m23s
[14:00:48.058] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:45:0)
[14:00:48.078] Build status: STARTED
[14:00:48.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:46:0) after 6m56s
[14:07:44.316] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:46:0)
[14:07:44.333] Build status: STARTED
[14:07:44.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:47:0) after 9m32s
[14:17:16.313] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:47:0)
[14:17:16.380] Build status: STARTED
[14:17:16.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:48:0) after 7m8s
[14:24:24.398] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:48:0)
[14:24:24.416] Build status: STARTED
[14:24:24.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:49:0) after 1m46s
[14:26:10.434] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:49:0)
[14:26:10.461] Build status: STARTED
[14:26:10.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:50:0) after 3m5s
[14:29:15.479] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:50:0)
[14:29:15.499] Build status: STARTED
[14:29:15.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:51:0) after 3m44s
[14:32:59.515] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:51:0)
[14:32:59.550] Build status: STARTED
[14:32:59.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:52:0) after 9m20s
[14:42:19.572] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:52:0)
[14:42:19.592] Build status: STARTED
[14:42:19.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:53:0) after 7m6s
[14:49:25.709] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:53:0)
[14:49:25.736] Build status: STARTED
[14:49:25.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:54:0) after 3m13s
[14:52:38.748] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:54:0)
[14:52:38.763] Build status: STARTED
[14:52:38.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:55:0) after 1m28s
[14:54:06.822] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:55:0)
[14:54:06.904] Build status: STARTED
[14:54:06.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:56:0) after 7m9s
[15:01:16.025] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:56:0)
[15:01:16.044] Build status: STARTED
[15:01:16.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:57:0) after 9m57s
[15:11:13.161] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:57:0)
[15:11:13.241] Build status: STARTED
[15:11:13.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:58:0) after 9m9s
[15:20:22.355] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:58:0)
[15:20:22.375] Build status: STARTED
[15:20:22.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:59:0) after 8m16s
[15:28:38.721] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:59:0)
[15:28:38.742] Build status: STARTED
[15:28:38.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:60:0) after 7m6s
[15:35:44.857] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:60:0)
[15:35:44.876] Build status: STARTED
[15:35:44.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:61:0) after 5m31s
[15:41:16.287] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:61:0)
[15:41:16.310] Build status: STARTED
[15:41:16.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:62:0) after 1m4s
[15:42:20.327] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:62:0)
[15:42:20.344] Build status: STARTED
[15:42:20.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:63:0) after 6m36s
[15:48:56.436] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:63:0)
[15:48:56.490] Build status: STARTED
[15:48:56.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:64:0) after 3m18s
[15:52:14.508] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:64:0)
[15:52:14.524] Build status: STARTED
[15:52:14.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:65:0) after 4m40s
[15:56:54.515] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:65:0)
[15:56:54.641] Build status: STARTED
[15:56:54.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:66:0) after 3m0s
[15:59:54.756] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:66:0)
[15:59:54.772] Build status: STARTED
[15:59:54.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8850890114554117600:67:0) after 3m5s
[16:00:31.722] Received PubSub notification, asking Buildbucket for the build status
[16:00:31.761] Build:
{
"id": "8685460052290689137",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 40126,
"createdBy": "project:chromium",
"createTime": "2026-04-04T10:00:44.165738121Z",
"startTime": "2026-04-04T10:01:32.308258213Z",
"endTime": "2026-04-04T16:00:30.600789923Z",
"updateTime": "2026-04-04T16:00:30.600789923Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6fb1f4315499853f4f7b6cba18ffefbed05c1b0e",
"ref": "refs/heads/main"
}
}
}
[16:00:31.761] Invocation finished in 5h59m49.138746926s with status FAILED