[02:04:10.902] New invocation is queued and will start shortly
[02:04:12.000] Starting the invocation (attempt 1)
[02:04:12.026] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/5c6f4416a4a2567b97bd52765e64e331e82717a4"
[02:04:12.026] Popped gitiles commit info from properties and tags
[02:04:12.026] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:04:12.026] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:04:12.026] Buildbucket request:
{
"requestId": "8879911124407343664",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5c6f4416a4a2567b97bd52765e64e331e82717a4",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8879911124407343664"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:04:12.514] Scheduled build:
{
"id": "8714481062511324337",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 36302,
"createdBy": "project:chromium",
"createTime": "2025-05-19T02:04:12.082371180Z",
"updateTime": "2025-05-19T02:04:12.082371180Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5c6f4416a4a2567b97bd52765e64e331e82717a4",
"ref": "refs/heads/main"
}
}
}
[02:04:12.514] Task URL: https://cr-buildbucket.appspot.com/build/8714481062511324337
[02:04:12.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:2:0) after 9m50s
[02:04:12.595] Received PubSub notification, asking Buildbucket for the build status
[02:04:12.612] Build status: SCHEDULED
[02:04:15.410] Received PubSub notification, asking Buildbucket for the build status
[02:04:15.428] Build status: STARTED
[02:14:02.645] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:2:0)
[02:14:02.672] Build status: STARTED
[02:14:02.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:5:0) after 8m37s
[02:22:39.776] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:5:0)
[02:22:39.792] Build status: STARTED
[02:22:39.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:6:0) after 2m1s
[02:24:41.019] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:6:0)
[02:24:41.060] Build status: STARTED
[02:24:41.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:7:0) after 3m4s
[02:27:45.421] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:7:0)
[02:27:45.451] Build status: STARTED
[02:27:45.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:8:0) after 7m54s
[02:35:39.477] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:8:0)
[02:35:39.499] Build status: STARTED
[02:35:39.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:9:0) after 2m15s
[02:37:54.573] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:9:0)
[02:37:54.600] Build status: STARTED
[02:37:54.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:10:0) after 9m39s
[02:47:33.641] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:10:0)
[02:47:33.668] Build status: STARTED
[02:47:33.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:11:0) after 1m11s
[02:48:44.846] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:11:0)
[02:48:44.882] Build status: STARTED
[02:48:44.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:12:0) after 7m41s
[02:56:25.862] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:12:0)
[02:56:25.905] Build status: STARTED
[02:56:25.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:13:0) after 5m47s
[03:02:12.921] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:13:0)
[03:02:12.948] Build status: STARTED
[03:02:12.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:14:0) after 9m48s
[03:12:01.231] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:14:0)
[03:12:01.255] Build status: STARTED
[03:12:01.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:15:0) after 7m9s
[03:19:10.327] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:15:0)
[03:19:10.344] Build status: STARTED
[03:19:10.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:16:0) after 8m17s
[03:27:27.472] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:16:0)
[03:27:27.504] Build status: STARTED
[03:27:27.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:17:0) after 4m16s
[03:31:43.494] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:17:0)
[03:31:43.582] Build status: STARTED
[03:31:43.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:18:0) after 7m46s
[03:39:29.721] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:18:0)
[03:39:29.737] Build status: STARTED
[03:39:29.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:19:0) after 4m50s
[03:44:19.877] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:19:0)
[03:44:19.906] Build status: STARTED
[03:44:19.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:20:0) after 9m52s
[03:54:12.093] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:20:0)
[03:54:12.146] Build status: STARTED
[03:54:12.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:21:0) after 9m6s
[04:03:18.201] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:21:0)
[04:03:18.220] Build status: STARTED
[04:03:18.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:22:0) after 9m16s
[04:12:34.340] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:22:0)
[04:12:34.367] Build status: STARTED
[04:12:34.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:23:0) after 7m27s
[04:20:01.554] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:23:0)
[04:20:01.589] Build status: STARTED
[04:20:01.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:24:0) after 3m7s
[04:23:08.810] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:24:0)
[04:23:08.824] Build status: STARTED
[04:23:08.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:25:0) after 9m11s
[04:32:19.839] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:25:0)
[04:32:19.853] Build status: STARTED
[04:32:19.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:26:0) after 8m50s
[04:41:09.971] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:26:0)
[04:41:10.014] Build status: STARTED
[04:41:10.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:27:0) after 7m34s
[04:48:44.626] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:27:0)
[04:48:44.644] Build status: STARTED
[04:48:44.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:28:0) after 4m49s
[04:53:33.683] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:28:0)
[04:53:33.708] Build status: STARTED
[04:53:33.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:29:0) after 3m26s
[04:56:59.727] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:29:0)
[04:56:59.816] Build status: STARTED
[04:56:59.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:30:0) after 7m55s
[05:04:54.831] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:30:0)
[05:04:54.846] Build status: STARTED
[05:04:54.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:31:0) after 9m47s
[05:14:41.831] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:31:0)
[05:14:41.849] Build status: STARTED
[05:14:41.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:32:0) after 9m11s
[05:23:52.869] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:32:0)
[05:23:52.885] Build status: STARTED
[05:23:52.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:33:0) after 7m31s
[05:31:24.275] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:33:0)
[05:31:24.372] Build status: STARTED
[05:31:24.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:34:0) after 8m13s
[05:39:37.387] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:34:0)
[05:39:37.404] Build status: STARTED
[05:39:37.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:35:0) after 3m9s
[05:42:46.421] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:35:0)
[05:42:46.450] Build status: STARTED
[05:42:46.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:36:0) after 1m28s
[05:44:15.133] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:36:0)
[05:44:15.148] Build status: STARTED
[05:44:15.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:37:0) after 4m17s
[05:48:32.164] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:37:0)
[05:48:32.260] Build status: STARTED
[05:48:32.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:38:0) after 3m7s
[05:51:39.527] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:38:0)
[05:51:39.551] Build status: STARTED
[05:51:39.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:39:0) after 5m14s
[05:56:53.626] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:39:0)
[05:56:53.672] Build status: STARTED
[05:56:53.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:40:0) after 2m34s
[05:59:28.090] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:40:0)
[05:59:28.111] Build status: STARTED
[05:59:28.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:41:0) after 2m8s
[06:01:36.122] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:41:0)
[06:01:36.138] Build status: STARTED
[06:01:36.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:42:0) after 7m54s
[06:09:30.587] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:42:0)
[06:09:30.608] Build status: STARTED
[06:09:30.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:43:0) after 2m33s
[06:12:03.722] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:43:0)
[06:12:03.739] Build status: STARTED
[06:12:03.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:44:0) after 3m43s
[06:15:46.821] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:44:0)
[06:15:46.847] Build status: STARTED
[06:15:46.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:45:0) after 6m2s
[06:21:48.921] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:45:0)
[06:21:48.940] Build status: STARTED
[06:21:48.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:46:0) after 5m50s
[06:27:38.966] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:46:0)
[06:27:38.992] Build status: STARTED
[06:27:38.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:47:0) after 5m38s
[06:33:17.000] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:47:0)
[06:33:17.015] Build status: STARTED
[06:33:17.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:48:0) after 3m29s
[06:36:46.094] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:48:0)
[06:36:46.116] Build status: STARTED
[06:36:46.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:49:0) after 6m9s
[06:42:55.195] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:49:0)
[06:42:55.689] Build status: STARTED
[06:42:55.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:50:0) after 3m59s
[06:46:54.776] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:50:0)
[06:46:54.836] Build status: STARTED
[06:46:54.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:51:0) after 2m55s
[06:49:49.948] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:51:0)
[06:49:50.024] Build status: STARTED
[06:49:50.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:52:0) after 2m55s
[06:52:45.046] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:52:0)
[06:52:45.063] Build status: STARTED
[06:52:45.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:53:0) after 7m26s
[07:00:11.244] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:53:0)
[07:00:11.269] Build status: STARTED
[07:00:11.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:54:0) after 1m49s
[07:02:00.376] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:54:0)
[07:02:00.397] Build status: STARTED
[07:02:00.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:55:0) after 5m51s
[07:07:51.417] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:55:0)
[07:07:51.435] Build status: STARTED
[07:07:51.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:56:0) after 1m50s
[07:09:41.458] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:56:0)
[07:09:41.484] Build status: STARTED
[07:09:41.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:57:0) after 9m10s
[07:18:51.504] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:57:0)
[07:18:51.519] Build status: STARTED
[07:18:51.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:58:0) after 4m30s
[07:23:21.651] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:58:0)
[07:23:21.670] Build status: STARTED
[07:23:21.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:59:0) after 8m3s
[07:31:24.791] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:59:0)
[07:31:24.807] Build status: STARTED
[07:31:24.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:60:0) after 1m24s
[07:32:48.855] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:60:0)
[07:32:48.869] Build status: STARTED
[07:32:48.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:61:0) after 5m2s
[07:37:51.027] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:61:0)
[07:37:51.045] Build status: STARTED
[07:37:51.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:62:0) after 3m30s
[07:41:21.061] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:62:0)
[07:41:21.087] Build status: STARTED
[07:41:21.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:63:0) after 4m43s
[07:46:04.126] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:63:0)
[07:46:04.146] Build status: STARTED
[07:46:04.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:64:0) after 1m44s
[07:47:48.163] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:64:0)
[07:47:48.189] Build status: STARTED
[07:47:48.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:65:0) after 2m46s
[07:50:34.216] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:65:0)
[07:50:34.328] Build status: STARTED
[07:50:34.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:66:0) after 2m58s
[07:53:32.582] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:66:0)
[07:53:32.599] Build status: STARTED
[07:53:32.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8879911124407343664:67:0) after 8m56s
[07:59:21.236] Received PubSub notification, asking Buildbucket for the build status
[07:59:21.292] Build:
{
"id": "8714481062511324337",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 36302,
"createdBy": "project:chromium",
"createTime": "2025-05-19T02:04:12.082371180Z",
"startTime": "2025-05-19T02:04:15.243553447Z",
"endTime": "2025-05-19T07:59:20.930603398Z",
"updateTime": "2025-05-19T07:59:20.930603398Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5c6f4416a4a2567b97bd52765e64e331e82717a4",
"ref": "refs/heads/main"
}
}
}
[07:59:21.292] Invocation finished in 5h55m10.402072772s with status FAILED