[07:43:54.075] New invocation is queued and will start shortly
[07:43:55.159] Starting the invocation (attempt 1)
[07:43:55.178] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/411220a0596f35b10ea757bac82df5cb099fded3"
[07:43:55.178] Popped gitiles commit info from properties and tags
[07:43:55.178] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[07:43:55.179] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[07:43:55.179] Buildbucket request:
{
"requestId": "8858418270062027040",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "411220a0596f35b10ea757bac82df5cb099fded3",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8858418270062027040"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[07:43:55.596] Scheduled build:
{
"id": "8692988208190725857",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"number": 1128,
"createdBy": "project:chromium",
"createTime": "2026-01-11T07:43:55.234950276Z",
"updateTime": "2026-01-11T07:43:55.234950276Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "411220a0596f35b10ea757bac82df5cb099fded3",
"ref": "refs/heads/main"
}
}
}
[07:43:55.596] Task URL: https://cr-buildbucket.appspot.com/build/8692988208190725857
[07:43:55.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:2:0) after 6m17s
[07:44:10.025] Received PubSub notification, asking Buildbucket for the build status
[07:44:10.049] Build status: SCHEDULED
[07:45:45.240] Received PubSub notification, asking Buildbucket for the build status
[07:45:45.257] Build status: STARTED
[07:50:12.603] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:2:0)
[07:50:12.620] Build status: STARTED
[07:50:12.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:5:0) after 8m40s
[07:58:52.773] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:5:0)
[07:58:52.796] Build status: STARTED
[07:58:52.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:6:0) after 3m6s
[08:01:58.818] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:6:0)
[08:01:58.833] Build status: STARTED
[08:01:58.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:7:0) after 8m31s
[08:10:29.848] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:7:0)
[08:10:29.883] Build status: STARTED
[08:10:29.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:8:0) after 3m45s
[08:14:14.903] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:8:0)
[08:14:14.932] Build status: STARTED
[08:14:14.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:9:0) after 1m51s
[08:16:05.944] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:9:0)
[08:16:05.963] Build status: STARTED
[08:16:05.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:10:0) after 8m26s
[08:24:31.979] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:10:0)
[08:24:32.013] Build status: STARTED
[08:24:32.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:11:0) after 3m31s
[08:28:02.977] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:11:0)
[08:28:03.005] Build status: STARTED
[08:28:03.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:12:0) after 8m27s
[08:36:30.138] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:12:0)
[08:36:30.164] Build status: STARTED
[08:36:30.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:13:0) after 7m6s
[08:43:36.240] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:13:0)
[08:43:36.265] Build status: STARTED
[08:43:36.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:14:0) after 6m19s
[08:49:55.630] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:14:0)
[08:49:55.646] Build status: STARTED
[08:49:55.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:15:0) after 3m12s
[08:53:07.758] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:15:0)
[08:53:07.778] Build status: STARTED
[08:53:07.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:16:0) after 1m46s
[08:54:53.795] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:16:0)
[08:54:53.811] Build status: STARTED
[08:54:53.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:17:0) after 3m33s
[08:58:26.825] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:17:0)
[08:58:26.842] Build status: STARTED
[08:58:26.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:18:0) after 2m58s
[09:01:25.022] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:18:0)
[09:01:25.037] Build status: STARTED
[09:01:25.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:19:0) after 8m47s
[09:10:12.020] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:19:0)
[09:10:12.033] Build status: STARTED
[09:10:12.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:20:0) after 5m49s
[09:16:01.218] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:20:0)
[09:16:01.233] Build status: STARTED
[09:16:01.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:21:0) after 9m58s
[09:25:59.496] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:21:0)
[09:25:59.512] Build status: STARTED
[09:25:59.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:22:0) after 5m46s
[09:31:45.560] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:22:0)
[09:31:45.573] Build status: STARTED
[09:31:45.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:23:0) after 3m16s
[09:35:01.601] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:23:0)
[09:35:01.615] Build status: STARTED
[09:35:01.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:24:0) after 1m51s
[09:36:52.626] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:24:0)
[09:36:52.652] Build status: STARTED
[09:36:52.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:25:0) after 9m49s
[09:46:42.048] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:25:0)
[09:46:42.064] Build status: STARTED
[09:46:42.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:26:0) after 2m6s
[09:48:48.209] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:26:0)
[09:48:48.240] Build status: STARTED
[09:48:48.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:27:0) after 9m9s
[09:57:57.354] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:27:0)
[09:57:57.374] Build status: STARTED
[09:57:57.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:28:0) after 7m33s
[10:05:30.879] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:28:0)
[10:05:30.896] Build status: STARTED
[10:05:30.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:29:0) after 8m37s
[10:14:07.917] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:29:0)
[10:14:07.935] Build status: STARTED
[10:14:07.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:30:0) after 1m19s
[10:15:26.950] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:30:0)
[10:15:27.234] Build status: STARTED
[10:15:27.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:31:0) after 9m16s
[10:24:43.366] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:31:0)
[10:24:43.381] Build status: STARTED
[10:24:43.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:32:0) after 6m10s
[10:30:53.409] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:32:0)
[10:30:53.429] Build status: STARTED
[10:30:53.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:33:0) after 5m43s
[10:36:36.477] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:33:0)
[10:36:36.508] Build status: STARTED
[10:36:36.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:34:0) after 7m29s
[10:44:05.707] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:34:0)
[10:44:05.733] Build status: STARTED
[10:44:05.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:35:0) after 3m18s
[10:47:23.859] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:35:0)
[10:47:23.879] Build status: STARTED
[10:47:23.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:36:0) after 8m19s
[10:55:42.886] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:36:0)
[10:55:42.900] Build status: STARTED
[10:55:42.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:37:0) after 8m29s
[11:04:11.918] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:37:0)
[11:04:11.931] Build status: STARTED
[11:04:11.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:38:0) after 5m53s
[11:10:05.195] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:38:0)
[11:10:05.207] Build status: STARTED
[11:10:05.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:39:0) after 3m48s
[11:13:53.281] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:39:0)
[11:13:53.298] Build status: STARTED
[11:13:53.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:40:0) after 3m32s
[11:17:25.596] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:40:0)
[11:17:25.615] Build status: STARTED
[11:17:25.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:41:0) after 2m51s
[11:20:16.734] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:41:0)
[11:20:16.764] Build status: STARTED
[11:20:16.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:42:0) after 7m28s
[11:27:44.778] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:42:0)
[11:27:44.803] Build status: STARTED
[11:27:44.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:43:0) after 8m27s
[11:36:11.983] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:43:0)
[11:36:12.053] Build status: STARTED
[11:36:12.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:44:0) after 3m30s
[11:39:42.155] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:44:0)
[11:39:42.172] Build status: STARTED
[11:39:42.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:45:0) after 7m5s
[11:46:47.187] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:45:0)
[11:46:47.213] Build status: STARTED
[11:46:47.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:46:0) after 2m58s
[11:49:45.228] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:46:0)
[11:49:45.243] Build status: STARTED
[11:49:45.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:47:0) after 3m10s
[11:52:55.272] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:47:0)
[11:52:55.289] Build status: STARTED
[11:52:55.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:48:0) after 5m7s
[11:58:02.531] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:48:0)
[11:58:02.547] Build status: STARTED
[11:58:02.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:49:0) after 4m36s
[12:02:38.594] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:49:0)
[12:02:38.608] Build status: STARTED
[12:02:38.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:50:0) after 8m2s
[12:10:40.730] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:50:0)
[12:10:40.746] Build status: STARTED
[12:10:40.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:51:0) after 4m10s
[12:14:50.777] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:51:0)
[12:14:50.795] Build status: STARTED
[12:14:50.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:52:0) after 1m29s
[12:16:19.891] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:52:0)
[12:16:19.918] Build status: STARTED
[12:16:19.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:53:0) after 3m21s
[12:19:41.102] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:53:0)
[12:19:41.156] Build status: STARTED
[12:19:41.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:54:0) after 5m25s
[12:25:06.174] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:54:0)
[12:25:06.191] Build status: STARTED
[12:25:06.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:55:0) after 3m12s
[12:28:18.219] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:55:0)
[12:28:18.238] Build status: STARTED
[12:28:18.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:56:0) after 3m33s
[12:31:51.255] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:56:0)
[12:31:51.271] Build status: STARTED
[12:31:51.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:57:0) after 6m37s
[12:38:28.297] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:57:0)
[12:38:28.312] Build status: STARTED
[12:38:28.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:58:0) after 7m19s
[12:45:47.360] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:58:0)
[12:45:47.384] Build status: STARTED
[12:45:47.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:59:0) after 4m30s
[12:50:17.400] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:59:0)
[12:50:17.415] Build status: STARTED
[12:50:17.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:60:0) after 2m25s
[12:52:42.531] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:60:0)
[12:52:42.550] Build status: STARTED
[12:52:42.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:61:0) after 9m35s
[13:02:17.681] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:61:0)
[13:02:17.779] Build status: STARTED
[13:02:17.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858418270062027040:62:0) after 8m25s
[13:06:57.708] Received PubSub notification, asking Buildbucket for the build status
[13:06:57.722] Build:
{
"id": "8692988208190725857",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"number": 1128,
"createdBy": "project:chromium",
"createTime": "2026-01-11T07:43:55.234950276Z",
"startTime": "2026-01-11T07:44:58.124824832Z",
"endTime": "2026-01-11T13:06:50.362512012Z",
"updateTime": "2026-01-11T13:06:50.362512012Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "411220a0596f35b10ea757bac82df5cb099fded3",
"ref": "refs/heads/main"
}
}
}
[13:06:57.722] Invocation finished in 5h23m3.657475114s with status FAILED