[15:30:10.527] New invocation is queued and will start shortly
[15:30:11.734] Starting the invocation (attempt 1)
[15:30:11.767] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/1905c045a2544a3692194555583e5eb1b98d3c57"
[15:30:11.767] Popped gitiles commit info from properties and tags
[15:30:11.767] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:30:11.767] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:30:11.767] Buildbucket request:
{
"requestId": "8881491161064385392",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1905c045a2544a3692194555583e5eb1b98d3c57",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8881491161064385392"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:30:12.555] Scheduled build:
{
"id": "8716061099020424241",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 35984,
"createdBy": "project:chromium",
"createTime": "2025-05-01T15:30:11.844285851Z",
"updateTime": "2025-05-01T15:30:11.844285851Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1905c045a2544a3692194555583e5eb1b98d3c57",
"ref": "refs/heads/main"
}
}
}
[15:30:12.555] Task URL: https://cr-buildbucket.appspot.com/build/8716061099020424241
[15:30:12.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:2:0) after 5m47s
[15:30:13.509] Received PubSub notification, asking Buildbucket for the build status
[15:30:13.540] Build status: SCHEDULED
[15:30:16.268] Received PubSub notification, asking Buildbucket for the build status
[15:30:16.343] Build status: STARTED
[15:35:59.583] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:2:0)
[15:35:59.682] Build status: STARTED
[15:35:59.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:5:0) after 5m9s
[15:41:08.751] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:5:0)
[15:41:08.805] Build status: STARTED
[15:41:08.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:6:0) after 8m38s
[15:49:46.857] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:6:0)
[15:49:46.884] Build status: STARTED
[15:49:46.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:7:0) after 9m10s
[15:58:56.909] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:7:0)
[15:58:56.934] Build status: STARTED
[15:58:56.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:8:0) after 1m14s
[16:00:11.010] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:8:0)
[16:00:11.029] Build status: STARTED
[16:00:11.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:9:0) after 7m2s
[16:07:13.045] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:9:0)
[16:07:13.178] Build status: STARTED
[16:07:13.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:10:0) after 2m48s
[16:10:01.199] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:10:0)
[16:10:01.219] Build status: STARTED
[16:10:01.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:11:0) after 6m35s
[16:16:36.295] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:11:0)
[16:16:36.335] Build status: STARTED
[16:16:36.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:12:0) after 3m34s
[16:20:10.354] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:12:0)
[16:20:10.372] Build status: STARTED
[16:20:10.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:13:0) after 3m55s
[16:24:05.488] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:13:0)
[16:24:05.508] Build status: STARTED
[16:24:05.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:14:0) after 3m58s
[16:28:03.500] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:14:0)
[16:28:03.514] Build status: STARTED
[16:28:03.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:15:0) after 9m3s
[16:37:06.539] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:15:0)
[16:37:06.556] Build status: STARTED
[16:37:06.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:16:0) after 3m5s
[16:40:11.633] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:16:0)
[16:40:11.652] Build status: STARTED
[16:40:11.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:17:0) after 2m2s
[16:42:13.689] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:17:0)
[16:42:13.724] Build status: STARTED
[16:42:13.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:18:0) after 3m10s
[16:45:23.762] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:18:0)
[16:45:23.778] Build status: STARTED
[16:45:23.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:19:0) after 4m48s
[16:50:11.797] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:19:0)
[16:50:11.826] Build status: STARTED
[16:50:11.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:20:0) after 4m15s
[16:54:26.855] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:20:0)
[16:54:26.875] Build status: STARTED
[16:54:26.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:21:0) after 7m25s
[17:01:51.905] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:21:0)
[17:01:51.918] Build status: STARTED
[17:01:51.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:22:0) after 4m46s
[17:06:37.974] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:22:0)
[17:06:37.989] Build status: STARTED
[17:06:37.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:23:0) after 3m8s
[17:09:46.010] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:23:0)
[17:09:46.086] Build status: STARTED
[17:09:46.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:24:0) after 6m53s
[17:16:39.172] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:24:0)
[17:16:39.193] Build status: STARTED
[17:16:39.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:25:0) after 6m48s
[17:23:27.255] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:25:0)
[17:23:27.275] Build status: STARTED
[17:23:27.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:26:0) after 7m54s
[17:31:21.425] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:26:0)
[17:31:21.496] Build status: STARTED
[17:31:21.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:27:0) after 9m56s
[17:41:17.535] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:27:0)
[17:41:17.557] Build status: STARTED
[17:41:17.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:28:0) after 7m19s
[17:48:36.583] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:28:0)
[17:48:36.598] Build status: STARTED
[17:48:36.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:29:0) after 8m59s
[17:57:35.737] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:29:0)
[17:57:35.753] Build status: STARTED
[17:57:35.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:30:0) after 2m5s
[17:59:40.776] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:30:0)
[17:59:40.794] Build status: STARTED
[17:59:40.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:31:0) after 4m9s
[18:03:49.829] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:31:0)
[18:03:49.866] Build status: STARTED
[18:03:49.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:32:0) after 2m4s
[18:05:53.895] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:32:0)
[18:05:53.911] Build status: STARTED
[18:05:53.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:33:0) after 1m53s
[18:07:46.960] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:33:0)
[18:07:46.977] Build status: STARTED
[18:07:46.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:34:0) after 5m5s
[18:12:52.010] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:34:0)
[18:12:52.029] Build status: STARTED
[18:12:52.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:35:0) after 7m21s
[18:20:13.081] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:35:0)
[18:20:13.098] Build status: STARTED
[18:20:13.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:36:0) after 1m2s
[18:21:15.130] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:36:0)
[18:21:15.149] Build status: STARTED
[18:21:15.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:37:0) after 3m44s
[18:24:59.177] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:37:0)
[18:24:59.269] Build status: STARTED
[18:24:59.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:38:0) after 4m0s
[18:28:59.321] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:38:0)
[18:28:59.338] Build status: STARTED
[18:28:59.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:39:0) after 8m27s
[18:37:26.374] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:39:0)
[18:37:26.411] Build status: STARTED
[18:37:26.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:40:0) after 1m42s
[18:39:08.443] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:40:0)
[18:39:08.478] Build status: STARTED
[18:39:08.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:41:0) after 6m58s
[18:46:06.503] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:41:0)
[18:46:06.519] Build status: STARTED
[18:46:06.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:42:0) after 1m0s
[18:47:06.546] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:42:0)
[18:47:06.562] Build status: STARTED
[18:47:06.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:43:0) after 3m50s
[18:50:56.589] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:43:0)
[18:50:56.608] Build status: STARTED
[18:50:56.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:44:0) after 5m29s
[18:56:25.631] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:44:0)
[18:56:25.645] Build status: STARTED
[18:56:25.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:45:0) after 5m23s
[19:01:48.722] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:45:0)
[19:01:48.737] Build status: STARTED
[19:01:48.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:46:0) after 4m20s
[19:06:08.762] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:46:0)
[19:06:08.782] Build status: STARTED
[19:06:08.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:47:0) after 2m47s
[19:08:55.807] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:47:0)
[19:08:55.822] Build status: STARTED
[19:08:55.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:48:0) after 2m30s
[19:11:25.817] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:48:0)
[19:11:25.832] Build status: STARTED
[19:11:25.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:49:0) after 7m30s
[19:18:55.880] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:49:0)
[19:18:55.902] Build status: STARTED
[19:18:55.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:50:0) after 2m43s
[19:21:38.897] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:50:0)
[19:21:38.924] Build status: STARTED
[19:21:38.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:51:0) after 1m37s
[19:23:15.946] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:51:0)
[19:23:15.962] Build status: STARTED
[19:23:15.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:52:0) after 2m31s
[19:25:47.127] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:52:0)
[19:25:47.190] Build status: STARTED
[19:25:47.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:53:0) after 2m3s
[19:27:50.344] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:53:0)
[19:27:50.367] Build status: STARTED
[19:27:50.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:54:0) after 6m40s
[19:34:30.440] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:54:0)
[19:34:30.455] Build status: STARTED
[19:34:30.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:55:0) after 9m42s
[19:44:12.556] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:55:0)
[19:44:12.571] Build status: STARTED
[19:44:12.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:56:0) after 7m12s
[19:51:24.598] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:56:0)
[19:51:24.616] Build status: STARTED
[19:51:24.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:57:0) after 8m53s
[20:00:17.694] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:57:0)
[20:00:17.718] Build status: STARTED
[20:00:17.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:58:0) after 4m37s
[20:04:54.800] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:58:0)
[20:04:54.820] Build status: STARTED
[20:04:54.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:59:0) after 7m37s
[20:12:31.891] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:59:0)
[20:12:31.906] Build status: STARTED
[20:12:31.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:60:0) after 1m4s
[20:13:35.890] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:60:0)
[20:13:35.925] Build status: STARTED
[20:13:35.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:61:0) after 7m21s
[20:20:57.030] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:61:0)
[20:20:57.049] Build status: STARTED
[20:20:57.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:62:0) after 6m51s
[20:27:48.070] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:62:0)
[20:27:48.090] Build status: STARTED
[20:27:48.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:63:0) after 6m22s
[20:34:10.111] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:63:0)
[20:34:10.151] Build status: STARTED
[20:34:10.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:64:0) after 4m27s
[20:38:37.167] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:64:0)
[20:38:37.202] Build status: STARTED
[20:38:37.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:65:0) after 5m40s
[20:44:17.220] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:65:0)
[20:44:17.234] Build status: STARTED
[20:44:17.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:66:0) after 7m57s
[20:52:14.256] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:66:0)
[20:52:14.274] Build status: STARTED
[20:52:14.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:67:0) after 7m22s
[20:59:36.300] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:67:0)
[20:59:36.318] Build status: STARTED
[20:59:36.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:68:0) after 4m17s
[21:03:53.357] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:68:0)
[21:03:53.378] Build status: STARTED
[21:03:53.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:69:0) after 2m23s
[21:06:16.447] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:69:0)
[21:06:16.510] Build status: STARTED
[21:06:16.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:70:0) after 6m51s
[21:13:07.576] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:70:0)
[21:13:07.595] Build status: STARTED
[21:13:07.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:71:0) after 3m29s
[21:16:36.670] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:71:0)
[21:16:36.689] Build status: STARTED
[21:16:36.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8881491161064385392:72:0) after 6m50s
[21:20:37.684] Received PubSub notification, asking Buildbucket for the build status
[21:20:37.712] Build:
{
"id": "8716061099020424241",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 35984,
"createdBy": "project:chromium",
"createTime": "2025-05-01T15:30:11.844285851Z",
"startTime": "2025-05-01T15:30:16.025044605Z",
"endTime": "2025-05-01T21:20:37.364545720Z",
"updateTime": "2025-05-01T21:20:37.364545720Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1905c045a2544a3692194555583e5eb1b98d3c57",
"ref": "refs/heads/main"
}
}
}
[21:20:37.712] Invocation finished in 5h50m27.201117665s with status FAILED