[13:38:37.556] New invocation is queued and will start shortly
[13:38:38.693] Starting the invocation (attempt 1)
[13:38:38.728] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/07e850c13b85c8419b3faf9d23c9b77004ddf1ad"
[13:38:38.728] Popped gitiles commit info from properties and tags
[13:38:38.728] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:38:38.728] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:38:38.728] Buildbucket request:
{
"requestId": "8884487879035161328",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "07e850c13b85c8419b3faf9d23c9b77004ddf1ad",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8884487879035161328"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:38:39.201] Scheduled build:
{
"id": "8719057817092863505",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 35310,
"createdBy": "project:chromium",
"createTime": "2025-03-29T13:38:38.785557796Z",
"updateTime": "2025-03-29T13:38:38.785557796Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "07e850c13b85c8419b3faf9d23c9b77004ddf1ad",
"ref": "refs/heads/main"
}
}
}
[13:38:39.201] Task URL: https://cr-buildbucket.appspot.com/build/8719057817092863505
[13:38:39.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:2:0) after 8m6s
[13:38:39.350] Received PubSub notification, asking Buildbucket for the build status
[13:38:39.373] Build status: SCHEDULED
[13:38:42.830] Received PubSub notification, asking Buildbucket for the build status
[13:38:42.853] Build status: STARTED
[13:46:45.877] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:2:0)
[13:46:45.900] Build status: STARTED
[13:46:45.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:5:0) after 7m40s
[13:54:25.908] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:5:0)
[13:54:25.947] Build status: STARTED
[13:54:25.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:6:0) after 1m5s
[13:55:30.964] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:6:0)
[13:55:30.985] Build status: STARTED
[13:55:30.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:7:0) after 5m40s
[14:01:11.044] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:7:0)
[14:01:11.107] Build status: STARTED
[14:01:11.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:8:0) after 4m35s
[14:05:46.150] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:8:0)
[14:05:46.180] Build status: STARTED
[14:05:46.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:9:0) after 6m12s
[14:11:58.588] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:9:0)
[14:11:58.616] Build status: STARTED
[14:11:58.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:10:0) after 3m43s
[14:15:41.744] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:10:0)
[14:15:41.768] Build status: STARTED
[14:15:41.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:11:0) after 8m25s
[14:24:06.917] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:11:0)
[14:24:06.939] Build status: STARTED
[14:24:06.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:12:0) after 3m12s
[14:27:18.999] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:12:0)
[14:27:19.025] Build status: STARTED
[14:27:19.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:13:0) after 6m53s
[14:34:12.060] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:13:0)
[14:34:12.096] Build status: STARTED
[14:34:12.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:14:0) after 8m54s
[14:43:06.133] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:14:0)
[14:43:06.159] Build status: STARTED
[14:43:06.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:15:0) after 5m53s
[14:48:59.260] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:15:0)
[14:48:59.459] Build status: STARTED
[14:48:59.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:16:0) after 1m48s
[14:50:47.957] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:16:0)
[14:50:47.978] Build status: STARTED
[14:50:47.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:17:0) after 2m25s
[14:53:12.980] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:17:0)
[14:53:13.004] Build status: STARTED
[14:53:13.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:18:0) after 4m30s
[14:57:43.353] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:18:0)
[14:57:43.394] Build status: STARTED
[14:57:43.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:19:0) after 5m47s
[15:03:30.576] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:19:0)
[15:03:30.653] Build status: STARTED
[15:03:30.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:20:0) after 9m14s
[15:12:44.812] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:20:0)
[15:12:44.831] Build status: STARTED
[15:12:44.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:21:0) after 6m12s
[15:18:56.849] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:21:0)
[15:18:56.868] Build status: STARTED
[15:18:56.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:22:0) after 5m19s
[15:24:16.077] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:22:0)
[15:24:16.109] Build status: STARTED
[15:24:16.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:23:0) after 4m54s
[15:29:10.137] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:23:0)
[15:29:10.159] Build status: STARTED
[15:29:10.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:24:0) after 5m55s
[15:35:05.317] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:24:0)
[15:35:05.347] Build status: STARTED
[15:35:05.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:25:0) after 7m23s
[15:42:28.480] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:25:0)
[15:42:28.504] Build status: STARTED
[15:42:28.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:26:0) after 4m29s
[15:46:57.529] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:26:0)
[15:46:57.547] Build status: STARTED
[15:46:57.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:27:0) after 6m25s
[15:53:22.836] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:27:0)
[15:53:22.861] Build status: STARTED
[15:53:22.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:28:0) after 3m37s
[15:56:59.886] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:28:0)
[15:56:59.904] Build status: STARTED
[15:56:59.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:29:0) after 9m1s
[16:06:01.368] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:29:0)
[16:06:01.386] Build status: STARTED
[16:06:01.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:30:0) after 4m42s
[16:10:43.461] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:30:0)
[16:10:43.485] Build status: STARTED
[16:10:43.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:31:0) after 3m19s
[16:14:02.605] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:31:0)
[16:14:02.625] Build status: STARTED
[16:14:02.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:32:0) after 2m8s
[16:16:10.864] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:32:0)
[16:16:10.882] Build status: STARTED
[16:16:10.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:33:0) after 2m47s
[16:18:57.905] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:33:0)
[16:18:57.930] Build status: STARTED
[16:18:57.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:34:0) after 3m40s
[16:22:38.030] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:34:0)
[16:22:38.047] Build status: STARTED
[16:22:38.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:35:0) after 3m30s
[16:26:08.169] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:35:0)
[16:26:08.192] Build status: STARTED
[16:26:08.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:36:0) after 9m33s
[16:35:41.219] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:36:0)
[16:35:41.264] Build status: STARTED
[16:35:41.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:37:0) after 3m30s
[16:39:11.289] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:37:0)
[16:39:11.452] Build status: STARTED
[16:39:11.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:38:0) after 4m56s
[16:44:07.611] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:38:0)
[16:44:07.640] Build status: STARTED
[16:44:07.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:39:0) after 8m31s
[16:52:38.778] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:39:0)
[16:52:38.797] Build status: STARTED
[16:52:38.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:40:0) after 4m0s
[16:56:38.903] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:40:0)
[16:56:38.916] Build status: STARTED
[16:56:38.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:41:0) after 1m26s
[16:58:04.973] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:41:0)
[16:58:04.988] Build status: STARTED
[16:58:04.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:42:0) after 6m21s
[17:04:26.007] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:42:0)
[17:04:26.051] Build status: STARTED
[17:04:26.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:43:0) after 7m18s
[17:11:44.106] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:43:0)
[17:11:44.128] Build status: STARTED
[17:11:44.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:44:0) after 5m17s
[17:17:01.249] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:44:0)
[17:17:01.272] Build status: STARTED
[17:17:01.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:45:0) after 1m50s
[17:18:51.349] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:45:0)
[17:18:51.383] Build status: STARTED
[17:18:51.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:46:0) after 9m31s
[17:28:22.628] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:46:0)
[17:28:22.653] Build status: STARTED
[17:28:22.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:47:0) after 8m43s
[17:37:05.679] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:47:0)
[17:37:05.693] Build status: STARTED
[17:37:05.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:48:0) after 4m10s
[17:41:15.934] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:48:0)
[17:41:15.965] Build status: STARTED
[17:41:15.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:49:0) after 2m57s
[17:44:13.007] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:49:0)
[17:44:13.030] Build status: STARTED
[17:44:13.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:50:0) after 8m8s
[17:52:21.153] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:50:0)
[17:52:21.175] Build status: STARTED
[17:52:21.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:51:0) after 1m53s
[17:54:14.195] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:51:0)
[17:54:14.219] Build status: STARTED
[17:54:14.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:52:0) after 1m23s
[17:55:37.432] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:52:0)
[17:55:37.448] Build status: STARTED
[17:55:37.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:53:0) after 6m27s
[18:02:04.470] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:53:0)
[18:02:04.491] Build status: STARTED
[18:02:04.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:54:0) after 7m39s
[18:09:43.766] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:54:0)
[18:09:43.779] Build status: STARTED
[18:09:43.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:55:0) after 8m54s
[18:18:37.800] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:55:0)
[18:18:37.895] Build status: STARTED
[18:18:37.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:56:0) after 5m32s
[18:24:09.914] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:56:0)
[18:24:09.932] Build status: STARTED
[18:24:09.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:57:0) after 1m37s
[18:25:47.284] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:57:0)
[18:25:47.297] Build status: STARTED
[18:25:47.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:58:0) after 7m34s
[18:33:21.318] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:58:0)
[18:33:21.356] Build status: STARTED
[18:33:21.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:59:0) after 8m41s
[18:42:02.465] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:59:0)
[18:42:02.483] Build status: STARTED
[18:42:02.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:60:0) after 1m39s
[18:43:41.609] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:60:0)
[18:43:41.651] Build status: STARTED
[18:43:41.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:61:0) after 2m59s
[18:46:40.880] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:61:0)
[18:46:40.911] Build status: STARTED
[18:46:40.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:62:0) after 4m32s
[18:51:13.161] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:62:0)
[18:51:13.179] Build status: STARTED
[18:51:13.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:63:0) after 9m59s
[19:01:12.321] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:63:0)
[19:01:12.341] Build status: STARTED
[19:01:12.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:64:0) after 6m42s
[19:07:54.365] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:64:0)
[19:07:54.380] Build status: STARTED
[19:07:54.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:65:0) after 4m35s
[19:12:29.505] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:65:0)
[19:12:29.524] Build status: STARTED
[19:12:29.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:66:0) after 8m55s
[19:21:24.556] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:66:0)
[19:21:24.575] Build status: STARTED
[19:21:24.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884487879035161328:67:0) after 5m40s
[19:22:38.862] Received PubSub notification, asking Buildbucket for the build status
[19:22:38.878] Build:
{
"id": "8719057817092863505",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 35310,
"createdBy": "project:chromium",
"createTime": "2025-03-29T13:38:38.785557796Z",
"startTime": "2025-03-29T13:38:42.550149566Z",
"endTime": "2025-03-29T19:22:38.474084488Z",
"updateTime": "2025-03-29T19:22:38.474084488Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "07e850c13b85c8419b3faf9d23c9b77004ddf1ad",
"ref": "refs/heads/main"
}
}
}
[19:22:38.878] Invocation finished in 5h44m1.328980033s with status FAILED