[19:38:00.771] New invocation is queued and will start shortly
[19:38:01.837] Starting the invocation (attempt 1)
[19:38:01.870] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/4de1cec1246698932cde06c8d628130b4541a93c"
[19:38:01.870] Popped gitiles commit info from properties and tags
[19:38:01.870] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:38:01.870] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:38:01.871] Buildbucket request:
{
"requestId": "8925233903243320976",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4de1cec1246698932cde06c8d628130b4541a93c",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8925233903243320976"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:38:02.500] Scheduled build:
{
"id": "8759803841379177201",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 30958,
"createdBy": "project:chromium",
"createTime": "2024-01-04T19:38:01.927093727Z",
"updateTime": "2024-01-04T19:38:01.927093727Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4de1cec1246698932cde06c8d628130b4541a93c",
"ref": "refs/heads/main"
}
}
}
[19:38:02.500] Task URL: https://cr-buildbucket.appspot.com/build/8759803841379177201
[19:38:02.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:2:0) after 5m21s
[19:38:03.442] Received PubSub notification, asking Buildbucket for the build status
[19:38:03.581] Build status: SCHEDULED
[19:38:03.960] Received PubSub notification, asking Buildbucket for the build status
[19:38:03.985] Build status: STARTED
[19:43:23.531] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:2:0)
[19:43:23.549] Build status: STARTED
[19:43:23.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:5:0) after 5m24s
[19:48:47.633] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:5:0)
[19:48:47.661] Build status: STARTED
[19:48:47.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:6:0) after 6m8s
[19:54:55.815] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:6:0)
[19:54:55.840] Build status: STARTED
[19:54:55.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:7:0) after 5m48s
[20:00:43.860] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:7:0)
[20:00:43.876] Build status: STARTED
[20:00:43.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:8:0) after 2m58s
[20:03:43.089] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:8:0)
[20:03:43.114] Build status: STARTED
[20:03:43.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:9:0) after 7m0s
[20:10:43.233] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:9:0)
[20:10:43.255] Build status: STARTED
[20:10:43.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:10:0) after 9m22s
[20:20:05.343] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:10:0)
[20:20:05.477] Build status: STARTED
[20:20:05.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:11:0) after 5m34s
[20:25:39.462] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:11:0)
[20:25:39.558] Build status: STARTED
[20:25:39.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:12:0) after 7m11s
[20:32:51.390] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:12:0)
[20:32:51.422] Build status: STARTED
[20:32:51.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:13:0) after 6m5s
[20:38:56.508] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:13:0)
[20:38:56.525] Build status: STARTED
[20:38:56.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:14:0) after 7m8s
[20:46:04.646] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:14:0)
[20:46:04.671] Build status: STARTED
[20:46:04.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:15:0) after 5m57s
[20:52:01.706] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:15:0)
[20:52:01.726] Build status: STARTED
[20:52:01.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:16:0) after 4m5s
[20:56:06.745] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:16:0)
[20:56:06.770] Build status: STARTED
[20:56:06.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:17:0) after 6m5s
[21:02:11.791] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:17:0)
[21:02:11.814] Build status: STARTED
[21:02:11.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:18:0) after 7m32s
[21:09:43.855] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:18:0)
[21:09:43.896] Build status: STARTED
[21:09:43.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:19:0) after 3m46s
[21:13:29.981] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:19:0)
[21:13:29.997] Build status: STARTED
[21:13:29.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:20:0) after 9m12s
[21:22:42.022] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:20:0)
[21:22:42.073] Build status: STARTED
[21:22:42.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:21:0) after 2m40s
[21:25:22.371] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:21:0)
[21:25:22.387] Build status: STARTED
[21:25:22.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:22:0) after 3m14s
[21:28:36.991] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:22:0)
[21:28:37.016] Build status: STARTED
[21:28:37.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:23:0) after 4m16s
[21:32:53.038] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:23:0)
[21:32:53.060] Build status: STARTED
[21:32:53.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:24:0) after 9m10s
[21:42:03.189] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:24:0)
[21:42:03.209] Build status: STARTED
[21:42:03.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:25:0) after 7m29s
[21:49:32.257] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:25:0)
[21:49:32.277] Build status: STARTED
[21:49:32.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:26:0) after 8m42s
[21:58:14.485] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:26:0)
[21:58:14.504] Build status: STARTED
[21:58:14.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:27:0) after 3m48s
[22:02:02.623] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:27:0)
[22:02:02.655] Build status: STARTED
[22:02:02.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:28:0) after 2m29s
[22:04:31.684] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:28:0)
[22:04:31.702] Build status: STARTED
[22:04:31.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:29:0) after 2m7s
[22:06:38.754] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:29:0)
[22:06:38.770] Build status: STARTED
[22:06:38.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:30:0) after 4m8s
[22:10:46.802] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:30:0)
[22:10:46.818] Build status: STARTED
[22:10:46.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:31:0) after 7m2s
[22:17:48.876] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:31:0)
[22:17:48.932] Build status: STARTED
[22:17:48.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:32:0) after 1m9s
[22:18:57.941] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:32:0)
[22:18:57.964] Build status: STARTED
[22:18:57.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:33:0) after 6m40s
[22:25:38.005] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:33:0)
[22:25:38.026] Build status: STARTED
[22:25:38.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:34:0) after 7m24s
[22:33:02.007] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:34:0)
[22:33:02.023] Build status: STARTED
[22:33:02.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:35:0) after 3m13s
[22:36:15.043] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:35:0)
[22:36:15.061] Build status: STARTED
[22:36:15.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:36:0) after 4m37s
[22:40:52.141] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:36:0)
[22:40:52.163] Build status: STARTED
[22:40:52.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:37:0) after 4m4s
[22:44:56.187] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:37:0)
[22:44:56.205] Build status: STARTED
[22:44:56.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:38:0) after 4m7s
[22:49:03.225] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:38:0)
[22:49:03.242] Build status: STARTED
[22:49:03.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:39:0) after 8m46s
[22:57:49.278] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:39:0)
[22:57:49.296] Build status: STARTED
[22:57:49.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:40:0) after 4m15s
[23:02:04.370] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:40:0)
[23:02:04.384] Build status: STARTED
[23:02:04.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:41:0) after 3m35s
[23:05:39.434] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:41:0)
[23:05:39.457] Build status: STARTED
[23:05:39.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:42:0) after 6m15s
[23:11:54.548] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:42:0)
[23:11:54.565] Build status: STARTED
[23:11:54.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:43:0) after 9m16s
[23:21:10.779] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:43:0)
[23:21:10.823] Build status: STARTED
[23:21:10.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:44:0) after 6m53s
[23:28:03.846] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:44:0)
[23:28:03.863] Build status: STARTED
[23:28:03.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:45:0) after 2m10s
[23:30:13.892] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:45:0)
[23:30:13.910] Build status: STARTED
[23:30:13.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:46:0) after 6m28s
[23:36:41.904] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:46:0)
[23:36:41.946] Build status: STARTED
[23:36:41.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:47:0) after 3m39s
[23:40:21.092] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:47:0)
[23:40:21.113] Build status: STARTED
[23:40:21.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:48:0) after 7m46s
[23:48:07.239] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:48:0)
[23:48:07.256] Build status: STARTED
[23:48:07.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:49:0) after 8m10s
[23:56:17.331] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:49:0)
[23:56:17.347] Build status: STARTED
[23:56:17.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:50:0) after 1m49s
[23:58:06.383] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:50:0)
[23:58:06.403] Build status: STARTED
[23:58:06.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:51:0) after 3m24s
[00:01:30.475] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:51:0)
[00:01:30.554] Build status: STARTED
[00:01:30.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:52:0) after 4m14s
[00:05:44.680] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:52:0)
[00:05:44.701] Build status: STARTED
[00:05:44.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:53:0) after 5m51s
[00:11:35.980] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:53:0)
[00:11:35.999] Build status: STARTED
[00:11:35.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:54:0) after 2m46s
[00:14:22.155] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:54:0)
[00:14:22.179] Build status: STARTED
[00:14:22.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:55:0) after 8m37s
[00:22:59.203] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:55:0)
[00:22:59.221] Build status: STARTED
[00:22:59.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:56:0) after 7m53s
[00:30:52.300] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:56:0)
[00:30:52.365] Build status: STARTED
[00:30:52.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:57:0) after 6m58s
[00:37:50.360] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:57:0)
[00:37:50.377] Build status: STARTED
[00:37:50.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:58:0) after 2m22s
[00:40:12.405] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:58:0)
[00:40:12.421] Build status: STARTED
[00:40:12.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:59:0) after 3m6s
[00:43:18.451] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:59:0)
[00:43:18.473] Build status: STARTED
[00:43:18.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:60:0) after 5m28s
[00:48:46.492] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:60:0)
[00:48:46.589] Build status: STARTED
[00:48:46.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:61:0) after 5m20s
[00:54:06.621] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:61:0)
[00:54:06.709] Build status: STARTED
[00:54:06.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:62:0) after 3m24s
[00:57:30.778] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:62:0)
[00:57:30.814] Build status: STARTED
[00:57:30.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:63:0) after 9m34s
[01:07:04.929] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:63:0)
[01:07:04.946] Build status: STARTED
[01:07:04.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:64:0) after 1m32s
[01:08:37.024] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:64:0)
[01:08:37.042] Build status: STARTED
[01:08:37.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:65:0) after 1m5s
[01:09:42.103] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:65:0)
[01:09:42.120] Build status: STARTED
[01:09:42.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:66:0) after 9m58s
[01:19:40.152] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:66:0)
[01:19:40.177] Build status: STARTED
[01:19:40.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:67:0) after 1m45s
[01:21:25.232] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:67:0)
[01:21:25.251] Build status: STARTED
[01:21:25.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:68:0) after 3m11s
[01:24:36.269] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:68:0)
[01:24:36.296] Build status: STARTED
[01:24:36.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:69:0) after 4m58s
[01:29:34.377] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:69:0)
[01:29:34.398] Build status: STARTED
[01:29:34.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:70:0) after 9m57s
[01:39:31.499] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:70:0)
[01:39:31.519] Build status: STARTED
[01:39:31.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:71:0) after 3m40s
[01:43:11.565] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:71:0)
[01:43:11.585] Build status: STARTED
[01:43:11.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:72:0) after 1m41s
[01:44:52.614] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:72:0)
[01:44:52.644] Build status: STARTED
[01:44:52.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925233903243320976:73:0) after 8m32s
[01:45:28.864] Received PubSub notification, asking Buildbucket for the build status
[01:45:28.881] Build:
{
"id": "8759803841379177201",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 30958,
"createdBy": "project:chromium",
"createTime": "2024-01-04T19:38:01.927093727Z",
"startTime": "2024-01-04T19:38:03.205344Z",
"endTime": "2024-01-05T01:45:28.342348Z",
"updateTime": "2024-01-05T01:45:28.342348Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4de1cec1246698932cde06c8d628130b4541a93c",
"ref": "refs/heads/main"
}
}
}
[01:45:28.881] Invocation finished in 6h7m28.115324946s with status FAILED