[04:00:08.341] New invocation is queued and will start shortly
[04:00:10.672] Starting the invocation (attempt 1)
[04:00:10.707] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f7a3dff21f7ecdf75daaff2f2e0d17568952f67e"
[04:00:10.707] Popped gitiles commit info from properties and tags
[04:00:10.707] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:00:10.707] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:00:10.707] Buildbucket request:
{
"requestId": "8895033522389420608",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f7a3dff21f7ecdf75daaff2f2e0d17568952f67e",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8895033522389420608"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:00:11.417] Scheduled build:
{
"id": "8729603459124431649",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 9974,
"createdBy": "project:chromium",
"createTime": "2024-12-03T04:00:10.829802056Z",
"updateTime": "2024-12-03T04:00:10.829802056Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f7a3dff21f7ecdf75daaff2f2e0d17568952f67e",
"ref": "refs/heads/main"
}
}
}
[04:00:11.417] Task URL: https://cr-buildbucket.appspot.com/build/8729603459124431649
[04:00:11.417] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:2:0) after 5m11s
[04:00:14.599] Received PubSub notification, asking Buildbucket for the build status
[04:00:14.648] Build status: SCHEDULED
[04:05:22.525] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:2:0)
[04:05:22.550] Build status: SCHEDULED
[04:05:22.550] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:4:0) after 6m52s
[04:06:42.413] Received PubSub notification, asking Buildbucket for the build status
[04:06:42.452] Build status: STARTED
[04:12:14.885] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:4:0)
[04:12:14.900] Build status: STARTED
[04:12:14.900] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:6:0) after 2m40s
[04:14:55.007] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:6:0)
[04:14:55.029] Build status: STARTED
[04:14:55.029] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:7:0) after 6m15s
[04:21:10.274] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:7:0)
[04:21:10.303] Build status: STARTED
[04:21:10.303] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:8:0) after 5m37s
[04:26:47.404] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:8:0)
[04:26:47.446] Build status: STARTED
[04:26:47.446] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:9:0) after 7m52s
[04:34:39.555] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:9:0)
[04:34:39.573] Build status: STARTED
[04:34:39.573] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:10:0) after 6m34s
[04:41:13.821] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:10:0)
[04:41:13.860] Build status: STARTED
[04:41:13.860] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:11:0) after 4m22s
[04:45:36.160] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:11:0)
[04:45:36.179] Build status: STARTED
[04:45:36.179] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:12:0) after 5m48s
[04:51:24.197] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:12:0)
[04:51:24.222] Build status: STARTED
[04:51:24.222] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:13:0) after 4m20s
[04:55:44.391] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:13:0)
[04:55:44.418] Build status: STARTED
[04:55:44.418] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:14:0) after 3m32s
[04:59:16.573] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:14:0)
[04:59:16.602] Build status: STARTED
[04:59:16.602] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:15:0) after 9m20s
[05:08:36.766] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:15:0)
[05:08:36.781] Build status: STARTED
[05:08:36.782] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:16:0) after 9m39s
[05:18:16.202] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:16:0)
[05:18:16.225] Build status: STARTED
[05:18:16.225] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:17:0) after 7m32s
[05:25:48.287] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:17:0)
[05:25:48.301] Build status: STARTED
[05:25:48.301] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:18:0) after 5m39s
[05:31:27.441] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:18:0)
[05:31:27.458] Build status: STARTED
[05:31:27.458] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:19:0) after 6m22s
[05:37:49.595] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:19:0)
[05:37:49.615] Build status: STARTED
[05:37:49.615] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:20:0) after 6m6s
[05:43:55.943] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:20:0)
[05:43:55.959] Build status: STARTED
[05:43:55.959] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:21:0) after 8m17s
[05:52:12.978] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:21:0)
[05:52:12.995] Build status: STARTED
[05:52:12.995] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:22:0) after 9m34s
[06:01:47.122] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:22:0)
[06:01:47.180] Build status: STARTED
[06:01:47.180] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:23:0) after 8m56s
[06:10:43.228] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:23:0)
[06:10:43.246] Build status: STARTED
[06:10:43.246] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:24:0) after 2m13s
[06:12:56.264] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:24:0)
[06:12:56.284] Build status: STARTED
[06:12:56.284] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:25:0) after 1m41s
[06:14:37.472] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:25:0)
[06:14:37.487] Build status: STARTED
[06:14:37.487] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:26:0) after 8m4s
[06:22:42.590] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:26:0)
[06:22:42.608] Build status: STARTED
[06:22:42.608] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:27:0) after 2m37s
[06:25:19.729] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:27:0)
[06:25:19.755] Build status: STARTED
[06:25:19.755] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:28:0) after 4m54s
[06:30:13.851] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:28:0)
[06:30:13.869] Build status: STARTED
[06:30:13.869] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:29:0) after 3m36s
[06:33:51.246] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:29:0)
[06:33:51.299] Build status: STARTED
[06:33:51.299] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:30:0) after 2m25s
[06:36:16.330] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:30:0)
[06:36:16.346] Build status: STARTED
[06:36:16.346] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:31:0) after 3m57s
[06:40:13.508] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:31:0)
[06:40:13.531] Build status: STARTED
[06:40:13.531] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:32:0) after 6m55s
[06:47:08.854] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:32:0)
[06:47:08.871] Build status: STARTED
[06:47:08.871] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:33:0) after 3m2s
[06:50:11.146] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:33:0)
[06:50:11.164] Build status: STARTED
[06:50:11.164] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:34:0) after 9m31s
[06:59:42.568] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:34:0)
[06:59:42.584] Build status: STARTED
[06:59:42.584] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:35:0) after 3m9s
[07:02:51.632] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:35:0)
[07:02:51.652] Build status: STARTED
[07:02:51.652] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:36:0) after 2m39s
[07:05:30.729] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:36:0)
[07:05:30.745] Build status: STARTED
[07:05:30.745] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:37:0) after 7m42s
[07:13:12.761] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:37:0)
[07:13:12.779] Build status: STARTED
[07:13:12.779] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:38:0) after 1m44s
[07:14:56.796] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:38:0)
[07:14:56.820] Build status: STARTED
[07:14:56.820] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:39:0) after 6m50s
[07:21:46.843] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:39:0)
[07:21:46.858] Build status: STARTED
[07:21:46.858] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:40:0) after 9m58s
[07:31:44.954] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:40:0)
[07:31:44.973] Build status: STARTED
[07:31:44.973] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:41:0) after 5m20s
[07:37:04.990] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:41:0)
[07:37:05.015] Build status: STARTED
[07:37:05.015] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:42:0) after 2m5s
[07:39:10.037] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:42:0)
[07:39:10.056] Build status: STARTED
[07:39:10.056] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:43:0) after 3m32s
[07:42:42.096] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:43:0)
[07:42:42.123] Build status: STARTED
[07:42:42.123] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:44:0) after 7m20s
[07:50:02.221] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:44:0)
[07:50:02.325] Build status: STARTED
[07:50:02.325] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:45:0) after 2m39s
[07:52:41.487] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:45:0)
[07:52:41.508] Build status: STARTED
[07:52:41.508] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:46:0) after 5m55s
[07:58:36.527] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:46:0)
[07:58:36.543] Build status: STARTED
[07:58:36.543] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:47:0) after 3m40s
[08:02:16.582] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:47:0)
[08:02:16.606] Build status: STARTED
[08:02:16.606] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:48:0) after 7m52s
[08:10:08.635] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:48:0)
[08:10:08.815] Build status: STARTED
[08:10:08.815] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:49:0) after 4m27s
[08:14:35.834] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:49:0)
[08:14:35.854] Build status: STARTED
[08:14:35.854] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:50:0) after 6m47s
[08:21:22.952] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:50:0)
[08:21:22.975] Build status: STARTED
[08:21:22.975] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:51:0) after 4m11s
[08:25:34.364] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:51:0)
[08:25:34.379] Build status: STARTED
[08:25:34.379] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:52:0) after 3m48s
[08:29:22.399] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:52:0)
[08:29:22.416] Build status: STARTED
[08:29:22.416] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:53:0) after 8m30s
[08:37:52.437] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:53:0)
[08:37:52.455] Build status: STARTED
[08:37:52.455] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:54:0) after 9m36s
[08:47:28.435] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:54:0)
[08:47:28.454] Build status: STARTED
[08:47:28.454] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:55:0) after 4m22s
[08:51:50.490] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:55:0)
[08:51:50.509] Build status: STARTED
[08:51:50.509] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:56:0) after 2m44s
[08:54:34.587] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:56:0)
[08:54:34.603] Build status: STARTED
[08:54:34.603] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:57:0) after 8m18s
[09:02:52.662] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:57:0)
[09:02:52.680] Build status: STARTED
[09:02:52.680] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:58:0) after 9m8s
[09:12:00.706] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:58:0)
[09:12:00.725] Build status: STARTED
[09:12:00.725] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:59:0) after 3m44s
[09:15:44.760] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:59:0)
[09:15:44.776] Build status: STARTED
[09:15:44.776] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:60:0) after 9m43s
[09:25:27.797] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:60:0)
[09:25:27.817] Build status: STARTED
[09:25:27.817] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:61:0) after 2m47s
[09:28:14.854] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:61:0)
[09:28:14.870] Build status: STARTED
[09:28:14.870] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:62:0) after 9m6s
[09:37:20.951] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:62:0)
[09:37:20.973] Build status: STARTED
[09:37:20.973] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:63:0) after 4m5s
[09:41:26.897] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:63:0)
[09:41:26.925] Build status: STARTED
[09:41:26.925] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:64:0) after 4m5s
[09:45:31.985] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:64:0)
[09:45:32.001] Build status: STARTED
[09:45:32.001] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:65:0) after 3m30s
[09:49:02.066] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:65:0)
[09:49:02.090] Build status: STARTED
[09:49:02.090] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:66:0) after 1m4s
[09:50:06.109] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:66:0)
[09:50:06.130] Build status: STARTED
[09:50:06.130] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:67:0) after 7m51s
[09:57:57.181] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:67:0)
[09:57:57.205] Build status: STARTED
[09:57:57.205] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:68:0) after 8m35s
[10:06:32.178] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:68:0)
[10:06:32.199] Build status: STARTED
[10:06:32.199] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:69:0) after 5m3s
[10:11:35.514] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:69:0)
[10:11:35.530] Build status: STARTED
[10:11:35.530] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:70:0) after 8m28s
[10:20:03.644] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:70:0)
[10:20:03.714] Build status: STARTED
[10:20:03.714] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:71:0) after 5m15s
[10:25:18.781] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:71:0)
[10:25:18.800] Build status: STARTED
[10:25:18.800] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:72:0) after 5m55s
[10:31:13.819] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:72:0)
[10:31:13.855] Build status: STARTED
[10:31:13.855] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:73:0) after 3m18s
[10:34:31.946] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:73:0)
[10:34:31.967] Build status: STARTED
[10:34:31.967] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:74:0) after 5m42s
[10:40:13.987] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:74:0)
[10:40:14.019] Build status: STARTED
[10:40:14.019] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:75:0) after 1m41s
[10:41:55.036] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:75:0)
[10:41:55.054] Build status: STARTED
[10:41:55.054] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:76:0) after 2m33s
[10:44:28.076] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:76:0)
[10:44:28.313] Build status: STARTED
[10:44:28.313] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:77:0) after 7m45s
[10:52:13.364] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:77:0)
[10:52:13.382] Build status: STARTED
[10:52:13.382] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:78:0) after 6m43s
[10:58:57.079] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:78:0)
[10:58:57.094] Build status: STARTED
[10:58:57.094] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:79:0) after 5m35s
[11:04:32.238] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:79:0)
[11:04:32.252] Build status: STARTED
[11:04:32.252] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:80:0) after 3m1s
[11:07:33.311] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:80:0)
[11:07:33.332] Build status: STARTED
[11:07:33.332] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:81:0) after 9m6s
[11:16:39.385] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:81:0)
[11:16:39.408] Build status: STARTED
[11:16:39.408] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:82:0) after 5m43s
[11:22:22.450] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:82:0)
[11:22:22.470] Build status: STARTED
[11:22:22.470] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:83:0) after 4m38s
[11:27:00.545] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:83:0)
[11:27:00.569] Build status: STARTED
[11:27:00.569] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:84:0) after 8m38s
[11:35:38.618] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:84:0)
[11:35:38.661] Build status: STARTED
[11:35:38.661] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:85:0) after 3m48s
[11:39:26.703] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:85:0)
[11:39:26.726] Build status: STARTED
[11:39:26.726] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:86:0) after 4m10s
[11:43:36.810] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:86:0)
[11:43:36.830] Build status: STARTED
[11:43:36.830] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:87:0) after 1m25s
[11:45:01.856] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:87:0)
[11:45:01.897] Build status: STARTED
[11:45:01.897] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:88:0) after 2m53s
[11:47:54.920] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:88:0)
[11:47:55.046] Build status: STARTED
[11:47:55.046] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:89:0) after 4m16s
[11:52:11.017] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:89:0)
[11:52:11.053] Build status: STARTED
[11:52:11.053] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:90:0) after 4m1s
[11:56:12.121] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:90:0)
[11:56:12.139] Build status: STARTED
[11:56:12.139] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:91:0) after 7m43s
[12:03:55.156] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:91:0)
[12:03:55.174] Build status: STARTED
[12:03:55.174] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:92:0) after 8m22s
[12:12:17.196] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:92:0)
[12:12:17.274] Build status: STARTED
[12:12:17.274] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:93:0) after 3m57s
[12:16:14.304] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:93:0)
[12:16:14.381] Build status: STARTED
[12:16:14.381] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:94:0) after 7m7s
[12:23:21.402] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:94:0)
[12:23:21.468] Build status: STARTED
[12:23:21.468] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:95:0) after 1m15s
[12:24:36.506] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:95:0)
[12:24:36.595] Build status: STARTED
[12:24:36.595] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:96:0) after 2m32s
[12:27:08.590] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:96:0)
[12:27:08.609] Build status: STARTED
[12:27:08.609] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:97:0) after 7m3s
[12:34:11.643] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:97:0)
[12:34:11.659] Build status: STARTED
[12:34:11.659] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:98:0) after 8m37s
[12:42:48.729] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:98:0)
[12:42:48.745] Build status: STARTED
[12:42:48.745] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:99:0) after 1m19s
[12:44:07.812] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:99:0)
[12:44:07.831] Build status: STARTED
[12:44:07.831] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:100:0) after 4m30s
[12:48:37.852] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:100:0)
[12:48:37.927] Build status: STARTED
[12:48:37.927] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:101:0) after 6m25s
[12:55:03.001] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:101:0)
[12:55:03.027] Build status: STARTED
[12:55:03.027] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:102:0) after 8m27s
[13:03:30.026] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:102:0)
[13:03:30.048] Build status: STARTED
[13:03:30.048] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:103:0) after 8m23s
[13:11:53.085] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:103:0)
[13:11:53.140] Build status: STARTED
[13:11:53.140] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:104:0) after 4m51s
[13:16:44.124] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:104:0)
[13:16:44.146] Build status: STARTED
[13:16:44.146] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:105:0) after 4m55s
[13:21:39.166] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:105:0)
[13:21:39.189] Build status: STARTED
[13:21:39.190] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:106:0) after 7m39s
[13:29:18.216] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:106:0)
[13:29:18.242] Build status: STARTED
[13:29:18.242] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:107:0) after 4m38s
[13:33:56.296] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:107:0)
[13:33:56.321] Build status: STARTED
[13:33:56.321] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:108:0) after 8m14s
[13:42:10.471] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:108:0)
[13:42:10.493] Build status: STARTED
[13:42:10.493] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:109:0) after 4m38s
[13:46:48.511] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:109:0)
[13:46:48.590] Build status: STARTED
[13:46:48.590] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:110:0) after 2m43s
[13:49:31.658] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:110:0)
[13:49:31.710] Build status: STARTED
[13:49:31.710] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:111:0) after 5m1s
[13:54:32.735] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:111:0)
[13:54:32.758] Build status: STARTED
[13:54:32.758] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:112:0) after 8m15s
[14:02:47.833] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:112:0)
[14:02:47.868] Build status: STARTED
[14:02:47.868] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:113:0) after 8m56s
[14:11:43.892] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:113:0)
[14:11:43.908] Build status: STARTED
[14:11:43.908] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:114:0) after 3m25s
[14:15:08.927] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:114:0)
[14:15:08.945] Build status: STARTED
[14:15:08.945] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:115:0) after 4m39s
[14:19:47.965] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:115:0)
[14:19:47.987] Build status: STARTED
[14:19:47.987] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:116:0) after 7m2s
[14:26:50.005] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:116:0)
[14:26:50.020] Build status: STARTED
[14:26:50.020] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:117:0) after 1m10s
[14:28:00.041] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:117:0)
[14:28:00.061] Build status: STARTED
[14:28:00.061] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:118:0) after 7m34s
[14:35:34.166] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:118:0)
[14:35:34.201] Build status: STARTED
[14:35:34.201] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:119:0) after 7m40s
[14:43:14.233] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:119:0)
[14:43:14.318] Build status: STARTED
[14:43:14.318] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:120:0) after 6m58s
[14:50:12.340] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:120:0)
[14:50:12.360] Build status: STARTED
[14:50:12.360] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:121:0) after 4m38s
[14:54:50.745] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:121:0)
[14:54:50.763] Build status: STARTED
[14:54:50.763] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:122:0) after 4m3s
[14:58:54.215] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:122:0)
[14:58:54.244] Build status: STARTED
[14:58:54.244] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:123:0) after 5m18s
[15:04:12.332] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:123:0)
[15:04:12.349] Build status: STARTED
[15:04:12.349] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:124:0) after 9m24s
[15:13:36.370] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:124:0)
[15:13:36.486] Build status: STARTED
[15:13:36.486] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:125:0) after 6m0s
[15:19:36.504] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:125:0)
[15:19:36.525] Build status: STARTED
[15:19:36.525] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:126:0) after 2m37s
[15:22:13.561] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:126:0)
[15:22:13.590] Build status: STARTED
[15:22:13.590] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:127:0) after 9m18s
[15:31:31.612] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:127:0)
[15:31:31.636] Build status: STARTED
[15:31:31.636] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:128:0) after 3m39s
[15:35:10.756] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:128:0)
[15:35:10.777] Build status: STARTED
[15:35:10.777] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:129:0) after 1m58s
[15:37:08.970] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:129:0)
[15:37:09.184] Build status: STARTED
[15:37:09.184] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:130:0) after 9m6s
[15:46:15.312] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:130:0)
[15:46:15.329] Build status: STARTED
[15:46:15.329] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:131:0) after 9m55s
[15:56:10.366] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:131:0)
[15:56:10.416] Build status: STARTED
[15:56:10.416] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:132:0) after 4m30s
[16:00:40.434] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:132:0)
[16:00:40.460] Build status: STARTED
[16:00:40.460] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:133:0) after 1m56s
[16:02:36.525] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:133:0)
[16:02:36.544] Build status: STARTED
[16:02:36.544] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:134:0) after 8m39s
[16:11:15.616] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:134:0)
[16:11:15.636] Build status: STARTED
[16:11:15.636] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:135:0) after 2m56s
[16:14:11.705] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:135:0)
[16:14:11.751] Build status: STARTED
[16:14:11.752] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:136:0) after 1m39s
[16:15:50.758] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:136:0)
[16:15:50.776] Build status: STARTED
[16:15:50.776] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:137:0) after 9m9s
[16:24:59.800] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:137:0)
[16:24:59.819] Build status: STARTED
[16:24:59.819] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:138:0) after 5m37s
[16:30:36.841] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:138:0)
[16:30:36.864] Build status: STARTED
[16:30:36.864] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8895033522389420608:139:0) after 8m42s
[16:36:41.381] Received PubSub notification, asking Buildbucket for the build status
[16:36:41.427] Build:
{
"id": "8729603459124431649",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 9974,
"createdBy": "project:chromium",
"createTime": "2024-12-03T04:00:10.829802056Z",
"startTime": "2024-12-03T04:06:42.200156958Z",
"endTime": "2024-12-03T16:36:40.708164027Z",
"updateTime": "2024-12-03T16:36:40.708164027Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f7a3dff21f7ecdf75daaff2f2e0d17568952f67e",
"ref": "refs/heads/main"
}
}
}
[16:36:41.427] Invocation finished in 12h36m33.095564411s with status FAILED