[05:35:45.328] New invocation is queued and will start shortly
[05:35:46.449] Starting the invocation (attempt 1)
[05:35:46.499] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a22771fc65ac8918b1f7a6ec79488638c1616fa1"
[05:35:46.499] Popped gitiles commit info from properties and tags
[05:35:46.499] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:35:46.499] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:35:46.499] Buildbucket request:
{
"requestId": "9016699232604415456",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a22771fc65ac8918b1f7a6ec79488638c1616fa1",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9016699232604415456"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[05:35:47.143] Scheduled build:
{
"id": "8851269170535547184",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 3616,
"createdBy": "project:chromium",
"createTime": "2021-03-31T05:35:46.669618Z",
"updateTime": "2021-03-31T05:35:47.077978Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a22771fc65ac8918b1f7a6ec79488638c1616fa1",
"ref": "refs/heads/master"
}
}
}
[05:35:47.143] Task URL: https://cr-buildbucket.appspot.com/build/8851269170535547184
[05:35:47.143] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:2:0) after 8m55s
[05:39:00.982] Received PubSub notification, asking Buildbucket for the build status
[05:39:01.010] Build status: STARTED
[05:44:42.179] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:2:0)
[05:44:42.213] Build status: STARTED
[05:44:42.214] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:4:0) after 5m28s
[05:50:10.317] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:4:0)
[05:50:10.343] Build status: STARTED
[05:50:10.343] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:5:0) after 2m15s
[05:52:25.623] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:5:0)
[05:52:25.655] Build status: STARTED
[05:52:25.655] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:6:0) after 4m43s
[05:57:09.057] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:6:0)
[05:57:09.106] Build status: STARTED
[05:57:09.106] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:7:0) after 6m56s
[06:04:05.204] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:7:0)
[06:04:05.290] Build status: STARTED
[06:04:05.290] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:8:0) after 8m32s
[06:12:37.477] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:8:0)
[06:12:37.516] Build status: STARTED
[06:12:37.516] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:9:0) after 4m37s
[06:17:14.562] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:9:0)
[06:17:14.601] Build status: STARTED
[06:17:14.601] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:10:0) after 1m42s
[06:18:56.768] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:10:0)
[06:18:56.797] Build status: STARTED
[06:18:56.797] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:11:0) after 8m38s
[06:27:34.902] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:11:0)
[06:27:34.941] Build status: STARTED
[06:27:34.941] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:12:0) after 6m20s
[06:33:55.075] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:12:0)
[06:33:55.101] Build status: STARTED
[06:33:55.101] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:13:0) after 9m59s
[06:43:54.226] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:13:0)
[06:43:54.253] Build status: STARTED
[06:43:54.253] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:14:0) after 6m8s
[06:50:02.280] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:14:0)
[06:50:02.338] Build status: STARTED
[06:50:02.338] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:15:0) after 5m16s
[06:55:18.367] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:15:0)
[06:55:18.399] Build status: STARTED
[06:55:18.399] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:16:0) after 6m5s
[07:01:23.508] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:16:0)
[07:01:23.537] Build status: STARTED
[07:01:23.538] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:17:0) after 1m50s
[07:03:13.589] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:17:0)
[07:03:13.681] Build status: STARTED
[07:03:13.681] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:18:0) after 7m43s
[07:10:56.733] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:18:0)
[07:10:56.774] Build status: STARTED
[07:10:56.774] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:19:0) after 8m44s
[07:19:41.122] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:19:0)
[07:19:41.154] Build status: STARTED
[07:19:41.154] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:20:0) after 9m27s
[07:29:08.261] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:20:0)
[07:29:08.354] Build status: STARTED
[07:29:08.354] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:21:0) after 6m17s
[07:35:25.477] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:21:0)
[07:35:25.504] Build status: STARTED
[07:35:25.504] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:22:0) after 1m17s
[07:36:42.863] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:22:0)
[07:36:42.903] Build status: STARTED
[07:36:42.903] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:23:0) after 2m54s
[07:39:36.930] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:23:0)
[07:39:36.956] Build status: STARTED
[07:39:36.956] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:24:0) after 8m54s
[07:48:31.089] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:24:0)
[07:48:31.115] Build status: STARTED
[07:48:31.115] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:25:0) after 6m11s
[07:54:42.142] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:25:0)
[07:54:42.186] Build status: STARTED
[07:54:42.186] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:26:0) after 3m0s
[07:57:42.314] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:26:0)
[07:57:42.340] Build status: STARTED
[07:57:42.340] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:27:0) after 4m19s
[08:02:01.373] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:27:0)
[08:02:01.399] Build status: STARTED
[08:02:01.399] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:28:0) after 9m16s
[08:11:17.540] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:28:0)
[08:11:17.597] Build status: STARTED
[08:11:17.597] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:29:0) after 8m15s
[08:19:32.692] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:29:0)
[08:19:32.751] Build status: STARTED
[08:19:32.751] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:30:0) after 2m41s
[08:22:13.779] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:30:0)
[08:22:13.810] Build status: STARTED
[08:22:13.810] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:31:0) after 7m16s
[08:29:29.839] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:31:0)
[08:29:29.863] Build status: STARTED
[08:29:29.863] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:32:0) after 1m40s
[08:31:10.105] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:32:0)
[08:31:10.143] Build status: STARTED
[08:31:10.143] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:33:0) after 1m0s
[08:32:10.169] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:33:0)
[08:32:10.213] Build status: STARTED
[08:32:10.213] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:34:0) after 7m16s
[08:39:26.340] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:34:0)
[08:39:26.387] Build status: STARTED
[08:39:26.387] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:35:0) after 6m54s
[08:46:20.415] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:35:0)
[08:46:20.448] Build status: STARTED
[08:46:20.448] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:36:0) after 4m45s
[08:51:05.560] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:36:0)
[08:51:05.586] Build status: STARTED
[08:51:05.586] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:37:0) after 6m8s
[08:57:13.621] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:37:0)
[08:57:13.652] Build status: STARTED
[08:57:13.653] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:38:0) after 8m28s
[09:05:41.737] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:38:0)
[09:05:41.815] Build status: STARTED
[09:05:41.815] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:39:0) after 6m58s
[09:12:39.932] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:39:0)
[09:12:39.960] Build status: STARTED
[09:12:39.960] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:40:0) after 5m57s
[09:18:37.030] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:40:0)
[09:18:37.060] Build status: STARTED
[09:18:37.060] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:41:0) after 3m13s
[09:21:50.176] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:41:0)
[09:21:50.206] Build status: STARTED
[09:21:50.207] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:42:0) after 6m29s
[09:28:19.249] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:42:0)
[09:28:19.278] Build status: STARTED
[09:28:19.278] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:43:0) after 9m28s
[09:37:47.321] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:43:0)
[09:37:47.375] Build status: STARTED
[09:37:47.375] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:44:0) after 5m12s
[09:42:59.405] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:44:0)
[09:42:59.468] Build status: STARTED
[09:42:59.468] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:45:0) after 1m16s
[09:44:15.509] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:45:0)
[09:44:15.549] Build status: STARTED
[09:44:15.549] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:46:0) after 4m13s
[09:48:28.665] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:46:0)
[09:48:28.698] Build status: STARTED
[09:48:28.698] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:47:0) after 8m4s
[09:56:32.680] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:47:0)
[09:56:32.707] Build status: STARTED
[09:56:32.707] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:48:0) after 6m2s
[10:02:34.745] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:48:0)
[10:02:34.773] Build status: STARTED
[10:02:34.773] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:49:0) after 7m39s
[10:10:14.037] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:49:0)
[10:10:14.086] Build status: STARTED
[10:10:14.086] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:50:0) after 1m56s
[10:12:10.117] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:50:0)
[10:12:10.147] Build status: STARTED
[10:12:10.148] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:51:0) after 1m6s
[10:13:16.193] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:51:0)
[10:13:16.223] Build status: STARTED
[10:13:16.223] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:52:0) after 4m8s
[10:17:24.388] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:52:0)
[10:17:24.414] Build status: STARTED
[10:17:24.414] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:53:0) after 6m33s
[10:23:57.439] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:53:0)
[10:23:57.468] Build status: STARTED
[10:23:57.468] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:54:0) after 2m44s
[10:26:41.634] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:54:0)
[10:26:41.660] Build status: STARTED
[10:26:41.660] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:55:0) after 5m15s
[10:31:56.912] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:55:0)
[10:31:56.942] Build status: STARTED
[10:31:56.942] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:56:0) after 1m27s
[10:33:23.971] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:56:0)
[10:33:24.012] Build status: STARTED
[10:33:24.013] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:57:0) after 9m41s
[10:43:05.068] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:57:0)
[10:43:05.098] Build status: STARTED
[10:43:05.098] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:58:0) after 3m38s
[10:46:43.156] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:58:0)
[10:46:43.188] Build status: STARTED
[10:46:43.188] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:59:0) after 3m19s
[10:50:02.223] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:59:0)
[10:50:02.252] Build status: STARTED
[10:50:02.252] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:60:0) after 4m36s
[10:54:38.340] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:60:0)
[10:54:38.378] Build status: STARTED
[10:54:38.378] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:61:0) after 8m29s
[11:03:07.675] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:61:0)
[11:03:07.705] Build status: STARTED
[11:03:07.705] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:62:0) after 5m30s
[11:08:37.776] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:62:0)
[11:08:37.804] Build status: STARTED
[11:08:37.804] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:63:0) after 4m46s
[11:13:23.858] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:63:0)
[11:13:23.884] Build status: STARTED
[11:13:23.884] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:64:0) after 2m57s
[11:16:20.950] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:64:0)
[11:16:20.985] Build status: STARTED
[11:16:20.985] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:65:0) after 2m20s
[11:18:41.011] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:65:0)
[11:18:41.038] Build status: STARTED
[11:18:41.038] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:66:0) after 6m25s
[11:25:06.173] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:66:0)
[11:25:06.200] Build status: STARTED
[11:25:06.200] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:67:0) after 9m26s
[11:34:32.316] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:67:0)
[11:34:32.394] Build status: STARTED
[11:34:32.394] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:68:0) after 3m28s
[11:38:00.419] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:68:0)
[11:38:00.460] Build status: STARTED
[11:38:00.460] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:69:0) after 6m56s
[11:44:56.467] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:69:0)
[11:44:56.504] Build status: STARTED
[11:44:56.504] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:70:0) after 1m19s
[11:46:15.531] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:70:0)
[11:46:15.571] Build status: STARTED
[11:46:15.571] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:71:0) after 6m40s
[11:52:55.648] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:71:0)
[11:52:55.689] Build status: STARTED
[11:52:55.689] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:72:0) after 9m4s
[12:01:59.754] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:72:0)
[12:01:59.781] Build status: STARTED
[12:01:59.781] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:73:0) after 2m52s
[12:04:52.019] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:73:0)
[12:04:52.045] Build status: STARTED
[12:04:52.045] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:74:0) after 3m35s
[12:08:27.081] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:74:0)
[12:08:27.115] Build status: STARTED
[12:08:27.115] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:75:0) after 1m6s
[12:09:33.149] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:75:0)
[12:09:33.192] Build status: STARTED
[12:09:33.192] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:76:0) after 3m10s
[12:12:43.313] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:76:0)
[12:12:43.341] Build status: STARTED
[12:12:43.341] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:77:0) after 1m34s
[12:14:17.393] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:77:0)
[12:14:17.442] Build status: STARTED
[12:14:17.442] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:78:0) after 6m10s
[12:20:27.624] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:78:0)
[12:20:27.661] Build status: STARTED
[12:20:27.661] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:79:0) after 6m37s
[12:27:04.970] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:79:0)
[12:27:05.000] Build status: STARTED
[12:27:05.000] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:80:0) after 2m21s
[12:29:26.054] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:80:0)
[12:29:26.086] Build status: STARTED
[12:29:26.086] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:81:0) after 7m13s
[12:36:39.106] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:81:0)
[12:36:39.154] Build status: STARTED
[12:36:39.154] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:82:0) after 2m42s
[12:39:21.189] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:82:0)
[12:39:21.235] Build status: STARTED
[12:39:21.235] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:83:0) after 4m37s
[12:43:58.267] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:83:0)
[12:43:58.306] Build status: STARTED
[12:43:58.306] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:84:0) after 3m30s
[12:47:28.490] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:84:0)
[12:47:28.535] Build status: STARTED
[12:47:28.535] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:85:0) after 8m19s
[12:55:47.574] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:85:0)
[12:55:47.600] Build status: STARTED
[12:55:47.600] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:86:0) after 4m5s
[12:59:52.626] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:86:0)
[12:59:52.657] Build status: STARTED
[12:59:52.657] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:87:0) after 4m28s
[13:04:21.469] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:87:0)
[13:04:21.500] Build status: STARTED
[13:04:21.500] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:88:0) after 4m58s
[13:09:20.261] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:88:0)
[13:09:20.306] Build status: STARTED
[13:09:20.306] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:89:0) after 9m43s
[13:19:03.353] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:89:0)
[13:19:03.392] Build status: STARTED
[13:19:03.392] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:90:0) after 3m58s
[13:23:01.505] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:90:0)
[13:23:01.538] Build status: STARTED
[13:23:01.538] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:91:0) after 1m54s
[13:24:55.666] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:91:0)
[13:24:55.713] Build status: STARTED
[13:24:55.713] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:92:0) after 4m28s
[13:29:23.964] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:92:0)
[13:29:23.996] Build status: STARTED
[13:29:23.996] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:93:0) after 2m49s
[13:32:13.090] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:93:0)
[13:32:13.118] Build status: STARTED
[13:32:13.118] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:94:0) after 8m48s
[13:41:01.203] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:94:0)
[13:41:01.231] Build status: STARTED
[13:41:01.231] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:95:0) after 1m57s
[13:42:58.405] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:95:0)
[13:42:58.444] Build status: STARTED
[13:42:58.444] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:96:0) after 7m57s
[13:50:55.471] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:96:0)
[13:50:55.514] Build status: STARTED
[13:50:55.514] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:97:0) after 8m37s
[13:59:32.601] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:97:0)
[13:59:32.628] Build status: STARTED
[13:59:32.628] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:98:0) after 4m52s
[14:04:24.897] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:98:0)
[14:04:24.924] Build status: STARTED
[14:04:24.924] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:99:0) after 9m24s
[14:13:49.141] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:99:0)
[14:13:49.168] Build status: STARTED
[14:13:49.168] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:100:0) after 1m37s
[14:15:26.392] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:100:0)
[14:15:26.440] Build status: STARTED
[14:15:26.440] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:101:0) after 2m25s
[14:17:51.468] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:101:0)
[14:17:51.518] Build status: STARTED
[14:17:51.518] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:102:0) after 8m10s
[14:26:01.538] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:102:0)
[14:26:01.599] Build status: STARTED
[14:26:01.600] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:103:0) after 5m1s
[14:31:02.675] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:103:0)
[14:31:02.772] Build status: STARTED
[14:31:02.772] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:104:0) after 8m56s
[14:39:58.855] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:104:0)
[14:39:58.901] Build status: STARTED
[14:39:58.901] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:105:0) after 3m51s
[14:43:49.945] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:105:0)
[14:43:49.969] Build status: STARTED
[14:43:49.969] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:106:0) after 2m13s
[14:46:03.019] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:106:0)
[14:46:03.044] Build status: STARTED
[14:46:03.044] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:107:0) after 4m18s
[14:50:21.174] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:107:0)
[14:50:21.204] Build status: STARTED
[14:50:21.204] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:108:0) after 6m36s
[14:56:57.234] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:108:0)
[14:56:57.266] Build status: STARTED
[14:56:57.266] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:109:0) after 9m14s
[15:06:11.395] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:109:0)
[15:06:11.430] Build status: STARTED
[15:06:11.430] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:110:0) after 3m12s
[15:09:23.518] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:110:0)
[15:09:23.547] Build status: STARTED
[15:09:23.547] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:111:0) after 7m26s
[15:16:49.723] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:111:0)
[15:16:49.752] Build status: STARTED
[15:16:49.752] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:112:0) after 4m50s
[15:21:39.778] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:112:0)
[15:21:39.817] Build status: STARTED
[15:21:39.817] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:113:0) after 9m4s
[15:30:44.082] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:113:0)
[15:30:44.114] Build status: STARTED
[15:30:44.114] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:114:0) after 3m1s
[15:33:45.151] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:114:0)
[15:33:45.180] Build status: STARTED
[15:33:45.180] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:115:0) after 2m14s
[15:35:59.210] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:115:0)
[15:35:59.247] Build status: STARTED
[15:35:59.247] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:116:0) after 9m13s
[15:45:12.379] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:116:0)
[15:45:12.406] Build status: STARTED
[15:45:12.406] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:117:0) after 9m18s
[15:54:30.465] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:117:0)
[15:54:30.533] Build status: STARTED
[15:54:30.533] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:118:0) after 9m32s
[16:04:02.926] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:118:0)
[16:04:02.954] Build status: STARTED
[16:04:02.954] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:119:0) after 7m18s
[16:11:21.365] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:119:0)
[16:11:21.395] Build status: STARTED
[16:11:21.395] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:120:0) after 5m49s
[16:17:10.630] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:120:0)
[16:17:10.659] Build status: STARTED
[16:17:10.659] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:121:0) after 2m9s
[16:19:19.751] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:121:0)
[16:19:19.779] Build status: STARTED
[16:19:19.779] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:122:0) after 7m42s
[16:27:01.863] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:122:0)
[16:27:01.891] Build status: STARTED
[16:27:01.891] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:123:0) after 8m21s
[16:35:22.920] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:123:0)
[16:35:22.951] Build status: STARTED
[16:35:22.951] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:124:0) after 8m35s
[16:43:58.207] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:124:0)
[16:43:58.246] Build status: STARTED
[16:43:58.246] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016699232604415456:125:0) after 4m56s
[16:44:59.119] Received PubSub notification, asking Buildbucket for the build status
[16:44:59.148] Build:
{
"id": "8851269170535547184",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 3616,
"createdBy": "project:chromium",
"createTime": "2021-03-31T05:35:46.669618Z",
"startTime": "2021-03-31T05:39:00.396554Z",
"endTime": "2021-03-31T16:44:58.426286351Z",
"updateTime": "2021-03-31T16:44:58.427132836Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a22771fc65ac8918b1f7a6ec79488638c1616fa1",
"ref": "refs/heads/master"
}
}
}
[16:44:59.148] Invocation finished in 11h9m13.834891958s with status FAILED