[01:04:52.490] New invocation is queued and will start shortly
[01:04:54.361] Starting the invocation (attempt 1)
[01:04:54.394] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/70c16ce7d171d36fab0867cf9ef719cb09dee52e"
[01:04:54.394] Popped gitiles commit info from properties and tags
[01:04:54.394] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:04:54.394] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:04:54.395] Buildbucket request:
{
"requestId": "9015357320444594480",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "70c16ce7d171d36fab0867cf9ef719cb09dee52e",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9015357320444594480"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:04:55.019] Scheduled build:
{
"id": "8849927257667827600",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 3646,
"createdBy": "project:chromium",
"createTime": "2021-04-15T01:04:54.506010Z",
"updateTime": "2021-04-15T01:04:54.944130Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "70c16ce7d171d36fab0867cf9ef719cb09dee52e",
"ref": "refs/heads/master"
}
}
}
[01:04:55.019] Task URL: https://cr-buildbucket.appspot.com/build/8849927257667827600
[01:04:55.019] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:2:0) after 2m9s
[01:05:17.429] Received PubSub notification, asking Buildbucket for the build status
[01:05:17.460] Build status: STARTED
[01:07:04.042] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:2:0)
[01:07:04.104] Build status: STARTED
[01:07:04.104] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:4:0) after 6m5s
[01:13:09.213] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:4:0)
[01:13:09.246] Build status: STARTED
[01:13:09.246] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:5:0) after 8m17s
[01:21:26.490] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:5:0)
[01:21:26.518] Build status: STARTED
[01:21:26.518] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:6:0) after 2m53s
[01:24:19.545] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:6:0)
[01:24:19.709] Build status: STARTED
[01:24:19.709] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:7:0) after 8m5s
[01:32:24.760] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:7:0)
[01:32:24.788] Build status: STARTED
[01:32:24.788] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:8:0) after 5m13s
[01:37:37.817] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:8:0)
[01:37:37.844] Build status: STARTED
[01:37:37.844] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:9:0) after 5m33s
[01:43:10.955] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:9:0)
[01:43:10.987] Build status: STARTED
[01:43:10.987] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:10:0) after 1m58s
[01:45:09.012] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:10:0)
[01:45:09.065] Build status: STARTED
[01:45:09.065] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:11:0) after 2m43s
[01:47:52.174] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:11:0)
[01:47:52.245] Build status: STARTED
[01:47:52.245] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:12:0) after 1m27s
[01:49:19.731] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:12:0)
[01:49:19.760] Build status: STARTED
[01:49:19.760] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:13:0) after 3m41s
[01:53:00.905] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:13:0)
[01:53:00.932] Build status: STARTED
[01:53:00.932] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:14:0) after 8m10s
[02:01:10.991] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:14:0)
[02:01:11.018] Build status: STARTED
[02:01:11.018] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:15:0) after 6m1s
[02:07:12.048] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:15:0)
[02:07:12.080] Build status: STARTED
[02:07:12.080] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:16:0) after 2m47s
[02:09:59.245] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:16:0)
[02:09:59.279] Build status: STARTED
[02:09:59.279] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:17:0) after 3m19s
[02:13:18.299] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:17:0)
[02:13:18.326] Build status: STARTED
[02:13:18.326] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:18:0) after 4m14s
[02:17:32.322] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:18:0)
[02:17:32.357] Build status: STARTED
[02:17:32.357] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:19:0) after 6m17s
[02:23:49.413] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:19:0)
[02:23:49.444] Build status: STARTED
[02:23:49.444] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:20:0) after 3m7s
[02:26:56.440] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:20:0)
[02:26:56.501] Build status: STARTED
[02:26:56.501] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:21:0) after 2m47s
[02:29:43.644] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:21:0)
[02:29:43.670] Build status: STARTED
[02:29:43.670] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:22:0) after 4m8s
[02:33:51.701] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:22:0)
[02:33:51.759] Build status: STARTED
[02:33:51.759] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:23:0) after 9m15s
[02:43:06.902] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:23:0)
[02:43:06.935] Build status: STARTED
[02:43:06.935] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:24:0) after 8m43s
[02:51:49.966] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:24:0)
[02:51:49.994] Build status: STARTED
[02:51:49.994] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:25:0) after 8m13s
[03:00:03.030] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:25:0)
[03:00:03.057] Build status: STARTED
[03:00:03.057] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:26:0) after 7m40s
[03:07:43.089] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:26:0)
[03:07:43.126] Build status: STARTED
[03:07:43.126] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:27:0) after 1m35s
[03:09:18.327] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:27:0)
[03:09:18.355] Build status: STARTED
[03:09:18.355] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:28:0) after 9m44s
[03:19:02.462] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:28:0)
[03:19:02.545] Build status: STARTED
[03:19:02.545] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:29:0) after 7m29s
[03:26:31.645] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:29:0)
[03:26:31.677] Build status: STARTED
[03:26:31.677] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:30:0) after 8m55s
[03:35:26.706] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:30:0)
[03:35:26.745] Build status: STARTED
[03:35:26.745] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:31:0) after 5m30s
[03:40:56.775] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:31:0)
[03:40:56.811] Build status: STARTED
[03:40:56.811] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:32:0) after 1m33s
[03:42:29.870] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:32:0)
[03:42:29.919] Build status: STARTED
[03:42:29.919] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:33:0) after 3m8s
[03:45:37.967] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:33:0)
[03:45:37.995] Build status: STARTED
[03:45:37.995] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:34:0) after 1m16s
[03:46:54.013] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:34:0)
[03:46:54.052] Build status: STARTED
[03:46:54.052] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:35:0) after 1m6s
[03:48:00.084] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:35:0)
[03:48:00.125] Build status: STARTED
[03:48:00.125] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:36:0) after 3m47s
[03:51:47.453] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:36:0)
[03:51:47.482] Build status: STARTED
[03:51:47.482] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:37:0) after 5m58s
[03:57:45.487] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:37:0)
[03:57:45.522] Build status: STARTED
[03:57:45.522] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:38:0) after 5m29s
[04:03:14.567] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:38:0)
[04:03:14.595] Build status: STARTED
[04:03:14.595] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:39:0) after 3m52s
[04:07:06.691] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:39:0)
[04:07:06.723] Build status: STARTED
[04:07:06.723] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:40:0) after 9m31s
[04:16:37.774] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:40:0)
[04:16:37.808] Build status: STARTED
[04:16:37.808] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:41:0) after 9m33s
[04:26:10.817] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:41:0)
[04:26:10.851] Build status: STARTED
[04:26:10.851] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:42:0) after 8m6s
[04:34:16.925] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:42:0)
[04:34:16.955] Build status: STARTED
[04:34:16.955] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:43:0) after 9m10s
[04:43:27.190] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:43:0)
[04:43:27.218] Build status: STARTED
[04:43:27.218] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:44:0) after 7m33s
[04:51:00.233] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:44:0)
[04:51:00.259] Build status: STARTED
[04:51:00.259] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:45:0) after 6m43s
[04:57:43.446] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:45:0)
[04:57:43.479] Build status: STARTED
[04:57:43.479] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:46:0) after 6m25s
[05:04:08.608] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:46:0)
[05:04:08.645] Build status: STARTED
[05:04:08.645] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:47:0) after 5m13s
[05:09:21.689] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:47:0)
[05:09:21.717] Build status: STARTED
[05:09:21.717] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:48:0) after 8m14s
[05:17:35.969] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:48:0)
[05:17:36.006] Build status: STARTED
[05:17:36.006] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:49:0) after 8m40s
[05:26:16.101] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:49:0)
[05:26:16.137] Build status: STARTED
[05:26:16.137] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:50:0) after 7m18s
[05:33:34.234] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:50:0)
[05:33:34.323] Build status: STARTED
[05:33:34.323] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:51:0) after 8m29s
[05:42:03.350] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:51:0)
[05:42:03.383] Build status: STARTED
[05:42:03.383] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:52:0) after 4m10s
[05:46:13.511] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:52:0)
[05:46:13.551] Build status: STARTED
[05:46:13.551] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:53:0) after 3m37s
[05:49:50.583] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:53:0)
[05:49:50.614] Build status: STARTED
[05:49:50.614] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:54:0) after 5m33s
[05:55:23.637] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:54:0)
[05:55:23.662] Build status: STARTED
[05:55:23.662] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:55:0) after 4m6s
[05:59:29.719] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:55:0)
[05:59:29.743] Build status: STARTED
[05:59:29.743] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:56:0) after 8m37s
[06:08:06.811] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:56:0)
[06:08:06.842] Build status: STARTED
[06:08:06.842] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:57:0) after 2m56s
[06:11:02.872] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:57:0)
[06:11:02.904] Build status: STARTED
[06:11:02.904] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:58:0) after 4m14s
[06:15:17.010] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:58:0)
[06:15:17.035] Build status: STARTED
[06:15:17.035] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:59:0) after 5m56s
[06:21:13.076] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:59:0)
[06:21:13.102] Build status: STARTED
[06:21:13.102] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:60:0) after 5m57s
[06:27:10.141] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:60:0)
[06:27:10.168] Build status: STARTED
[06:27:10.168] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:61:0) after 4m1s
[06:31:11.214] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:61:0)
[06:31:11.262] Build status: STARTED
[06:31:11.262] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:62:0) after 3m0s
[06:34:11.287] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:62:0)
[06:34:11.317] Build status: STARTED
[06:34:11.317] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:63:0) after 2m17s
[06:36:28.573] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:63:0)
[06:36:28.601] Build status: STARTED
[06:36:28.601] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:64:0) after 3m40s
[06:40:08.684] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:64:0)
[06:40:08.720] Build status: STARTED
[06:40:08.720] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:65:0) after 8m25s
[06:48:33.756] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:65:0)
[06:48:33.791] Build status: STARTED
[06:48:33.791] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:66:0) after 9m55s
[06:58:28.819] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:66:0)
[06:58:28.841] Build status: STARTED
[06:58:28.842] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:67:0) after 1m22s
[06:59:50.865] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:67:0)
[06:59:50.896] Build status: STARTED
[06:59:50.896] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:68:0) after 9m37s
[07:09:27.933] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:68:0)
[07:09:27.967] Build status: STARTED
[07:09:27.967] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:69:0) after 1m9s
[07:10:37.094] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:69:0)
[07:10:37.124] Build status: STARTED
[07:10:37.124] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:70:0) after 2m46s
[07:13:23.274] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:70:0)
[07:13:23.303] Build status: STARTED
[07:13:23.303] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:71:0) after 9m20s
[07:22:43.442] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:71:0)
[07:22:43.474] Build status: STARTED
[07:22:43.474] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:72:0) after 5m46s
[07:28:29.514] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:72:0)
[07:28:29.546] Build status: STARTED
[07:28:29.546] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:73:0) after 5m17s
[07:33:46.591] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:73:0)
[07:33:46.624] Build status: STARTED
[07:33:46.624] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:74:0) after 8m0s
[07:41:46.650] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:74:0)
[07:41:46.684] Build status: STARTED
[07:41:46.684] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:75:0) after 4m36s
[07:46:22.805] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:75:0)
[07:46:22.878] Build status: STARTED
[07:46:22.878] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:76:0) after 9m58s
[07:56:21.123] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:76:0)
[07:56:21.152] Build status: STARTED
[07:56:21.152] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:77:0) after 1m47s
[07:58:08.220] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:77:0)
[07:58:08.255] Build status: STARTED
[07:58:08.255] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:78:0) after 9m30s
[08:07:38.336] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:78:0)
[08:07:38.376] Build status: STARTED
[08:07:38.376] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:79:0) after 9m25s
[08:17:03.410] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:79:0)
[08:17:03.446] Build status: STARTED
[08:17:03.446] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:80:0) after 1m14s
[08:18:17.486] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:80:0)
[08:18:17.514] Build status: STARTED
[08:18:17.514] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:81:0) after 2m21s
[08:20:38.586] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:81:0)
[08:20:38.621] Build status: STARTED
[08:20:38.621] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:82:0) after 6m35s
[08:27:13.877] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:82:0)
[08:27:13.905] Build status: STARTED
[08:27:13.905] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:83:0) after 6m28s
[08:33:41.935] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:83:0)
[08:33:41.963] Build status: STARTED
[08:33:41.963] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:84:0) after 3m35s
[08:37:16.995] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:84:0)
[08:37:17.022] Build status: STARTED
[08:37:17.022] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:85:0) after 7m55s
[08:45:12.052] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:85:0)
[08:45:12.089] Build status: STARTED
[08:45:12.089] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:86:0) after 5m6s
[08:50:18.221] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:86:0)
[08:50:18.325] Build status: STARTED
[08:50:18.325] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:87:0) after 5m17s
[08:55:35.434] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:87:0)
[08:55:35.509] Build status: STARTED
[08:55:35.509] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:88:0) after 8m22s
[09:03:57.622] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:88:0)
[09:03:57.651] Build status: STARTED
[09:03:57.651] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:89:0) after 4m19s
[09:08:16.881] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:89:0)
[09:08:16.906] Build status: STARTED
[09:08:16.906] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:90:0) after 8m18s
[09:16:35.063] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:90:0)
[09:16:35.092] Build status: STARTED
[09:16:35.092] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:91:0) after 2m27s
[09:19:02.474] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:91:0)
[09:19:02.503] Build status: STARTED
[09:19:02.503] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:92:0) after 6m14s
[09:25:16.555] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:92:0)
[09:25:16.584] Build status: STARTED
[09:25:16.584] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:93:0) after 8m44s
[09:34:00.669] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:93:0)
[09:34:00.752] Build status: STARTED
[09:34:00.752] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:94:0) after 3m10s
[09:37:10.888] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:94:0)
[09:37:10.917] Build status: STARTED
[09:37:10.917] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:95:0) after 2m45s
[09:39:55.948] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:95:0)
[09:39:55.978] Build status: STARTED
[09:39:55.978] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:96:0) after 1m46s
[09:41:42.051] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:96:0)
[09:41:42.086] Build status: STARTED
[09:41:42.086] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:97:0) after 2m1s
[09:43:43.137] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:97:0)
[09:43:43.164] Build status: STARTED
[09:43:43.164] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:98:0) after 5m53s
[09:49:36.300] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:98:0)
[09:49:36.346] Build status: STARTED
[09:49:36.346] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:99:0) after 1m59s
[09:51:35.394] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:99:0)
[09:51:35.427] Build status: STARTED
[09:51:35.427] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:100:0) after 6m40s
[09:58:15.523] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:100:0)
[09:58:15.565] Build status: STARTED
[09:58:15.565] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:101:0) after 6m58s
[10:05:14.060] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:101:0)
[10:05:14.096] Build status: STARTED
[10:05:14.096] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:102:0) after 3m45s
[10:08:59.201] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:102:0)
[10:08:59.233] Build status: STARTED
[10:08:59.233] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:103:0) after 2m12s
[10:11:11.306] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:103:0)
[10:11:11.338] Build status: STARTED
[10:11:11.338] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:104:0) after 6m47s
[10:17:58.465] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:104:0)
[10:17:58.495] Build status: STARTED
[10:17:58.495] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:105:0) after 6m4s
[10:24:02.566] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:105:0)
[10:24:02.668] Build status: STARTED
[10:24:02.668] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:106:0) after 4m26s
[10:28:28.874] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:106:0)
[10:28:28.983] Build status: STARTED
[10:28:28.983] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:107:0) after 3m14s
[10:31:43.053] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:107:0)
[10:31:43.083] Build status: STARTED
[10:31:43.083] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:108:0) after 1m17s
[10:33:00.272] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:108:0)
[10:33:00.303] Build status: STARTED
[10:33:00.303] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:109:0) after 5m29s
[10:38:29.341] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:109:0)
[10:38:29.382] Build status: STARTED
[10:38:29.382] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:110:0) after 3m3s
[10:41:32.514] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:110:0)
[10:41:32.543] Build status: STARTED
[10:41:32.543] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:111:0) after 2m25s
[10:43:57.773] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:111:0)
[10:43:57.803] Build status: STARTED
[10:43:57.803] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:112:0) after 6m14s
[10:50:12.002] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:112:0)
[10:50:12.029] Build status: STARTED
[10:50:12.029] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:113:0) after 8m25s
[10:58:37.168] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:113:0)
[10:58:37.203] Build status: STARTED
[10:58:37.203] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:114:0) after 6m29s
[11:05:06.230] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:114:0)
[11:05:06.395] Build status: STARTED
[11:05:06.395] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:115:0) after 1m15s
[11:06:21.425] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:115:0)
[11:06:22.090] Build status: STARTED
[11:06:22.090] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:116:0) after 9m32s
[11:15:54.305] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:116:0)
[11:15:54.332] Build status: STARTED
[11:15:54.332] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:117:0) after 4m32s
[11:20:26.491] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:117:0)
[11:20:26.543] Build status: STARTED
[11:20:26.543] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:118:0) after 4m14s
[11:24:40.569] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:118:0)
[11:24:40.607] Build status: STARTED
[11:24:40.607] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:119:0) after 2m8s
[11:26:48.633] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:119:0)
[11:26:48.660] Build status: STARTED
[11:26:48.660] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:120:0) after 1m24s
[11:28:12.668] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:120:0)
[11:28:12.704] Build status: STARTED
[11:28:12.704] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:121:0) after 4m49s
[11:33:01.719] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:121:0)
[11:33:01.749] Build status: STARTED
[11:33:01.749] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:122:0) after 6m15s
[11:39:17.011] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:122:0)
[11:39:17.060] Build status: STARTED
[11:39:17.060] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:123:0) after 8m36s
[11:47:53.225] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:123:0)
[11:47:53.255] Build status: STARTED
[11:47:53.255] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:124:0) after 4m14s
[11:52:07.308] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:124:0)
[11:52:07.335] Build status: STARTED
[11:52:07.335] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:125:0) after 6m12s
[11:58:19.446] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:125:0)
[11:58:19.492] Build status: STARTED
[11:58:19.492] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:126:0) after 5m27s
[12:03:46.517] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:126:0)
[12:03:46.553] Build status: STARTED
[12:03:46.553] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:127:0) after 1m41s
[12:05:27.578] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:127:0)
[12:05:27.612] Build status: STARTED
[12:05:27.612] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:128:0) after 2m38s
[12:08:05.685] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:128:0)
[12:08:05.737] Build status: STARTED
[12:08:05.737] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:129:0) after 2m39s
[12:10:44.805] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:129:0)
[12:10:44.854] Build status: STARTED
[12:10:44.854] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:130:0) after 5m6s
[12:15:50.923] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:130:0)
[12:15:50.970] Build status: STARTED
[12:15:50.970] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015357320444594480:131:0) after 9m24s
[12:16:23.686] Received PubSub notification, asking Buildbucket for the build status
[12:16:23.714] Build:
{
"id": "8849927257667827600",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 3646,
"createdBy": "project:chromium",
"createTime": "2021-04-15T01:04:54.506010Z",
"startTime": "2021-04-15T01:05:16.323727Z",
"endTime": "2021-04-15T12:16:23.148808813Z",
"updateTime": "2021-04-15T12:16:23.149188872Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "70c16ce7d171d36fab0867cf9ef719cb09dee52e",
"ref": "refs/heads/master"
}
}
}
[12:16:23.714] Invocation finished in 11h11m31.240360728s with status FAILED