[17:04:54.593] New invocation is queued and will start shortly
[17:04:55.695] Starting the invocation (attempt 1)
[17:04:55.734] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/79228a95cd02abcbcb1f1e914230fab11f6308de"
[17:04:55.735] Popped gitiles commit info from properties and tags
[17:04:55.735] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[17:04:55.735] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[17:04:55.735] Buildbucket request:
{
"requestId": "9016927665655412944",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "79228a95cd02abcbcb1f1e914230fab11f6308de",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9016927665655412944"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[17:04:56.354] Scheduled build:
{
"id": "8851497603722670704",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 3610,
"createdBy": "project:chromium",
"createTime": "2021-03-28T17:04:55.806161Z",
"updateTime": "2021-03-28T17:04:56.282337Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "79228a95cd02abcbcb1f1e914230fab11f6308de",
"ref": "refs/heads/master"
}
}
}
[17:04:56.354] Task URL: https://cr-buildbucket.appspot.com/build/8851497603722670704
[17:04:56.354] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:2:0) after 8m0s
[17:05:34.791] Received PubSub notification, asking Buildbucket for the build status
[17:05:34.817] Build status: STARTED
[17:12:56.368] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:2:0)
[17:12:56.393] Build status: STARTED
[17:12:56.393] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:4:0) after 7m12s
[17:20:08.444] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:4:0)
[17:20:08.473] Build status: STARTED
[17:20:08.473] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:5:0) after 9m41s
[17:29:49.607] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:5:0)
[17:29:49.631] Build status: STARTED
[17:29:49.631] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:6:0) after 2m35s
[17:32:24.647] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:6:0)
[17:32:24.682] Build status: STARTED
[17:32:24.682] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:7:0) after 3m55s
[17:36:19.722] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:7:0)
[17:36:19.751] Build status: STARTED
[17:36:19.751] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:8:0) after 9m16s
[17:45:35.778] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:8:0)
[17:45:35.805] Build status: STARTED
[17:45:35.805] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:9:0) after 3m26s
[17:49:02.224] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:9:0)
[17:49:02.291] Build status: STARTED
[17:49:02.291] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:10:0) after 6m35s
[17:55:37.425] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:10:0)
[17:55:37.569] Build status: STARTED
[17:55:37.569] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:11:0) after 2m32s
[17:58:09.585] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:11:0)
[17:58:09.628] Build status: STARTED
[17:58:09.628] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:12:0) after 8m13s
[18:06:22.648] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:12:0)
[18:06:22.677] Build status: STARTED
[18:06:22.677] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:13:0) after 8m1s
[18:14:23.852] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:13:0)
[18:14:23.914] Build status: STARTED
[18:14:23.914] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:14:0) after 1m47s
[18:16:11.071] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:14:0)
[18:16:11.115] Build status: STARTED
[18:16:11.115] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:15:0) after 4m1s
[18:20:12.129] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:15:0)
[18:20:12.156] Build status: STARTED
[18:20:12.156] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:16:0) after 3m22s
[18:23:34.173] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:16:0)
[18:23:34.207] Build status: STARTED
[18:23:34.207] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:17:0) after 3m1s
[18:26:35.567] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:17:0)
[18:26:35.611] Build status: STARTED
[18:26:35.611] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:18:0) after 6m13s
[18:32:48.845] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:18:0)
[18:32:48.872] Build status: STARTED
[18:32:48.872] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:19:0) after 4m11s
[18:37:00.036] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:19:0)
[18:37:00.067] Build status: STARTED
[18:37:00.067] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:20:0) after 9m34s
[18:46:34.088] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:20:0)
[18:46:34.116] Build status: STARTED
[18:46:34.116] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:21:0) after 6m36s
[18:53:10.215] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:21:0)
[18:53:10.245] Build status: STARTED
[18:53:10.245] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:22:0) after 2m19s
[18:55:29.263] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:22:0)
[18:55:29.291] Build status: STARTED
[18:55:29.291] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:23:0) after 6m18s
[19:01:47.308] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:23:0)
[19:01:47.351] Build status: STARTED
[19:01:47.351] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:24:0) after 3m56s
[19:05:43.476] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:24:0)
[19:05:43.504] Build status: STARTED
[19:05:43.504] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:25:0) after 9m58s
[19:15:41.538] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:25:0)
[19:15:41.563] Build status: STARTED
[19:15:41.563] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:26:0) after 5m33s
[19:21:15.115] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:26:0)
[19:21:15.143] Build status: STARTED
[19:21:15.143] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:27:0) after 3m48s
[19:25:03.257] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:27:0)
[19:25:03.288] Build status: STARTED
[19:25:03.289] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:28:0) after 3m37s
[19:28:40.309] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:28:0)
[19:28:40.336] Build status: STARTED
[19:28:40.337] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:29:0) after 3m23s
[19:32:03.359] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:29:0)
[19:32:03.390] Build status: STARTED
[19:32:03.390] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:30:0) after 4m36s
[19:36:39.822] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:30:0)
[19:36:39.847] Build status: STARTED
[19:36:39.847] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:31:0) after 9m40s
[19:46:19.915] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:31:0)
[19:46:19.939] Build status: STARTED
[19:46:19.939] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:32:0) after 8m46s
[19:55:06.031] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:32:0)
[19:55:06.081] Build status: STARTED
[19:55:06.082] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:33:0) after 9m58s
[20:05:05.790] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:33:0)
[20:05:05.813] Build status: STARTED
[20:05:05.813] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:34:0) after 1m28s
[20:06:33.858] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:34:0)
[20:06:33.897] Build status: STARTED
[20:06:33.897] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:35:0) after 5m53s
[20:12:27.110] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:35:0)
[20:12:27.139] Build status: STARTED
[20:12:27.139] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:36:0) after 8m37s
[20:21:04.213] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:36:0)
[20:21:04.243] Build status: STARTED
[20:21:04.243] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:37:0) after 4m29s
[20:25:33.474] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:37:0)
[20:25:33.500] Build status: STARTED
[20:25:33.500] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:38:0) after 1m59s
[20:27:32.523] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:38:0)
[20:27:32.549] Build status: STARTED
[20:27:32.549] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:39:0) after 1m17s
[20:28:50.122] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:39:0)
[20:28:50.174] Build status: STARTED
[20:28:50.174] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:40:0) after 9m51s
[20:38:41.194] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:40:0)
[20:38:41.229] Build status: STARTED
[20:38:41.229] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:41:0) after 8m28s
[20:47:09.781] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:41:0)
[20:47:09.816] Build status: STARTED
[20:47:09.816] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:42:0) after 1m21s
[20:48:30.842] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:42:0)
[20:48:30.870] Build status: STARTED
[20:48:30.870] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:43:0) after 2m25s
[20:50:55.891] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:43:0)
[20:50:55.918] Build status: STARTED
[20:50:55.918] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:44:0) after 2m59s
[20:53:54.936] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:44:0)
[20:53:54.964] Build status: STARTED
[20:53:54.965] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:45:0) after 6m58s
[21:00:52.981] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:45:0)
[21:00:53.008] Build status: STARTED
[21:00:53.008] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:46:0) after 6m53s
[21:07:46.089] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:46:0)
[21:07:46.115] Build status: STARTED
[21:07:46.115] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:47:0) after 3m25s
[21:11:11.135] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:47:0)
[21:11:11.210] Build status: STARTED
[21:11:11.210] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:48:0) after 6m7s
[21:17:18.233] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:48:0)
[21:17:18.262] Build status: STARTED
[21:17:18.262] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:49:0) after 7m30s
[21:24:48.290] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:49:0)
[21:24:48.320] Build status: STARTED
[21:24:48.320] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:50:0) after 7m53s
[21:32:41.558] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:50:0)
[21:32:41.592] Build status: STARTED
[21:32:41.592] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:51:0) after 6m49s
[21:39:31.002] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:51:0)
[21:39:31.030] Build status: STARTED
[21:39:31.030] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:52:0) after 5m43s
[21:45:14.047] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:52:0)
[21:45:14.075] Build status: STARTED
[21:45:14.075] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:53:0) after 1m29s
[21:46:43.094] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:53:0)
[21:46:43.126] Build status: STARTED
[21:46:43.126] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:54:0) after 4m36s
[21:51:19.743] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:54:0)
[21:51:19.772] Build status: STARTED
[21:51:19.772] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:55:0) after 2m58s
[21:54:17.792] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:55:0)
[21:54:17.821] Build status: STARTED
[21:54:17.822] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:56:0) after 7m53s
[22:02:11.341] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:56:0)
[22:02:11.383] Build status: STARTED
[22:02:11.383] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:57:0) after 8m54s
[22:11:05.593] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:57:0)
[22:11:05.633] Build status: STARTED
[22:11:05.633] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:58:0) after 5m24s
[22:16:29.650] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:58:0)
[22:16:29.674] Build status: STARTED
[22:16:29.674] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:59:0) after 7m16s
[22:23:45.697] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:59:0)
[22:23:45.728] Build status: STARTED
[22:23:45.728] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:60:0) after 3m31s
[22:27:16.786] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:60:0)
[22:27:16.835] Build status: STARTED
[22:27:16.835] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:61:0) after 7m29s
[22:34:45.910] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:61:0)
[22:34:45.933] Build status: STARTED
[22:34:45.933] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:62:0) after 5m4s
[22:39:49.979] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:62:0)
[22:39:50.002] Build status: STARTED
[22:39:50.002] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:63:0) after 2m12s
[22:42:02.028] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:63:0)
[22:42:02.059] Build status: STARTED
[22:42:02.059] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:64:0) after 1m50s
[22:43:52.332] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:64:0)
[22:43:52.361] Build status: STARTED
[22:43:52.361] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:65:0) after 2m1s
[22:45:53.502] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:65:0)
[22:45:53.535] Build status: STARTED
[22:45:53.535] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:66:0) after 5m9s
[22:51:02.598] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:66:0)
[22:51:02.633] Build status: STARTED
[22:51:02.633] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:67:0) after 2m47s
[22:53:50.015] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:67:0)
[22:53:50.061] Build status: STARTED
[22:53:50.061] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:68:0) after 2m48s
[22:56:38.289] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:68:0)
[22:56:38.330] Build status: STARTED
[22:56:38.330] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:69:0) after 4m21s
[23:00:59.348] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:69:0)
[23:00:59.386] Build status: STARTED
[23:00:59.386] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:70:0) after 6m36s
[23:07:35.585] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:70:0)
[23:07:35.612] Build status: STARTED
[23:07:35.612] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:71:0) after 1m41s
[23:09:16.630] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:71:0)
[23:09:16.656] Build status: STARTED
[23:09:16.656] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:72:0) after 8m26s
[23:17:42.675] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:72:0)
[23:17:42.727] Build status: STARTED
[23:17:42.727] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:73:0) after 2m10s
[23:19:53.034] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:73:0)
[23:19:53.069] Build status: STARTED
[23:19:53.069] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:74:0) after 5m59s
[23:25:52.273] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:74:0)
[23:25:52.309] Build status: STARTED
[23:25:52.309] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:75:0) after 1m16s
[23:27:09.034] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:75:0)
[23:27:09.061] Build status: STARTED
[23:27:09.061] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:76:0) after 1m31s
[23:28:40.219] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:76:0)
[23:28:40.245] Build status: STARTED
[23:28:40.245] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:77:0) after 7m53s
[23:36:33.263] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:77:0)
[23:36:33.293] Build status: STARTED
[23:36:33.293] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:78:0) after 6m6s
[23:42:39.297] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:78:0)
[23:42:39.350] Build status: STARTED
[23:42:39.350] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:79:0) after 4m17s
[23:46:56.371] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:79:0)
[23:46:56.394] Build status: STARTED
[23:46:56.394] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:80:0) after 4m6s
[23:51:02.445] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:80:0)
[23:51:02.480] Build status: STARTED
[23:51:02.480] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:81:0) after 4m41s
[23:55:43.634] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:81:0)
[23:55:43.670] Build status: STARTED
[23:55:43.670] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:82:0) after 2m19s
[23:58:02.693] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:82:0)
[23:58:02.719] Build status: STARTED
[23:58:02.719] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:83:0) after 1m53s
[23:59:55.813] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:83:0)
[23:59:55.838] Build status: STARTED
[23:59:55.838] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:84:0) after 5m58s
[00:05:53.892] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:84:0)
[00:05:53.923] Build status: STARTED
[00:05:53.923] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:85:0) after 7m31s
[00:13:24.989] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:85:0)
[00:13:25.020] Build status: STARTED
[00:13:25.020] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:86:0) after 6m2s
[00:19:27.248] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:86:0)
[00:19:27.272] Build status: STARTED
[00:19:27.272] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:87:0) after 4m9s
[00:23:36.311] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:87:0)
[00:23:36.344] Build status: STARTED
[00:23:36.344] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:88:0) after 8m23s
[00:31:59.872] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:88:0)
[00:31:59.900] Build status: STARTED
[00:31:59.900] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:89:0) after 1m52s
[00:33:51.911] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:89:0)
[00:33:51.950] Build status: STARTED
[00:33:51.950] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:90:0) after 8m49s
[00:42:41.139] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:90:0)
[00:42:41.248] Build status: STARTED
[00:42:41.248] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:91:0) after 8m58s
[00:51:39.265] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:91:0)
[00:51:39.320] Build status: STARTED
[00:51:39.320] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:92:0) after 4m40s
[00:56:19.618] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:92:0)
[00:56:19.644] Build status: STARTED
[00:56:19.644] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:93:0) after 9m40s
[01:05:59.665] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:93:0)
[01:05:59.695] Build status: STARTED
[01:05:59.695] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:94:0) after 9m10s
[01:15:09.863] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:94:0)
[01:15:09.894] Build status: STARTED
[01:15:09.894] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:95:0) after 3m59s
[01:19:08.924] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:95:0)
[01:19:08.974] Build status: STARTED
[01:19:08.974] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:96:0) after 1m49s
[01:20:58.612] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:96:0)
[01:20:58.640] Build status: STARTED
[01:20:58.640] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:97:0) after 4m50s
[01:25:48.660] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:97:0)
[01:25:48.745] Build status: STARTED
[01:25:48.745] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:98:0) after 9m32s
[01:35:21.019] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:98:0)
[01:35:21.045] Build status: STARTED
[01:35:21.045] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:99:0) after 2m31s
[01:37:52.070] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:99:0)
[01:37:52.098] Build status: STARTED
[01:37:52.098] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:100:0) after 2m41s
[01:40:33.196] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:100:0)
[01:40:33.243] Build status: STARTED
[01:40:33.243] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:101:0) after 4m26s
[01:44:59.323] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:101:0)
[01:44:59.355] Build status: STARTED
[01:44:59.355] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:102:0) after 7m2s
[01:52:01.374] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:102:0)
[01:52:01.399] Build status: STARTED
[01:52:01.399] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:103:0) after 6m43s
[01:58:44.425] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:103:0)
[01:58:44.457] Build status: STARTED
[01:58:44.457] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:104:0) after 4m38s
[02:03:22.476] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:104:0)
[02:03:22.512] Build status: STARTED
[02:03:22.512] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:105:0) after 7m11s
[02:10:33.532] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:105:0)
[02:10:33.559] Build status: STARTED
[02:10:33.559] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:106:0) after 8m26s
[02:18:59.578] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:106:0)
[02:18:59.605] Build status: STARTED
[02:18:59.605] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:107:0) after 2m29s
[02:21:28.711] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:107:0)
[02:21:28.743] Build status: STARTED
[02:21:28.743] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:108:0) after 8m40s
[02:30:08.930] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:108:0)
[02:30:09.027] Build status: STARTED
[02:30:09.027] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:109:0) after 5m33s
[02:35:42.054] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:109:0)
[02:35:42.084] Build status: STARTED
[02:35:42.084] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:110:0) after 5m10s
[02:40:52.304] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:110:0)
[02:40:52.330] Build status: STARTED
[02:40:52.330] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:111:0) after 8m0s
[02:48:52.351] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:111:0)
[02:48:52.383] Build status: STARTED
[02:48:52.383] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:112:0) after 5m35s
[02:54:27.470] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:112:0)
[02:54:27.515] Build status: STARTED
[02:54:27.515] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:113:0) after 8m43s
[03:03:10.791] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:113:0)
[03:03:10.818] Build status: STARTED
[03:03:10.818] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:114:0) after 9m39s
[03:12:49.847] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:114:0)
[03:12:49.875] Build status: STARTED
[03:12:49.875] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:115:0) after 9m14s
[03:22:03.909] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:115:0)
[03:22:03.932] Build status: STARTED
[03:22:03.932] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:116:0) after 8m1s
[03:30:05.403] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:116:0)
[03:30:05.470] Build status: STARTED
[03:30:05.470] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:117:0) after 4m48s
[03:34:53.490] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:117:0)
[03:34:53.525] Build status: STARTED
[03:34:53.525] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:118:0) after 7m42s
[03:42:35.548] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:118:0)
[03:42:35.583] Build status: STARTED
[03:42:35.584] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:119:0) after 5m19s
[03:47:54.608] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:119:0)
[03:47:54.635] Build status: STARTED
[03:47:54.635] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:120:0) after 7m50s
[03:55:44.655] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:120:0)
[03:55:44.713] Build status: STARTED
[03:55:44.713] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016927665655412944:121:0) after 8m39s
[03:58:18.593] Received PubSub notification, asking Buildbucket for the build status
[03:58:18.625] Build:
{
"id": "8851497603722670704",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 3610,
"createdBy": "project:chromium",
"createTime": "2021-03-28T17:04:55.806161Z",
"startTime": "2021-03-28T17:05:34.033403Z",
"endTime": "2021-03-29T03:58:17.774833142Z",
"updateTime": "2021-03-29T03:58:17.775141533Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "79228a95cd02abcbcb1f1e914230fab11f6308de",
"ref": "refs/heads/master"
}
}
}
[03:58:18.625] Invocation finished in 10h53m24.046414049s with status FAILED