[01:35:06.361] New invocation is queued and will start shortly
[01:35:07.530] Starting the invocation (attempt 1)
[01:35:07.572] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/71e84a5b2e01f092ae9700d43e91b2a30dd96f66"
[01:35:07.572] Popped gitiles commit info from properties and tags
[01:35:07.572] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:35:07.572] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:35:07.573] Buildbucket request:
{
"requestId": "9012909300370514144",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "71e84a5b2e01f092ae9700d43e91b2a30dd96f66",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9012909300370514144"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:35:08.379] Scheduled build:
{
"id": "8847479238324204432",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 24950,
"createdBy": "project:chromium",
"createTime": "2021-05-12T01:35:07.680022Z",
"updateTime": "2021-05-12T01:35:08.243173Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "71e84a5b2e01f092ae9700d43e91b2a30dd96f66",
"ref": "refs/heads/master"
}
}
}
[01:35:08.379] Task URL: https://cr-buildbucket.appspot.com/build/8847479238324204432
[01:35:08.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:2:0) after 1m10s
[01:36:18.402] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:2:0)
[01:36:18.440] Build status: SCHEDULED
[01:36:18.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:3:0) after 3m23s
[01:36:25.423] Received PubSub notification, asking Buildbucket for the build status
[01:36:25.448] Build status: STARTED
[01:39:41.533] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:3:0)
[01:39:41.564] Build status: STARTED
[01:39:41.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:5:0) after 8m52s
[01:48:33.688] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:5:0)
[01:48:33.719] Build status: STARTED
[01:48:33.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:6:0) after 6m43s
[01:55:16.742] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:6:0)
[01:55:16.770] Build status: STARTED
[01:55:16.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:7:0) after 1m25s
[01:56:41.794] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:7:0)
[01:56:41.820] Build status: STARTED
[01:56:41.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:8:0) after 7m10s
[02:03:52.022] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:8:0)
[02:03:52.048] Build status: STARTED
[02:03:52.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:9:0) after 2m0s
[02:05:52.197] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:9:0)
[02:05:52.230] Build status: STARTED
[02:05:52.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:10:0) after 5m6s
[02:10:58.263] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:10:0)
[02:10:58.305] Build status: STARTED
[02:10:58.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:11:0) after 9m22s
[02:20:20.398] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:11:0)
[02:20:20.426] Build status: STARTED
[02:20:20.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:12:0) after 7m10s
[02:27:30.565] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:12:0)
[02:27:30.603] Build status: STARTED
[02:27:30.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:13:0) after 4m4s
[02:31:34.635] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:13:0)
[02:31:34.663] Build status: STARTED
[02:31:34.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:14:0) after 3m1s
[02:34:35.686] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:14:0)
[02:34:35.727] Build status: STARTED
[02:34:35.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:15:0) after 7m50s
[02:42:25.988] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:15:0)
[02:42:26.107] Build status: STARTED
[02:42:26.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:16:0) after 8m28s
[02:50:54.131] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:16:0)
[02:50:54.155] Build status: STARTED
[02:50:54.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:17:0) after 2m46s
[02:53:40.656] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:17:0)
[02:53:40.706] Build status: STARTED
[02:53:40.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:18:0) after 7m52s
[03:01:32.936] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:18:0)
[03:01:32.968] Build status: STARTED
[03:01:32.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:19:0) after 1m19s
[03:02:52.063] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:19:0)
[03:02:52.096] Build status: STARTED
[03:02:52.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:20:0) after 5m25s
[03:08:17.223] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:20:0)
[03:08:17.292] Build status: STARTED
[03:08:17.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:21:0) after 8m23s
[03:16:40.505] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:21:0)
[03:16:40.546] Build status: STARTED
[03:16:40.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:22:0) after 4m5s
[03:20:45.608] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:22:0)
[03:20:45.643] Build status: STARTED
[03:20:45.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:23:0) after 7m58s
[03:28:43.688] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:23:0)
[03:28:43.718] Build status: STARTED
[03:28:43.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:24:0) after 5m10s
[03:33:53.798] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:24:0)
[03:33:53.834] Build status: STARTED
[03:33:53.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:25:0) after 1m13s
[03:35:06.889] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:25:0)
[03:35:06.916] Build status: STARTED
[03:35:06.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:26:0) after 1m17s
[03:36:24.261] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:26:0)
[03:36:24.292] Build status: STARTED
[03:36:24.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:27:0) after 7m45s
[03:44:09.665] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:27:0)
[03:44:09.692] Build status: STARTED
[03:44:09.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:28:0) after 6m40s
[03:50:49.719] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:28:0)
[03:50:49.750] Build status: STARTED
[03:50:49.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:29:0) after 8m24s
[03:59:13.814] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:29:0)
[03:59:13.852] Build status: STARTED
[03:59:13.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:30:0) after 4m30s
[04:03:43.859] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:30:0)
[04:03:43.892] Build status: STARTED
[04:03:43.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:31:0) after 2m52s
[04:06:36.168] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:31:0)
[04:06:36.199] Build status: STARTED
[04:06:36.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:32:0) after 4m37s
[04:11:13.229] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:32:0)
[04:11:13.261] Build status: STARTED
[04:11:13.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:33:0) after 8m31s
[04:19:44.294] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:33:0)
[04:19:44.324] Build status: STARTED
[04:19:44.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:34:0) after 4m33s
[04:24:17.463] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:34:0)
[04:24:17.493] Build status: STARTED
[04:24:17.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:35:0) after 8m39s
[04:32:56.630] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:35:0)
[04:32:56.657] Build status: STARTED
[04:32:56.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:36:0) after 7m52s
[04:40:48.690] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:36:0)
[04:40:48.755] Build status: STARTED
[04:40:48.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:37:0) after 2m40s
[04:43:28.786] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:37:0)
[04:43:28.812] Build status: STARTED
[04:43:28.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:38:0) after 8m48s
[04:52:16.801] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:38:0)
[04:52:16.835] Build status: STARTED
[04:52:16.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:39:0) after 7m31s
[04:59:48.001] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:39:0)
[04:59:48.031] Build status: STARTED
[04:59:48.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:40:0) after 1m55s
[05:01:43.064] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:40:0)
[05:01:43.107] Build status: STARTED
[05:01:43.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:41:0) after 9m46s
[05:11:29.334] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:41:0)
[05:11:29.364] Build status: STARTED
[05:11:29.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:42:0) after 5m4s
[05:16:33.799] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:42:0)
[05:16:33.831] Build status: STARTED
[05:16:33.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:43:0) after 2m18s
[05:18:51.960] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:43:0)
[05:18:51.996] Build status: STARTED
[05:18:51.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:44:0) after 8m47s
[05:27:39.082] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:44:0)
[05:27:39.143] Build status: STARTED
[05:27:39.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:45:0) after 4m25s
[05:32:04.247] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:45:0)
[05:32:04.279] Build status: STARTED
[05:32:04.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:46:0) after 3m40s
[05:35:44.533] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:46:0)
[05:35:44.570] Build status: STARTED
[05:35:44.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:47:0) after 1m23s
[05:37:07.607] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:47:0)
[05:37:07.643] Build status: STARTED
[05:37:07.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:48:0) after 6m59s
[05:44:06.669] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:48:0)
[05:44:08.001] Build status: STARTED
[05:44:08.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:49:0) after 5m12s
[05:49:20.202] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:49:0)
[05:49:20.307] Build status: STARTED
[05:49:20.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:50:0) after 1m17s
[05:50:37.344] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:50:0)
[05:50:45.963] Build status: STARTED
[05:50:45.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:51:0) after 5m22s
[05:56:07.993] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:51:0)
[05:56:08.022] Build status: STARTED
[05:56:08.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:52:0) after 8m13s
[06:04:21.132] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:52:0)
[06:04:21.174] Build status: STARTED
[06:04:21.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:53:0) after 1m9s
[06:05:30.411] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:53:0)
[06:05:30.449] Build status: STARTED
[06:05:30.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:54:0) after 8m0s
[06:13:30.595] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:54:0)
[06:13:30.622] Build status: STARTED
[06:13:30.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:55:0) after 4m51s
[06:18:21.680] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:55:0)
[06:18:21.711] Build status: STARTED
[06:18:21.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:56:0) after 7m55s
[06:26:16.764] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:56:0)
[06:26:16.803] Build status: STARTED
[06:26:16.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:57:0) after 2m44s
[06:29:00.966] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:57:0)
[06:29:00.994] Build status: STARTED
[06:29:00.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:58:0) after 2m32s
[06:31:33.022] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:58:0)
[06:31:33.124] Build status: STARTED
[06:31:33.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:59:0) after 8m41s
[06:40:14.200] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:59:0)
[06:40:14.231] Build status: STARTED
[06:40:14.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:60:0) after 2m14s
[06:42:28.414] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:60:0)
[06:42:28.438] Build status: STARTED
[06:42:28.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:61:0) after 9m38s
[06:52:06.546] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:61:0)
[06:52:06.576] Build status: STARTED
[06:52:06.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:62:0) after 2m7s
[06:54:13.610] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:62:0)
[06:54:13.654] Build status: STARTED
[06:54:13.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:63:0) after 3m32s
[06:57:45.679] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:63:0)
[06:57:45.727] Build status: STARTED
[06:57:45.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:64:0) after 6m10s
[07:03:55.870] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:64:0)
[07:03:55.918] Build status: STARTED
[07:03:55.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:65:0) after 9m19s
[07:13:14.980] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:65:0)
[07:13:15.014] Build status: STARTED
[07:13:15.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:66:0) after 5m29s
[07:18:44.048] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:66:0)
[07:18:44.076] Build status: STARTED
[07:18:44.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:67:0) after 3m54s
[07:22:38.112] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:67:0)
[07:22:38.151] Build status: STARTED
[07:22:38.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:68:0) after 4m58s
[07:27:36.184] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:68:0)
[07:27:36.221] Build status: STARTED
[07:27:36.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:69:0) after 7m31s
[07:35:07.355] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:69:0)
[07:35:07.387] Build status: STARTED
[07:35:07.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:70:0) after 4m41s
[07:39:48.593] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:70:0)
[07:39:48.624] Build status: STARTED
[07:39:48.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:71:0) after 8m12s
[07:48:00.762] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:71:0)
[07:48:00.805] Build status: STARTED
[07:48:00.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:72:0) after 3m11s
[07:51:12.071] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:72:0)
[07:51:12.100] Build status: STARTED
[07:51:12.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:73:0) after 7m41s
[07:58:53.185] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:73:0)
[07:58:53.255] Build status: STARTED
[07:58:53.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:74:0) after 1m36s
[08:00:29.264] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:74:0)
[08:00:29.294] Build status: STARTED
[08:00:29.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:75:0) after 3m55s
[08:04:24.907] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:75:0)
[08:04:24.935] Build status: STARTED
[08:04:24.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:76:0) after 5m2s
[08:09:27.145] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:76:0)
[08:09:27.186] Build status: STARTED
[08:09:27.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:77:0) after 5m44s
[08:15:11.282] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:77:0)
[08:15:11.310] Build status: STARTED
[08:15:11.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:78:0) after 4m23s
[08:19:34.387] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:78:0)
[08:19:34.455] Build status: STARTED
[08:19:34.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:79:0) after 1m36s
[08:21:10.487] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:79:0)
[08:21:10.521] Build status: STARTED
[08:21:10.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:80:0) after 2m35s
[08:23:45.600] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:80:0)
[08:23:45.633] Build status: STARTED
[08:23:45.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:81:0) after 9m6s
[08:32:51.666] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:81:0)
[08:32:51.693] Build status: STARTED
[08:32:51.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:82:0) after 2m29s
[08:35:20.836] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:82:0)
[08:35:20.893] Build status: STARTED
[08:35:20.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:83:0) after 2m6s
[08:37:26.933] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:83:0)
[08:37:26.960] Build status: STARTED
[08:37:26.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:84:0) after 2m38s
[08:40:05.017] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:84:0)
[08:40:05.054] Build status: STARTED
[08:40:05.054] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:85:0) after 7m11s
[08:47:16.270] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:85:0)
[08:47:16.305] Build status: STARTED
[08:47:16.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:86:0) after 2m47s
[08:50:03.352] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:86:0)
[08:50:03.387] Build status: STARTED
[08:50:03.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:87:0) after 6m21s
[08:56:24.418] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:87:0)
[08:56:24.445] Build status: STARTED
[08:56:24.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:88:0) after 7m25s
[09:03:49.471] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:88:0)
[09:03:49.509] Build status: STARTED
[09:03:49.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:89:0) after 3m45s
[09:07:34.726] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:89:0)
[09:07:34.810] Build status: STARTED
[09:07:34.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:90:0) after 7m12s
[09:14:46.837] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:90:0)
[09:14:46.863] Build status: STARTED
[09:14:46.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:91:0) after 2m11s
[09:16:58.015] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:91:0)
[09:16:58.039] Build status: STARTED
[09:16:58.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:92:0) after 8m5s
[09:25:03.173] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:92:0)
[09:25:03.203] Build status: STARTED
[09:25:03.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:93:0) after 9m27s
[09:34:30.375] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:93:0)
[09:34:30.401] Build status: STARTED
[09:34:30.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:94:0) after 3m24s
[09:37:54.432] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:94:0)
[09:37:54.460] Build status: STARTED
[09:37:54.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:95:0) after 1m29s
[09:39:23.499] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:95:0)
[09:39:23.530] Build status: STARTED
[09:39:23.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:96:0) after 6m50s
[09:46:13.707] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:96:0)
[09:46:13.732] Build status: STARTED
[09:46:13.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:97:0) after 8m44s
[09:54:57.775] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:97:0)
[09:54:57.815] Build status: STARTED
[09:54:57.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:98:0) after 4m52s
[09:59:49.983] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:98:0)
[09:59:50.018] Build status: STARTED
[09:59:50.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:99:0) after 2m32s
[10:02:22.130] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:99:0)
[10:02:22.155] Build status: STARTED
[10:02:22.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:100:0) after 1m5s
[10:03:27.256] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:100:0)
[10:03:27.281] Build status: STARTED
[10:03:27.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:101:0) after 6m22s
[10:09:49.308] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:101:0)
[10:09:49.339] Build status: STARTED
[10:09:49.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:102:0) after 8m52s
[10:18:41.564] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:102:0)
[10:18:41.595] Build status: STARTED
[10:18:41.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:103:0) after 1m46s
[10:20:27.623] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:103:0)
[10:20:27.648] Build status: STARTED
[10:20:27.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:104:0) after 4m11s
[10:24:38.779] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:104:0)
[10:24:38.820] Build status: STARTED
[10:24:38.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:105:0) after 8m48s
[10:33:26.848] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:105:0)
[10:33:26.877] Build status: STARTED
[10:33:26.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:106:0) after 2m1s
[10:35:28.033] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:106:0)
[10:35:28.073] Build status: STARTED
[10:35:28.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:107:0) after 3m1s
[10:38:29.154] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:107:0)
[10:38:29.184] Build status: STARTED
[10:38:29.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:108:0) after 7m21s
[10:45:50.325] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:108:0)
[10:45:50.353] Build status: STARTED
[10:45:50.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:109:0) after 4m58s
[10:50:48.360] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:109:0)
[10:50:48.387] Build status: STARTED
[10:50:48.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:110:0) after 4m5s
[10:54:53.419] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:110:0)
[10:54:53.446] Build status: STARTED
[10:54:53.446] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:111:0) after 8m7s
[11:03:00.487] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:111:0)
[11:03:00.626] Build status: STARTED
[11:03:00.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:112:0) after 5m43s
[11:08:43.654] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:112:0)
[11:08:43.679] Build status: STARTED
[11:08:43.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:113:0) after 2m20s
[11:11:03.750] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:113:0)
[11:11:03.794] Build status: STARTED
[11:11:03.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:114:0) after 1m55s
[11:12:58.785] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:114:0)
[11:12:58.817] Build status: STARTED
[11:12:58.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:115:0) after 1m55s
[11:14:53.886] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:115:0)
[11:14:53.917] Build status: STARTED
[11:14:53.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:116:0) after 1m52s
[11:16:46.006] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:116:0)
[11:16:46.030] Build status: STARTED
[11:16:46.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:117:0) after 5m33s
[11:22:19.131] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:117:0)
[11:22:19.157] Build status: STARTED
[11:22:19.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:118:0) after 6m26s
[11:28:45.185] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:118:0)
[11:28:45.213] Build status: STARTED
[11:28:45.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:119:0) after 8m59s
[11:37:44.351] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:119:0)
[11:37:44.415] Build status: STARTED
[11:37:44.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:120:0) after 2m13s
[11:39:57.609] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:120:0)
[11:39:57.695] Build status: STARTED
[11:39:57.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:121:0) after 1m23s
[11:41:20.764] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:121:0)
[11:41:20.798] Build status: STARTED
[11:41:20.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:122:0) after 5m14s
[11:46:34.950] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:122:0)
[11:46:34.975] Build status: STARTED
[11:46:34.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:123:0) after 3m54s
[11:50:29.032] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:123:0)
[11:50:29.063] Build status: STARTED
[11:50:29.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:124:0) after 2m27s
[11:52:56.171] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:124:0)
[11:52:56.196] Build status: STARTED
[11:52:56.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:125:0) after 7m37s
[12:00:33.300] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:125:0)
[12:00:33.347] Build status: STARTED
[12:00:33.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:126:0) after 9m36s
[12:10:09.700] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:126:0)
[12:10:09.731] Build status: STARTED
[12:10:09.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:127:0) after 7m3s
[12:17:12.771] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:127:0)
[12:17:12.797] Build status: STARTED
[12:17:12.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:128:0) after 3m53s
[12:21:05.873] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:128:0)
[12:21:05.910] Build status: STARTED
[12:21:05.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:129:0) after 5m36s
[12:26:41.952] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:129:0)
[12:26:41.977] Build status: STARTED
[12:26:41.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:130:0) after 8m57s
[12:35:39.025] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:130:0)
[12:35:39.052] Build status: STARTED
[12:35:39.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:131:0) after 4m10s
[12:39:49.395] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:131:0)
[12:39:49.426] Build status: STARTED
[12:39:49.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:132:0) after 8m14s
[12:48:03.522] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:132:0)
[12:48:03.583] Build status: STARTED
[12:48:03.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:133:0) after 2m21s
[12:50:24.611] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:133:0)
[12:50:24.637] Build status: STARTED
[12:50:24.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:134:0) after 5m38s
[12:56:02.726] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:134:0)
[12:56:02.756] Build status: STARTED
[12:56:02.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:135:0) after 2m44s
[12:58:46.892] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:135:0)
[12:58:46.923] Build status: STARTED
[12:58:46.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:136:0) after 7m2s
[13:05:48.995] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:136:0)
[13:05:49.025] Build status: STARTED
[13:05:49.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012909300370514144:137:0) after 5m49s
[13:09:47.208] Received PubSub notification, asking Buildbucket for the build status
[13:09:47.239] Build:
{
"id": "8847479238324204432",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 24950,
"createdBy": "project:chromium",
"createTime": "2021-05-12T01:35:07.680022Z",
"startTime": "2021-05-12T01:36:24.414111Z",
"endTime": "2021-05-12T13:09:46.904966591Z",
"updateTime": "2021-05-12T13:09:46.905916878Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "71e84a5b2e01f092ae9700d43e91b2a30dd96f66",
"ref": "refs/heads/master"
}
}
}
[13:09:47.239] Invocation finished in 11h34m40.893760743s with status FAILED