[10:57:38.473] New invocation is queued and will start shortly
[10:57:39.588] Starting the invocation (attempt 1)
[10:57:39.623] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/fde902c534109bcdcf075b1316c591116aae65d7"
[10:57:39.623] Popped gitiles commit info from properties and tags
[10:57:39.623] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:57:39.623] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:57:39.623] Buildbucket request:
{
"requestId": "9017403757041981024",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fde902c534109bcdcf075b1316c591116aae65d7",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9017403757041981024"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:57:40.263] Scheduled build:
{
"id": "8851973694985141600",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 24663,
"createdBy": "project:chromium",
"createTime": "2021-03-23T10:57:39.796251Z",
"updateTime": "2021-03-23T10:57:40.191457Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fde902c534109bcdcf075b1316c591116aae65d7",
"ref": "refs/heads/master"
}
}
}
[10:57:40.264] Task URL: https://cr-buildbucket.appspot.com/build/8851973694985141600
[10:57:40.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:2:0) after 2m47s
[10:57:42.504] Received PubSub notification, asking Buildbucket for the build status
[10:57:42.531] Build status: STARTED
[11:00:27.296] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:2:0)
[11:00:27.337] Build status: STARTED
[11:00:27.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:4:0) after 1m7s
[11:01:34.360] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:4:0)
[11:01:34.393] Build status: STARTED
[11:01:34.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:5:0) after 1m29s
[11:03:03.469] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:5:0)
[11:03:03.496] Build status: STARTED
[11:03:03.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:6:0) after 1m59s
[11:05:02.528] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:6:0)
[11:05:02.557] Build status: STARTED
[11:05:02.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:7:0) after 6m25s
[11:11:27.578] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:7:0)
[11:11:27.605] Build status: STARTED
[11:11:27.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:8:0) after 3m52s
[11:15:19.639] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:8:0)
[11:15:19.827] Build status: STARTED
[11:15:19.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:9:0) after 5m37s
[11:20:56.847] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:9:0)
[11:20:56.875] Build status: STARTED
[11:20:56.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:10:0) after 2m31s
[11:23:27.895] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:10:0)
[11:23:27.935] Build status: STARTED
[11:23:27.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:11:0) after 4m58s
[11:28:25.956] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:11:0)
[11:28:25.981] Build status: STARTED
[11:28:25.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:12:0) after 3m1s
[11:31:27.012] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:12:0)
[11:31:27.039] Build status: STARTED
[11:31:27.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:13:0) after 9m23s
[11:40:50.064] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:13:0)
[11:40:50.092] Build status: STARTED
[11:40:50.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:14:0) after 3m35s
[11:44:25.318] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:14:0)
[11:44:25.346] Build status: STARTED
[11:44:25.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:15:0) after 3m14s
[11:47:39.377] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:15:0)
[11:47:39.413] Build status: STARTED
[11:47:39.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:16:0) after 4m13s
[11:51:52.511] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:16:0)
[11:51:52.540] Build status: STARTED
[11:51:52.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:17:0) after 8m0s
[11:59:52.585] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:17:0)
[11:59:52.612] Build status: STARTED
[11:59:52.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:18:0) after 4m8s
[12:04:00.711] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:18:0)
[12:04:00.733] Build status: STARTED
[12:04:00.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:19:0) after 1m31s
[12:05:31.799] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:19:0)
[12:05:31.828] Build status: STARTED
[12:05:31.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:20:0) after 6m38s
[12:12:09.853] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:20:0)
[12:12:09.877] Build status: STARTED
[12:12:09.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:21:0) after 2m8s
[12:14:17.952] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:21:0)
[12:14:17.989] Build status: STARTED
[12:14:17.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:22:0) after 1m59s
[12:16:17.274] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:22:0)
[12:16:17.303] Build status: STARTED
[12:16:17.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:23:0) after 5m3s
[12:21:20.426] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:23:0)
[12:21:20.453] Build status: STARTED
[12:21:20.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:24:0) after 7m33s
[12:28:53.477] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:24:0)
[12:28:53.502] Build status: STARTED
[12:28:53.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:25:0) after 9m30s
[12:38:23.680] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:25:0)
[12:38:23.708] Build status: STARTED
[12:38:23.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:26:0) after 4m28s
[12:42:51.731] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:26:0)
[12:42:51.759] Build status: STARTED
[12:42:51.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:27:0) after 5m6s
[12:47:57.924] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:27:0)
[12:47:57.950] Build status: STARTED
[12:47:57.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:28:0) after 2m32s
[12:50:30.074] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:28:0)
[12:50:30.099] Build status: STARTED
[12:50:30.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:29:0) after 1m42s
[12:52:12.157] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:29:0)
[12:52:12.185] Build status: STARTED
[12:52:12.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:30:0) after 6m59s
[12:59:11.443] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:30:0)
[12:59:11.467] Build status: STARTED
[12:59:11.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:31:0) after 7m3s
[13:06:14.711] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:31:0)
[13:06:14.737] Build status: STARTED
[13:06:14.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:32:0) after 1m51s
[13:08:05.759] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:32:0)
[13:08:05.792] Build status: STARTED
[13:08:05.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:33:0) after 2m2s
[13:10:07.860] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:33:0)
[13:10:07.886] Build status: STARTED
[13:10:07.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:34:0) after 2m30s
[13:12:37.990] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:34:0)
[13:12:38.032] Build status: STARTED
[13:12:38.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:35:0) after 3m38s
[13:16:16.065] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:35:0)
[13:16:16.089] Build status: STARTED
[13:16:16.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:36:0) after 5m31s
[13:21:47.292] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:36:0)
[13:21:47.333] Build status: STARTED
[13:21:47.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:37:0) after 3m35s
[13:25:22.411] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:37:0)
[13:25:22.437] Build status: STARTED
[13:25:22.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:38:0) after 5m28s
[13:30:50.469] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:38:0)
[13:30:50.499] Build status: STARTED
[13:30:50.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:39:0) after 2m18s
[13:33:08.526] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:39:0)
[13:33:08.588] Build status: STARTED
[13:33:08.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:40:0) after 5m1s
[13:38:09.883] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:40:0)
[13:38:09.919] Build status: STARTED
[13:38:09.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:41:0) after 6m33s
[13:44:42.945] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:41:0)
[13:44:42.972] Build status: STARTED
[13:44:42.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:42:0) after 2m12s
[13:46:54.993] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:42:0)
[13:46:55.039] Build status: STARTED
[13:46:55.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:43:0) after 7m42s
[13:54:37.061] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:43:0)
[13:54:37.094] Build status: STARTED
[13:54:37.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:44:0) after 4m55s
[13:59:32.195] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:44:0)
[13:59:32.223] Build status: STARTED
[13:59:32.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:45:0) after 5m37s
[14:05:09.263] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:45:0)
[14:05:09.296] Build status: STARTED
[14:05:09.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:46:0) after 5m23s
[14:10:32.320] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:46:0)
[14:10:32.345] Build status: STARTED
[14:10:32.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:47:0) after 9m49s
[14:20:21.440] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:47:0)
[14:20:21.467] Build status: STARTED
[14:20:21.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:48:0) after 2m26s
[14:22:47.500] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:48:0)
[14:22:47.531] Build status: STARTED
[14:22:47.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:49:0) after 2m4s
[14:24:51.581] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:49:0)
[14:24:51.623] Build status: STARTED
[14:24:51.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:50:0) after 2m23s
[14:27:14.671] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:50:0)
[14:27:14.719] Build status: STARTED
[14:27:14.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:51:0) after 9m41s
[14:36:55.752] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:51:0)
[14:36:55.783] Build status: STARTED
[14:36:55.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:52:0) after 5m35s
[14:42:30.833] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:52:0)
[14:42:30.859] Build status: STARTED
[14:42:30.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:53:0) after 5m0s
[14:47:31.024] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:53:0)
[14:47:31.055] Build status: STARTED
[14:47:31.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:54:0) after 4m20s
[14:51:51.110] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:54:0)
[14:51:51.207] Build status: STARTED
[14:51:51.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:55:0) after 5m28s
[14:57:19.472] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:55:0)
[14:57:19.503] Build status: STARTED
[14:57:19.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:56:0) after 2m16s
[14:59:35.625] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:56:0)
[14:59:35.659] Build status: STARTED
[14:59:35.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:57:0) after 1m33s
[15:01:08.811] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:57:0)
[15:01:08.844] Build status: STARTED
[15:01:08.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:58:0) after 6m17s
[15:07:25.970] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:58:0)
[15:07:25.998] Build status: STARTED
[15:07:25.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:59:0) after 4m40s
[15:12:06.239] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:59:0)
[15:12:06.264] Build status: STARTED
[15:12:06.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:60:0) after 2m1s
[15:14:07.387] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:60:0)
[15:14:07.419] Build status: STARTED
[15:14:07.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:61:0) after 6m9s
[15:20:16.415] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:61:0)
[15:20:16.459] Build status: STARTED
[15:20:16.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:62:0) after 4m11s
[15:24:27.695] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:62:0)
[15:24:27.729] Build status: STARTED
[15:24:27.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:63:0) after 2m21s
[15:26:48.835] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:63:0)
[15:26:48.880] Build status: STARTED
[15:26:48.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:64:0) after 3m37s
[15:30:26.204] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:64:0)
[15:30:26.232] Build status: STARTED
[15:30:26.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:65:0) after 2m14s
[15:32:40.256] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:65:0)
[15:32:40.286] Build status: STARTED
[15:32:40.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:66:0) after 4m8s
[15:36:48.600] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:66:0)
[15:36:48.626] Build status: STARTED
[15:36:48.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:67:0) after 8m50s
[15:45:38.651] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:67:0)
[15:45:38.681] Build status: STARTED
[15:45:38.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:68:0) after 9m51s
[15:55:29.789] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:68:0)
[15:55:29.818] Build status: STARTED
[15:55:29.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:69:0) after 9m25s
[16:04:54.927] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:69:0)
[16:04:54.954] Build status: STARTED
[16:04:54.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:70:0) after 7m44s
[16:12:39.090] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:70:0)
[16:12:39.120] Build status: STARTED
[16:12:39.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:71:0) after 8m25s
[16:21:04.267] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:71:0)
[16:21:04.309] Build status: STARTED
[16:21:04.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:72:0) after 6m59s
[16:28:03.486] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:72:0)
[16:28:03.518] Build status: STARTED
[16:28:03.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:73:0) after 8m42s
[16:36:45.632] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:73:0)
[16:36:45.662] Build status: STARTED
[16:36:45.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:74:0) after 1m10s
[16:37:55.701] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:74:0)
[16:37:55.737] Build status: STARTED
[16:37:55.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:75:0) after 7m25s
[16:45:20.791] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:75:0)
[16:45:20.828] Build status: STARTED
[16:45:20.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:76:0) after 4m22s
[16:49:42.851] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:76:0)
[16:49:42.877] Build status: STARTED
[16:49:42.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:77:0) after 5m12s
[16:54:54.900] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:77:0)
[16:54:54.930] Build status: STARTED
[16:54:54.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:78:0) after 5m43s
[17:00:38.105] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:78:0)
[17:00:38.135] Build status: STARTED
[17:00:38.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:79:0) after 8m45s
[17:09:23.157] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:79:0)
[17:09:23.186] Build status: STARTED
[17:09:23.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:80:0) after 1m32s
[17:10:55.521] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:80:0)
[17:10:55.551] Build status: STARTED
[17:10:55.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:81:0) after 4m22s
[17:15:17.859] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:81:0)
[17:15:17.888] Build status: STARTED
[17:15:17.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:82:0) after 6m21s
[17:21:39.076] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:82:0)
[17:21:39.119] Build status: STARTED
[17:21:39.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:83:0) after 9m59s
[17:31:38.146] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:83:0)
[17:31:38.217] Build status: STARTED
[17:31:38.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:84:0) after 6m46s
[17:38:24.285] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:84:0)
[17:38:24.328] Build status: STARTED
[17:38:24.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:85:0) after 2m40s
[17:41:04.353] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:85:0)
[17:41:04.383] Build status: STARTED
[17:41:04.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:86:0) after 1m9s
[17:42:13.790] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:86:0)
[17:42:13.817] Build status: STARTED
[17:42:13.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:87:0) after 8m17s
[17:50:31.526] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:87:0)
[17:50:31.565] Build status: STARTED
[17:50:31.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:88:0) after 2m22s
[17:52:53.608] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:88:0)
[17:52:53.637] Build status: STARTED
[17:52:53.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:89:0) after 4m54s
[17:57:47.663] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:89:0)
[17:57:47.692] Build status: STARTED
[17:57:47.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:90:0) after 1m53s
[17:59:40.724] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:90:0)
[17:59:40.752] Build status: STARTED
[17:59:40.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:91:0) after 8m35s
[18:08:15.783] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:91:0)
[18:08:15.836] Build status: STARTED
[18:08:15.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:92:0) after 6m43s
[18:14:58.886] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:92:0)
[18:14:58.921] Build status: STARTED
[18:14:58.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:93:0) after 6m6s
[18:21:05.097] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:93:0)
[18:21:05.133] Build status: STARTED
[18:21:05.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:94:0) after 2m35s
[18:23:40.312] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:94:0)
[18:23:40.348] Build status: STARTED
[18:23:40.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:95:0) after 6m15s
[18:29:55.353] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:95:0)
[18:29:55.383] Build status: STARTED
[18:29:55.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:96:0) after 3m9s
[18:33:04.463] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:96:0)
[18:33:04.492] Build status: STARTED
[18:33:04.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:97:0) after 4m43s
[18:37:47.639] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:97:0)
[18:37:47.669] Build status: STARTED
[18:37:47.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:98:0) after 7m10s
[18:44:57.668] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:98:0)
[18:44:57.693] Build status: STARTED
[18:44:57.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:99:0) after 1m29s
[18:46:26.716] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:99:0)
[18:46:26.746] Build status: STARTED
[18:46:26.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:100:0) after 6m54s
[18:53:20.969] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:100:0)
[18:53:20.993] Build status: STARTED
[18:53:20.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:101:0) after 2m18s
[18:55:39.022] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:101:0)
[18:55:39.059] Build status: STARTED
[18:55:39.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:102:0) after 2m17s
[18:57:56.198] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:102:0)
[18:57:56.229] Build status: STARTED
[18:57:56.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:103:0) after 1m28s
[18:59:24.373] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:103:0)
[18:59:24.400] Build status: STARTED
[18:59:24.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:104:0) after 5m47s
[19:05:11.619] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:104:0)
[19:05:11.654] Build status: STARTED
[19:05:11.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:105:0) after 3m26s
[19:08:37.807] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:105:0)
[19:08:37.841] Build status: STARTED
[19:08:37.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:106:0) after 1m9s
[19:09:47.086] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:106:0)
[19:09:47.131] Build status: STARTED
[19:09:47.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:107:0) after 8m53s
[19:18:40.320] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:107:0)
[19:18:40.348] Build status: STARTED
[19:18:40.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:108:0) after 2m33s
[19:21:13.373] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:108:0)
[19:21:13.412] Build status: STARTED
[19:21:13.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:109:0) after 6m54s
[19:28:07.666] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:109:0)
[19:28:07.693] Build status: STARTED
[19:28:07.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:110:0) after 3m52s
[19:31:59.928] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:110:0)
[19:31:59.955] Build status: STARTED
[19:31:59.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:111:0) after 1m47s
[19:33:46.988] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:111:0)
[19:33:47.016] Build status: STARTED
[19:33:47.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:112:0) after 9m8s
[19:42:55.159] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:112:0)
[19:42:55.204] Build status: STARTED
[19:42:55.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:113:0) after 7m8s
[19:50:03.275] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:113:0)
[19:50:03.311] Build status: STARTED
[19:50:03.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:114:0) after 6m10s
[19:56:13.528] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:114:0)
[19:56:13.572] Build status: STARTED
[19:56:13.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:115:0) after 6m11s
[20:02:24.628] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:115:0)
[20:02:24.660] Build status: STARTED
[20:02:24.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:116:0) after 4m48s
[20:07:12.709] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:116:0)
[20:07:12.736] Build status: STARTED
[20:07:12.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:117:0) after 6m6s
[20:13:18.826] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:117:0)
[20:13:18.855] Build status: STARTED
[20:13:18.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:118:0) after 2m54s
[20:16:12.923] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:118:0)
[20:16:12.958] Build status: STARTED
[20:16:12.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:119:0) after 9m9s
[20:25:21.997] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:119:0)
[20:25:22.030] Build status: STARTED
[20:25:22.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:120:0) after 4m26s
[20:29:48.108] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:120:0)
[20:29:48.135] Build status: STARTED
[20:29:48.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:121:0) after 2m6s
[20:31:54.260] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:121:0)
[20:31:54.327] Build status: STARTED
[20:31:54.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:122:0) after 4m36s
[20:36:30.405] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:122:0)
[20:36:30.453] Build status: STARTED
[20:36:30.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:123:0) after 5m20s
[20:41:50.646] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:123:0)
[20:41:50.677] Build status: STARTED
[20:41:50.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:124:0) after 6m32s
[20:48:22.922] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:124:0)
[20:48:22.952] Build status: STARTED
[20:48:22.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:125:0) after 3m18s
[20:51:41.132] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:125:0)
[20:51:41.159] Build status: STARTED
[20:51:41.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:126:0) after 7m5s
[20:58:46.247] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:126:0)
[20:58:46.294] Build status: STARTED
[20:58:46.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:127:0) after 1m19s
[21:00:05.514] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:127:0)
[21:00:05.584] Build status: STARTED
[21:00:05.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:128:0) after 5m44s
[21:05:49.685] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:128:0)
[21:05:49.743] Build status: STARTED
[21:05:49.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:129:0) after 8m49s
[21:14:38.769] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:129:0)
[21:14:38.801] Build status: STARTED
[21:14:38.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:130:0) after 9m0s
[21:23:38.831] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:130:0)
[21:23:38.857] Build status: STARTED
[21:23:38.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:131:0) after 9m49s
[21:33:28.326] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:131:0)
[21:33:28.399] Build status: STARTED
[21:33:28.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:132:0) after 5m36s
[21:39:04.788] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:132:0)
[21:39:04.814] Build status: STARTED
[21:39:04.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:133:0) after 1m52s
[21:40:56.850] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:133:0)
[21:40:57.082] Build status: STARTED
[21:40:57.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:134:0) after 9m2s
[21:49:59.106] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:134:0)
[21:49:59.143] Build status: STARTED
[21:49:59.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:135:0) after 1m31s
[21:51:30.210] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:135:0)
[21:51:30.246] Build status: STARTED
[21:51:30.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:136:0) after 3m44s
[21:55:14.371] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:136:0)
[21:55:14.407] Build status: STARTED
[21:55:14.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:137:0) after 5m7s
[22:00:21.672] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:137:0)
[22:00:21.700] Build status: STARTED
[22:00:21.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:138:0) after 4m31s
[22:04:52.742] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:138:0)
[22:04:52.775] Build status: STARTED
[22:04:52.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:139:0) after 3m8s
[22:08:00.985] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:139:0)
[22:08:01.016] Build status: STARTED
[22:08:01.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:140:0) after 1m15s
[22:09:16.047] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:140:0)
[22:09:16.092] Build status: STARTED
[22:09:16.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:141:0) after 1m20s
[22:10:36.181] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:141:0)
[22:10:36.219] Build status: STARTED
[22:10:36.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:142:0) after 4m40s
[22:15:16.264] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:142:0)
[22:15:16.298] Build status: STARTED
[22:15:16.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9017403757041981024:143:0) after 5m40s
[22:16:19.496] Received PubSub notification, asking Buildbucket for the build status
[22:16:19.524] Build:
{
"id": "8851973694985141600",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 24663,
"createdBy": "project:chromium",
"createTime": "2021-03-23T10:57:39.796251Z",
"startTime": "2021-03-23T10:57:42.018717Z",
"endTime": "2021-03-23T22:16:19.041144088Z",
"updateTime": "2021-03-23T22:16:19.042379046Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fde902c534109bcdcf075b1316c591116aae65d7",
"ref": "refs/heads/master"
}
}
}
[22:16:19.524] Invocation finished in 11h18m41.072982624s with status FAILED