[03:13:40.312] New invocation is queued and will start shortly
[03:13:41.404] Starting the invocation (attempt 1)
[03:13:41.454] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/fc7602f06138edd14dd564842fa0cbdc318cf154"
[03:13:41.454] Popped gitiles commit info from properties and tags
[03:13:41.454] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:13:41.454] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:13:41.454] Buildbucket request:
{
"requestId": "9015349217236284144",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fc7602f06138edd14dd564842fa0cbdc318cf154",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9015349217236284144"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:13:42.888] Scheduled build:
{
"id": "8849919155213407744",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 24817,
"createdBy": "project:chromium",
"createTime": "2021-04-15T03:13:41.609515Z",
"updateTime": "2021-04-15T03:13:42.668481Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fc7602f06138edd14dd564842fa0cbdc318cf154",
"ref": "refs/heads/master"
}
}
}
[03:13:42.888] Task URL: https://cr-buildbucket.appspot.com/build/8849919155213407744
[03:13:42.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:2:0) after 6m28s
[03:14:39.097] Received PubSub notification, asking Buildbucket for the build status
[03:14:39.125] Build status: STARTED
[03:20:10.915] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:2:0)
[03:20:10.957] Build status: STARTED
[03:20:10.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:4:0) after 5m25s
[03:25:35.980] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:4:0)
[03:25:36.021] Build status: STARTED
[03:25:36.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:5:0) after 6m2s
[03:31:38.043] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:5:0)
[03:31:38.067] Build status: STARTED
[03:31:38.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:6:0) after 8m40s
[03:40:18.203] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:6:0)
[03:40:18.236] Build status: STARTED
[03:40:18.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:7:0) after 4m54s
[03:45:12.320] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:7:0)
[03:45:12.349] Build status: STARTED
[03:45:12.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:8:0) after 1m36s
[03:46:48.380] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:8:0)
[03:46:48.408] Build status: STARTED
[03:46:48.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:9:0) after 5m56s
[03:52:44.466] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:9:0)
[03:52:44.491] Build status: STARTED
[03:52:44.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:10:0) after 5m21s
[03:58:05.656] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:10:0)
[03:58:05.682] Build status: STARTED
[03:58:05.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:11:0) after 6m27s
[04:04:32.759] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:11:0)
[04:04:32.790] Build status: STARTED
[04:04:32.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:12:0) after 2m22s
[04:06:54.915] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:12:0)
[04:06:54.959] Build status: STARTED
[04:06:54.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:13:0) after 4m1s
[04:10:55.993] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:13:0)
[04:10:56.020] Build status: STARTED
[04:10:56.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:14:0) after 2m43s
[04:13:39.058] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:14:0)
[04:13:39.084] Build status: STARTED
[04:13:39.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:15:0) after 2m51s
[04:16:30.183] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:15:0)
[04:16:30.213] Build status: STARTED
[04:16:30.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:16:0) after 2m6s
[04:18:36.263] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:16:0)
[04:18:36.291] Build status: STARTED
[04:18:36.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:17:0) after 2m41s
[04:21:17.459] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:17:0)
[04:21:17.492] Build status: STARTED
[04:21:17.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:18:0) after 1m35s
[04:22:52.562] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:18:0)
[04:22:52.590] Build status: STARTED
[04:22:52.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:19:0) after 5m6s
[04:27:58.843] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:19:0)
[04:27:58.869] Build status: STARTED
[04:27:58.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:20:0) after 9m7s
[04:37:05.899] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:20:0)
[04:37:05.932] Build status: STARTED
[04:37:05.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:21:0) after 8m26s
[04:45:32.042] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:21:0)
[04:45:32.076] Build status: STARTED
[04:45:32.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:22:0) after 8m36s
[04:54:08.293] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:22:0)
[04:54:08.322] Build status: STARTED
[04:54:08.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:23:0) after 8m40s
[05:02:48.350] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:23:0)
[05:02:48.421] Build status: STARTED
[05:02:48.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:24:0) after 2m41s
[05:05:29.601] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:24:0)
[05:05:29.632] Build status: STARTED
[05:05:29.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:25:0) after 4m59s
[05:10:28.811] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:25:0)
[05:10:28.847] Build status: STARTED
[05:10:28.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:26:0) after 5m5s
[05:15:33.965] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:26:0)
[05:15:34.003] Build status: STARTED
[05:15:34.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:27:0) after 4m57s
[05:20:31.171] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:27:0)
[05:20:31.197] Build status: STARTED
[05:20:31.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:28:0) after 8m35s
[05:29:06.261] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:28:0)
[05:29:06.337] Build status: STARTED
[05:29:06.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:29:0) after 6m39s
[05:35:45.431] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:29:0)
[05:35:45.462] Build status: STARTED
[05:35:45.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:30:0) after 3m17s
[05:39:02.486] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:30:0)
[05:39:02.594] Build status: STARTED
[05:39:02.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:31:0) after 9m4s
[05:48:06.635] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:31:0)
[05:48:06.684] Build status: STARTED
[05:48:06.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:32:0) after 4m45s
[05:52:51.713] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:32:0)
[05:52:51.747] Build status: STARTED
[05:52:51.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:33:0) after 2m45s
[05:55:36.822] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:33:0)
[05:55:36.847] Build status: STARTED
[05:55:36.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:34:0) after 8m38s
[06:04:14.962] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:34:0)
[06:04:15.031] Build status: STARTED
[06:04:15.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:35:0) after 9m10s
[06:13:25.092] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:35:0)
[06:13:25.124] Build status: STARTED
[06:13:25.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:36:0) after 7m11s
[06:20:36.184] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:36:0)
[06:20:36.210] Build status: STARTED
[06:20:36.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:37:0) after 9m6s
[06:29:42.341] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:37:0)
[06:29:42.371] Build status: STARTED
[06:29:42.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:38:0) after 7m46s
[06:37:28.397] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:38:0)
[06:37:28.422] Build status: STARTED
[06:37:28.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:39:0) after 9m21s
[06:46:49.576] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:39:0)
[06:46:49.610] Build status: STARTED
[06:46:49.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:40:0) after 6m0s
[06:52:49.704] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:40:0)
[06:52:49.736] Build status: STARTED
[06:52:49.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:41:0) after 1m59s
[06:54:48.986] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:41:0)
[06:54:49.024] Build status: STARTED
[06:54:49.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:42:0) after 1m6s
[06:55:55.199] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:42:0)
[06:55:55.321] Build status: STARTED
[06:55:55.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:43:0) after 2m21s
[06:58:16.350] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:43:0)
[06:58:16.377] Build status: STARTED
[06:58:16.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:44:0) after 2m31s
[07:00:47.417] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:44:0)
[07:00:47.449] Build status: STARTED
[07:00:47.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:45:0) after 6m40s
[07:07:27.584] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:45:0)
[07:07:27.613] Build status: STARTED
[07:07:27.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:46:0) after 7m22s
[07:14:49.648] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:46:0)
[07:14:49.675] Build status: STARTED
[07:14:49.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:47:0) after 4m44s
[07:19:33.700] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:47:0)
[07:19:33.731] Build status: STARTED
[07:19:33.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:48:0) after 4m40s
[07:24:13.889] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:48:0)
[07:24:13.919] Build status: STARTED
[07:24:13.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:49:0) after 6m30s
[07:30:43.958] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:49:0)
[07:30:43.985] Build status: STARTED
[07:30:43.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:50:0) after 5m27s
[07:36:11.026] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:50:0)
[07:36:11.054] Build status: STARTED
[07:36:11.054] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:51:0) after 4m49s
[07:41:00.100] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:51:0)
[07:41:00.147] Build status: STARTED
[07:41:00.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:52:0) after 2m13s
[07:43:13.170] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:52:0)
[07:43:13.202] Build status: STARTED
[07:43:13.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:53:0) after 3m48s
[07:47:01.327] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:53:0)
[07:47:01.355] Build status: STARTED
[07:47:01.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:54:0) after 7m57s
[07:54:58.432] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:54:0)
[07:54:58.462] Build status: STARTED
[07:54:58.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:55:0) after 9m55s
[08:04:53.503] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:55:0)
[08:04:53.533] Build status: STARTED
[08:04:53.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:56:0) after 8m47s
[08:13:40.614] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:56:0)
[08:13:40.691] Build status: STARTED
[08:13:40.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:57:0) after 4m13s
[08:17:53.770] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:57:0)
[08:17:53.798] Build status: STARTED
[08:17:53.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:58:0) after 6m14s
[08:24:07.827] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:58:0)
[08:24:07.864] Build status: STARTED
[08:24:07.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:59:0) after 4m42s
[08:28:49.983] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:59:0)
[08:28:50.007] Build status: STARTED
[08:28:50.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:60:0) after 3m27s
[08:32:17.106] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:60:0)
[08:32:17.131] Build status: STARTED
[08:32:17.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:61:0) after 9m25s
[08:41:42.225] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:61:0)
[08:41:42.258] Build status: STARTED
[08:41:42.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:62:0) after 4m5s
[08:45:47.285] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:62:0)
[08:45:47.312] Build status: STARTED
[08:45:47.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:63:0) after 6m20s
[08:52:07.371] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:63:0)
[08:52:07.396] Build status: STARTED
[08:52:07.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:64:0) after 3m38s
[08:55:45.455] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:64:0)
[08:55:45.487] Build status: STARTED
[08:55:45.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:65:0) after 3m41s
[08:59:26.563] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:65:0)
[08:59:26.600] Build status: STARTED
[08:59:26.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:66:0) after 9m10s
[09:08:36.716] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:66:0)
[09:08:36.746] Build status: STARTED
[09:08:36.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:67:0) after 5m40s
[09:14:16.771] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:67:0)
[09:14:16.798] Build status: STARTED
[09:14:16.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:68:0) after 4m3s
[09:18:19.829] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:68:0)
[09:18:19.857] Build status: STARTED
[09:18:19.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:69:0) after 1m5s
[09:19:24.986] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:69:0)
[09:19:25.035] Build status: STARTED
[09:19:25.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:70:0) after 4m7s
[09:23:32.066] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:70:0)
[09:23:32.092] Build status: STARTED
[09:23:32.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:71:0) after 5m55s
[09:29:27.123] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:71:0)
[09:29:27.152] Build status: STARTED
[09:29:27.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:72:0) after 9m41s
[09:39:08.280] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:72:0)
[09:39:08.315] Build status: STARTED
[09:39:08.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:73:0) after 3m3s
[09:42:11.434] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:73:0)
[09:42:11.458] Build status: STARTED
[09:42:11.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:74:0) after 4m21s
[09:46:33.050] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:74:0)
[09:46:33.083] Build status: STARTED
[09:46:33.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:75:0) after 8m49s
[09:55:22.119] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:75:0)
[09:55:22.146] Build status: STARTED
[09:55:22.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:76:0) after 8m12s
[10:03:34.174] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:76:0)
[10:03:34.202] Build status: STARTED
[10:03:34.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:77:0) after 1m21s
[10:04:55.385] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:77:0)
[10:04:55.413] Build status: STARTED
[10:04:55.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:78:0) after 1m10s
[10:06:05.419] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:78:0)
[10:06:05.460] Build status: STARTED
[10:06:05.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:79:0) after 9m35s
[10:15:40.494] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:79:0)
[10:15:40.547] Build status: STARTED
[10:15:40.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:80:0) after 5m15s
[10:20:55.619] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:80:0)
[10:20:55.710] Build status: STARTED
[10:20:55.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:81:0) after 8m20s
[10:29:15.738] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:81:0)
[10:29:15.765] Build status: STARTED
[10:29:15.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:82:0) after 8m40s
[10:37:55.904] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:82:0)
[10:37:55.933] Build status: STARTED
[10:37:55.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:83:0) after 3m20s
[10:41:15.966] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:83:0)
[10:41:15.995] Build status: STARTED
[10:41:15.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:84:0) after 4m6s
[10:45:22.079] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:84:0)
[10:45:22.169] Build status: STARTED
[10:45:22.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:85:0) after 7m27s
[10:52:49.257] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:85:0)
[10:52:49.285] Build status: STARTED
[10:52:49.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:86:0) after 1m43s
[10:54:32.371] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:86:0)
[10:54:32.398] Build status: STARTED
[10:54:32.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:87:0) after 7m59s
[11:02:31.562] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:87:0)
[11:02:31.594] Build status: STARTED
[11:02:31.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:88:0) after 3m12s
[11:05:43.902] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:88:0)
[11:05:43.935] Build status: STARTED
[11:05:43.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:89:0) after 1m40s
[11:07:24.455] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:89:0)
[11:07:24.481] Build status: STARTED
[11:07:24.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:90:0) after 8m19s
[11:15:43.620] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:90:0)
[11:15:43.649] Build status: STARTED
[11:15:43.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:91:0) after 2m29s
[11:18:12.688] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:91:0)
[11:18:12.730] Build status: STARTED
[11:18:12.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:92:0) after 7m12s
[11:25:24.824] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:92:0)
[11:25:24.853] Build status: STARTED
[11:25:24.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:93:0) after 6m21s
[11:31:45.979] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:93:0)
[11:31:46.013] Build status: STARTED
[11:31:46.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:94:0) after 8m3s
[11:39:49.426] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:94:0)
[11:39:49.467] Build status: STARTED
[11:39:49.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:95:0) after 5m22s
[11:45:11.469] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:95:0)
[11:45:11.496] Build status: STARTED
[11:45:11.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:96:0) after 2m4s
[11:47:15.532] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:96:0)
[11:47:15.564] Build status: STARTED
[11:47:15.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:97:0) after 2m48s
[11:50:03.589] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:97:0)
[11:50:03.616] Build status: STARTED
[11:50:03.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:98:0) after 3m34s
[11:53:37.737] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:98:0)
[11:53:37.766] Build status: STARTED
[11:53:37.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:99:0) after 5m34s
[11:59:11.802] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:99:0)
[11:59:11.831] Build status: STARTED
[11:59:11.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:100:0) after 7m9s
[12:06:20.919] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:100:0)
[12:06:20.951] Build status: STARTED
[12:06:20.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:101:0) after 9m27s
[12:15:48.228] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:101:0)
[12:15:48.267] Build status: STARTED
[12:15:48.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:102:0) after 3m59s
[12:19:47.361] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:102:0)
[12:19:47.392] Build status: STARTED
[12:19:47.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:103:0) after 6m16s
[12:26:03.422] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:103:0)
[12:26:03.448] Build status: STARTED
[12:26:03.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:104:0) after 5m12s
[12:31:15.466] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:104:0)
[12:31:15.492] Build status: STARTED
[12:31:15.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:105:0) after 9m3s
[12:40:18.557] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:105:0)
[12:40:18.585] Build status: STARTED
[12:40:18.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:106:0) after 5m36s
[12:45:54.611] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:106:0)
[12:45:54.641] Build status: STARTED
[12:45:54.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:107:0) after 3m28s
[12:49:22.807] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:107:0)
[12:49:22.833] Build status: STARTED
[12:49:22.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:108:0) after 9m45s
[12:59:07.873] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:108:0)
[12:59:07.901] Build status: STARTED
[12:59:07.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:109:0) after 9m14s
[13:08:22.522] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:109:0)
[13:08:22.596] Build status: STARTED
[13:08:22.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:110:0) after 2m44s
[13:11:06.891] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:110:0)
[13:11:06.933] Build status: STARTED
[13:11:06.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:111:0) after 8m57s
[13:20:04.246] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:111:0)
[13:20:04.317] Build status: STARTED
[13:20:04.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:112:0) after 7m30s
[13:27:34.491] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:112:0)
[13:27:34.538] Build status: STARTED
[13:27:34.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:113:0) after 6m47s
[13:34:22.304] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:113:0)
[13:34:22.345] Build status: STARTED
[13:34:22.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:114:0) after 2m8s
[13:36:30.639] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:114:0)
[13:36:30.664] Build status: STARTED
[13:36:30.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:115:0) after 6m50s
[13:43:20.909] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:115:0)
[13:43:20.934] Build status: STARTED
[13:43:20.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:116:0) after 8m35s
[13:51:55.968] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:116:0)
[13:51:55.999] Build status: STARTED
[13:51:55.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:117:0) after 3m54s
[13:55:50.057] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:117:0)
[13:55:50.089] Build status: STARTED
[13:55:50.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:118:0) after 5m21s
[14:01:11.093] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:118:0)
[14:01:11.122] Build status: STARTED
[14:01:11.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:119:0) after 6m46s
[14:07:57.160] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:119:0)
[14:07:57.186] Build status: STARTED
[14:07:57.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:120:0) after 4m23s
[14:12:20.228] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:120:0)
[14:12:20.253] Build status: STARTED
[14:12:20.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:121:0) after 5m41s
[14:18:01.476] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:121:0)
[14:18:01.499] Build status: STARTED
[14:18:01.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:122:0) after 1m5s
[14:19:06.566] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:122:0)
[14:19:06.631] Build status: STARTED
[14:19:06.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:123:0) after 1m4s
[14:20:10.749] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:123:0)
[14:20:10.796] Build status: STARTED
[14:20:10.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:124:0) after 4m36s
[14:24:47.085] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:124:0)
[14:24:47.111] Build status: STARTED
[14:24:47.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:125:0) after 3m11s
[14:27:58.475] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:125:0)
[14:27:58.506] Build status: STARTED
[14:27:58.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:126:0) after 7m22s
[14:35:20.648] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:126:0)
[14:35:20.696] Build status: STARTED
[14:35:20.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9015349217236284144:127:0) after 7m4s
[14:36:46.533] Received PubSub notification, asking Buildbucket for the build status
[14:36:46.562] Build:
{
"id": "8849919155213407744",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 24817,
"createdBy": "project:chromium",
"createTime": "2021-04-15T03:13:41.609515Z",
"startTime": "2021-04-15T03:14:38.426808Z",
"endTime": "2021-04-15T14:36:45.764133220Z",
"updateTime": "2021-04-15T14:36:45.764563203Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fc7602f06138edd14dd564842fa0cbdc318cf154",
"ref": "refs/heads/master"
}
}
}
[14:36:46.562] Invocation finished in 11h23m6.265816327s with status FAILED