[06:29:48.721] New invocation is queued and will start shortly
[06:29:49.951] Starting the invocation (attempt 1)
[06:29:49.991] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f242fb96b8d53df46a7c79ce30beb1af35945a04"
[06:29:49.991] Popped gitiles commit info from properties and tags
[06:29:49.991] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[06:29:49.991] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[06:29:49.991] Buildbucket request:
{
"requestId": "8994227784003246624",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f242fb96b8d53df46a7c79ce30beb1af35945a04",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8994227784003246624"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[06:29:50.563] Scheduled build:
{
"id": "8828797721890919649",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26334,
"createdBy": "project:chromium",
"createTime": "2021-12-04T06:29:50.094269476Z",
"updateTime": "2021-12-04T06:29:50.094269476Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f242fb96b8d53df46a7c79ce30beb1af35945a04",
"ref": "refs/heads/main"
}
},
"canary": true
}
[06:29:50.563] Task URL: https://cr-buildbucket.appspot.com/build/8828797721890919649
[06:29:50.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:2:0) after 1m50s
[06:31:40.664] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:2:0)
[06:31:40.697] Build status: SCHEDULED
[06:31:40.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:3:0) after 8m11s
[06:39:51.721] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:3:0)
[06:39:51.803] Build status: SCHEDULED
[06:39:51.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:4:0) after 2m34s
[06:42:25.837] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:4:0)
[06:42:25.890] Build status: SCHEDULED
[06:42:25.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:5:0) after 7m57s
[06:50:22.917] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:5:0)
[06:50:22.980] Build status: SCHEDULED
[06:50:22.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:6:0) after 6m2s
[06:56:09.318] Received PubSub notification, asking Buildbucket for the build status
[06:56:09.349] Build status: STARTED
[06:56:26.595] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:6:0)
[06:56:26.626] Build status: STARTED
[06:56:26.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:8:0) after 9m18s
[07:05:44.661] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:8:0)
[07:05:44.692] Build status: STARTED
[07:05:44.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:9:0) after 5m2s
[07:10:46.720] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:9:0)
[07:10:46.772] Build status: STARTED
[07:10:46.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:10:0) after 2m48s
[07:13:34.807] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:10:0)
[07:13:34.841] Build status: STARTED
[07:13:34.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:11:0) after 9m2s
[07:22:36.944] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:11:0)
[07:22:36.973] Build status: STARTED
[07:22:36.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:12:0) after 4m8s
[07:26:45.077] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:12:0)
[07:26:45.114] Build status: STARTED
[07:26:45.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:13:0) after 3m33s
[07:30:18.139] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:13:0)
[07:30:18.167] Build status: STARTED
[07:30:18.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:14:0) after 4m10s
[07:34:28.189] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:14:0)
[07:34:28.269] Build status: STARTED
[07:34:28.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:15:0) after 2m54s
[07:37:22.294] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:15:0)
[07:37:22.323] Build status: STARTED
[07:37:22.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:16:0) after 4m4s
[07:41:26.430] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:16:0)
[07:41:26.498] Build status: STARTED
[07:41:26.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:17:0) after 7m37s
[07:49:03.535] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:17:0)
[07:49:03.563] Build status: STARTED
[07:49:03.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:18:0) after 1m36s
[07:50:39.551] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:18:0)
[07:50:39.581] Build status: STARTED
[07:50:39.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:19:0) after 4m4s
[07:54:43.840] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:19:0)
[07:54:43.879] Build status: STARTED
[07:54:43.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:20:0) after 9m58s
[08:04:42.062] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:20:0)
[08:04:42.157] Build status: STARTED
[08:04:42.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:21:0) after 1m47s
[08:06:29.184] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:21:0)
[08:06:29.213] Build status: STARTED
[08:06:29.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:22:0) after 6m14s
[08:12:43.252] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:22:0)
[08:12:43.288] Build status: STARTED
[08:12:43.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:23:0) after 4m24s
[08:17:07.329] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:23:0)
[08:17:07.398] Build status: STARTED
[08:17:07.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:24:0) after 7m47s
[08:24:54.454] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:24:0)
[08:24:54.486] Build status: STARTED
[08:24:54.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:25:0) after 5m0s
[08:29:54.509] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:25:0)
[08:29:54.544] Build status: STARTED
[08:29:54.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:26:0) after 3m21s
[08:33:15.813] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:26:0)
[08:33:15.845] Build status: STARTED
[08:33:15.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:27:0) after 8m46s
[08:42:01.977] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:27:0)
[08:42:02.027] Build status: STARTED
[08:42:02.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:28:0) after 6m1s
[08:48:03.061] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:28:0)
[08:48:03.100] Build status: STARTED
[08:48:03.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:29:0) after 1m18s
[08:49:21.140] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:29:0)
[08:49:21.183] Build status: STARTED
[08:49:21.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:30:0) after 3m58s
[08:53:19.311] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:30:0)
[08:53:19.349] Build status: STARTED
[08:53:19.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:31:0) after 5m12s
[08:58:31.385] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:31:0)
[08:58:31.413] Build status: STARTED
[08:58:31.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:32:0) after 8m57s
[09:07:28.439] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:32:0)
[09:07:28.487] Build status: STARTED
[09:07:28.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:33:0) after 4m24s
[09:11:52.560] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:33:0)
[09:11:52.593] Build status: STARTED
[09:11:52.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:34:0) after 8m29s
[09:20:21.727] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:34:0)
[09:20:21.763] Build status: STARTED
[09:20:21.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:35:0) after 3m17s
[09:23:38.797] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:35:0)
[09:23:38.826] Build status: STARTED
[09:23:38.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:36:0) after 5m9s
[09:28:48.203] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:36:0)
[09:28:48.242] Build status: STARTED
[09:28:48.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:37:0) after 3m31s
[09:32:20.187] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:37:0)
[09:32:20.217] Build status: STARTED
[09:32:20.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:38:0) after 2m40s
[09:35:00.402] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:38:0)
[09:35:00.466] Build status: STARTED
[09:35:00.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:39:0) after 9m20s
[09:44:20.491] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:39:0)
[09:44:20.619] Build status: STARTED
[09:44:20.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:40:0) after 6m58s
[09:51:18.970] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:40:0)
[09:51:19.002] Build status: STARTED
[09:51:19.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:41:0) after 2m26s
[09:53:45.378] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:41:0)
[09:53:45.441] Build status: STARTED
[09:53:45.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:42:0) after 6m12s
[09:59:57.604] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:42:0)
[09:59:57.637] Build status: STARTED
[09:59:57.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:43:0) after 2m41s
[10:02:39.445] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:43:0)
[10:02:39.478] Build status: STARTED
[10:02:39.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:44:0) after 4m30s
[10:07:09.661] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:44:0)
[10:07:09.695] Build status: STARTED
[10:07:09.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:45:0) after 6m55s
[10:14:04.746] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:45:0)
[10:14:04.793] Build status: STARTED
[10:14:04.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:46:0) after 8m28s
[10:22:32.823] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:46:0)
[10:22:32.859] Build status: STARTED
[10:22:32.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:47:0) after 9m9s
[10:31:41.887] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:47:0)
[10:31:41.924] Build status: STARTED
[10:31:41.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:48:0) after 8m29s
[10:40:11.384] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:48:0)
[10:40:11.420] Build status: STARTED
[10:40:11.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:49:0) after 4m16s
[10:44:27.450] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:49:0)
[10:44:27.493] Build status: STARTED
[10:44:27.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:50:0) after 7m26s
[10:51:53.868] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:50:0)
[10:51:53.906] Build status: STARTED
[10:51:53.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:51:0) after 3m50s
[10:55:43.932] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:51:0)
[10:55:43.968] Build status: STARTED
[10:55:43.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:52:0) after 3m30s
[10:59:13.985] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:52:0)
[10:59:14.022] Build status: STARTED
[10:59:14.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:53:0) after 2m50s
[11:02:04.317] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:53:0)
[11:02:04.355] Build status: STARTED
[11:02:04.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:54:0) after 5m2s
[11:07:06.450] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:54:0)
[11:07:06.482] Build status: STARTED
[11:07:06.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:55:0) after 4m13s
[11:11:20.473] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:55:0)
[11:11:20.511] Build status: STARTED
[11:11:20.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:56:0) after 5m1s
[11:16:21.540] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:56:0)
[11:16:21.573] Build status: STARTED
[11:16:21.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:57:0) after 3m45s
[11:20:06.713] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:57:0)
[11:20:06.743] Build status: STARTED
[11:20:06.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:58:0) after 4m8s
[11:24:15.677] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:58:0)
[11:24:15.732] Build status: STARTED
[11:24:15.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:59:0) after 4m37s
[11:28:52.763] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:59:0)
[11:28:52.793] Build status: STARTED
[11:28:52.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:60:0) after 8m31s
[11:37:23.819] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:60:0)
[11:37:23.853] Build status: STARTED
[11:37:23.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:61:0) after 6m20s
[11:43:44.581] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:61:0)
[11:43:44.613] Build status: STARTED
[11:43:44.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:62:0) after 6m42s
[11:50:26.698] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:62:0)
[11:50:26.765] Build status: STARTED
[11:50:26.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:63:0) after 5m28s
[11:55:55.385] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:63:0)
[11:55:55.411] Build status: STARTED
[11:55:55.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:64:0) after 4m57s
[12:00:52.416] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:64:0)
[12:00:52.470] Build status: STARTED
[12:00:52.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:65:0) after 4m10s
[12:05:02.526] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:65:0)
[12:05:02.601] Build status: STARTED
[12:05:02.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:66:0) after 3m52s
[12:08:54.632] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:66:0)
[12:08:54.663] Build status: STARTED
[12:08:54.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:67:0) after 3m58s
[12:12:53.351] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:67:0)
[12:12:53.397] Build status: STARTED
[12:12:53.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:68:0) after 1m8s
[12:14:01.459] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:68:0)
[12:14:01.493] Build status: STARTED
[12:14:01.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:69:0) after 6m46s
[12:20:48.033] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:69:0)
[12:20:48.063] Build status: STARTED
[12:20:48.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:70:0) after 4m52s
[12:25:40.091] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:70:0)
[12:25:40.353] Build status: STARTED
[12:25:40.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:71:0) after 6m1s
[12:31:41.965] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:71:0)
[12:31:41.997] Build status: STARTED
[12:31:41.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:72:0) after 4m16s
[12:35:58.019] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:72:0)
[12:35:58.048] Build status: STARTED
[12:35:58.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:73:0) after 8m59s
[12:44:57.092] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:73:0)
[12:44:57.135] Build status: STARTED
[12:44:57.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:74:0) after 1m24s
[12:46:21.179] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:74:0)
[12:46:21.218] Build status: STARTED
[12:46:21.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:75:0) after 1m48s
[12:48:09.248] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:75:0)
[12:48:09.301] Build status: STARTED
[12:48:09.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:76:0) after 5m42s
[12:53:51.370] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:76:0)
[12:53:51.443] Build status: STARTED
[12:53:51.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:77:0) after 3m38s
[12:57:29.473] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:77:0)
[12:57:29.504] Build status: STARTED
[12:57:29.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:78:0) after 1m59s
[12:59:28.878] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:78:0)
[12:59:28.913] Build status: STARTED
[12:59:28.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:79:0) after 6m41s
[13:06:10.009] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:79:0)
[13:06:10.041] Build status: STARTED
[13:06:10.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:80:0) after 6m21s
[13:12:31.066] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:80:0)
[13:12:31.096] Build status: STARTED
[13:12:31.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:81:0) after 3m15s
[13:15:46.142] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:81:0)
[13:15:46.191] Build status: STARTED
[13:15:46.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:82:0) after 5m32s
[13:21:18.222] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:82:0)
[13:21:18.252] Build status: STARTED
[13:21:18.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:83:0) after 9m21s
[13:30:39.278] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:83:0)
[13:30:39.342] Build status: STARTED
[13:30:39.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:84:0) after 9m24s
[13:40:03.496] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:84:0)
[13:40:03.527] Build status: STARTED
[13:40:03.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:85:0) after 5m48s
[13:45:51.576] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:85:0)
[13:45:51.673] Build status: STARTED
[13:45:51.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:86:0) after 1m18s
[13:47:09.907] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:86:0)
[13:47:09.936] Build status: STARTED
[13:47:09.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:87:0) after 8m36s
[13:55:46.291] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:87:0)
[13:55:46.343] Build status: STARTED
[13:55:46.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:88:0) after 9m58s
[14:05:44.389] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:88:0)
[14:05:44.425] Build status: STARTED
[14:05:44.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:89:0) after 1m47s
[14:07:31.712] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:89:0)
[14:07:31.768] Build status: STARTED
[14:07:31.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:90:0) after 3m37s
[14:11:08.895] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:90:0)
[14:11:08.928] Build status: STARTED
[14:11:08.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:91:0) after 9m48s
[14:20:56.978] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:91:0)
[14:20:57.015] Build status: STARTED
[14:20:57.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:92:0) after 2m23s
[14:23:20.044] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:92:0)
[14:23:20.073] Build status: STARTED
[14:23:20.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:93:0) after 1m26s
[14:24:46.153] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:93:0)
[14:24:46.198] Build status: STARTED
[14:24:46.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:94:0) after 7m48s
[14:32:34.288] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:94:0)
[14:32:34.332] Build status: STARTED
[14:32:34.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:95:0) after 3m28s
[14:36:02.463] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:95:0)
[14:36:02.494] Build status: STARTED
[14:36:02.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:96:0) after 3m11s
[14:39:13.546] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:96:0)
[14:39:13.585] Build status: STARTED
[14:39:13.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:97:0) after 5m59s
[14:45:12.753] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:97:0)
[14:45:12.791] Build status: STARTED
[14:45:12.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:98:0) after 7m39s
[14:52:51.919] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:98:0)
[14:52:51.948] Build status: STARTED
[14:52:51.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:99:0) after 9m42s
[15:02:33.974] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:99:0)
[15:02:34.117] Build status: STARTED
[15:02:34.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:100:0) after 7m28s
[15:10:02.290] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:100:0)
[15:10:02.319] Build status: STARTED
[15:10:02.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:101:0) after 8m15s
[15:18:17.400] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:101:0)
[15:18:17.469] Build status: STARTED
[15:18:17.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:102:0) after 6m13s
[15:24:30.645] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:102:0)
[15:24:30.677] Build status: STARTED
[15:24:30.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:103:0) after 7m31s
[15:32:01.922] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:103:0)
[15:32:01.962] Build status: STARTED
[15:32:01.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:104:0) after 1m41s
[15:33:43.251] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:104:0)
[15:33:43.297] Build status: STARTED
[15:33:43.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:105:0) after 2m5s
[15:35:50.447] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:105:0)
[15:35:50.480] Build status: STARTED
[15:35:50.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:106:0) after 9m4s
[15:44:54.510] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:106:0)
[15:44:54.558] Build status: STARTED
[15:44:54.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:107:0) after 3m55s
[15:48:50.858] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:107:0)
[15:48:50.892] Build status: STARTED
[15:48:50.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:108:0) after 4m55s
[15:53:46.381] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:108:0)
[15:53:46.421] Build status: STARTED
[15:53:46.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:109:0) after 6m13s
[16:00:00.470] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:109:0)
[16:00:00.507] Build status: STARTED
[16:00:00.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:110:0) after 9m25s
[16:09:25.807] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:110:0)
[16:09:25.843] Build status: STARTED
[16:09:25.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:111:0) after 7m22s
[16:16:47.875] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:111:0)
[16:16:47.905] Build status: STARTED
[16:16:47.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:112:0) after 6m18s
[16:23:05.941] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:112:0)
[16:23:05.974] Build status: STARTED
[16:23:05.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:113:0) after 2m41s
[16:25:47.029] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:113:0)
[16:25:47.071] Build status: STARTED
[16:25:47.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:114:0) after 3m16s
[16:29:03.127] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:114:0)
[16:29:03.161] Build status: STARTED
[16:29:03.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:115:0) after 8m5s
[16:37:08.482] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:115:0)
[16:37:08.522] Build status: STARTED
[16:37:08.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:116:0) after 3m58s
[16:41:06.947] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:116:0)
[16:41:06.978] Build status: STARTED
[16:41:06.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:117:0) after 1m1s
[16:42:08.011] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:117:0)
[16:42:08.044] Build status: STARTED
[16:42:08.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:118:0) after 5m42s
[16:47:50.215] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:118:0)
[16:47:50.246] Build status: STARTED
[16:47:50.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:119:0) after 7m43s
[16:55:33.309] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:119:0)
[16:55:33.382] Build status: STARTED
[16:55:33.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:120:0) after 2m0s
[16:57:33.427] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:120:0)
[16:57:33.462] Build status: STARTED
[16:57:33.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:121:0) after 7m24s
[17:04:57.501] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:121:0)
[17:04:57.556] Build status: STARTED
[17:04:57.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:122:0) after 2m30s
[17:07:27.759] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:122:0)
[17:07:27.793] Build status: STARTED
[17:07:27.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:123:0) after 1m44s
[17:09:11.825] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:123:0)
[17:09:11.858] Build status: STARTED
[17:09:11.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:124:0) after 1m1s
[17:10:12.888] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:124:0)
[17:10:13.041] Build status: STARTED
[17:10:13.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:125:0) after 9m14s
[17:19:27.097] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:125:0)
[17:19:27.127] Build status: STARTED
[17:19:27.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:126:0) after 9m1s
[17:28:28.760] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:126:0)
[17:28:28.797] Build status: STARTED
[17:28:28.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:127:0) after 7m51s
[17:36:19.863] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:127:0)
[17:36:19.897] Build status: STARTED
[17:36:19.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8994227784003246624:128:0) after 9m53s
[17:37:50.400] Received PubSub notification, asking Buildbucket for the build status
[17:37:50.432] Build:
{
"id": "8828797721890919649",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26334,
"createdBy": "project:chromium",
"createTime": "2021-12-04T06:29:50.094269476Z",
"startTime": "2021-12-04T06:56:08.687634Z",
"endTime": "2021-12-04T17:37:49.689487112Z",
"updateTime": "2021-12-04T17:37:49.689487112Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f242fb96b8d53df46a7c79ce30beb1af35945a04",
"ref": "refs/heads/main"
}
},
"canary": true
}
[17:37:50.432] Invocation finished in 11h8m1.736074939s with status FAILED