[23:42:27.964] New invocation is queued and will start shortly
[23:42:29.064] Starting the invocation (attempt 1)
[23:42:29.101] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/4cf15282e6be620a370fe46bf4ead1ca93f36c6e"
[23:42:29.101] Popped gitiles commit info from properties and tags
[23:42:29.101] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:42:29.101] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:42:29.101] Buildbucket request:
{
"requestId": "8962272682853552016",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4cf15282e6be620a370fe46bf4ead1ca93f36c6e",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8962272682853552016"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:42:29.621] Scheduled build:
{
"id": "8796842620893933281",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 28446,
"createdBy": "project:chromium",
"createTime": "2022-11-21T23:42:29.193038246Z",
"updateTime": "2022-11-21T23:42:29.193038246Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4cf15282e6be620a370fe46bf4ead1ca93f36c6e",
"ref": "refs/heads/main"
}
}
}
[23:42:29.621] Task URL: https://cr-buildbucket.appspot.com/build/8796842620893933281
[23:42:29.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:2:0) after 3m29s
[23:45:58.707] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:2:0)
[23:45:58.731] Build status: SCHEDULED
[23:45:58.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:3:0) after 8m13s
[23:47:16.323] Received PubSub notification, asking Buildbucket for the build status
[23:47:16.348] Build status: STARTED
[23:54:11.985] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:3:0)
[23:54:12.070] Build status: STARTED
[23:54:12.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:5:0) after 7m5s
[00:01:17.200] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:5:0)
[00:01:17.232] Build status: STARTED
[00:01:17.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:6:0) after 1m34s
[00:02:51.765] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:6:0)
[00:02:51.796] Build status: STARTED
[00:02:51.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:7:0) after 2m21s
[00:05:13.018] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:7:0)
[00:05:13.071] Build status: STARTED
[00:05:13.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:8:0) after 3m13s
[00:08:26.095] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:8:0)
[00:08:26.118] Build status: STARTED
[00:08:26.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:9:0) after 8m29s
[00:16:55.376] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:9:0)
[00:16:55.430] Build status: STARTED
[00:16:55.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:10:0) after 9m47s
[00:26:42.660] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:10:0)
[00:26:42.687] Build status: STARTED
[00:26:42.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:11:0) after 9m41s
[00:36:23.813] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:11:0)
[00:36:23.838] Build status: STARTED
[00:36:23.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:12:0) after 4m43s
[00:41:06.870] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:12:0)
[00:41:06.938] Build status: STARTED
[00:41:06.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:13:0) after 4m10s
[00:45:17.293] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:13:0)
[00:45:17.319] Build status: STARTED
[00:45:17.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:14:0) after 2m1s
[00:47:19.526] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:14:0)
[00:47:19.552] Build status: STARTED
[00:47:19.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:15:0) after 9m0s
[00:56:19.581] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:15:0)
[00:56:19.608] Build status: STARTED
[00:56:19.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:16:0) after 5m2s
[01:01:21.718] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:16:0)
[01:01:21.754] Build status: STARTED
[01:01:21.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:17:0) after 9m53s
[01:11:14.899] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:17:0)
[01:11:14.933] Build status: STARTED
[01:11:14.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:18:0) after 8m48s
[01:20:02.968] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:18:0)
[01:20:02.991] Build status: STARTED
[01:20:02.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:19:0) after 2m23s
[01:22:26.173] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:19:0)
[01:22:26.194] Build status: STARTED
[01:22:26.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:20:0) after 3m11s
[01:25:37.914] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:20:0)
[01:25:37.939] Build status: STARTED
[01:25:37.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:21:0) after 7m4s
[01:32:42.071] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:21:0)
[01:32:42.096] Build status: STARTED
[01:32:42.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:22:0) after 3m19s
[01:36:01.239] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:22:0)
[01:36:01.261] Build status: STARTED
[01:36:01.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:23:0) after 9m21s
[01:45:22.298] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:23:0)
[01:45:22.318] Build status: STARTED
[01:45:22.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:24:0) after 9m22s
[01:54:44.406] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:24:0)
[01:54:44.428] Build status: STARTED
[01:54:44.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:25:0) after 6m54s
[02:01:38.476] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:25:0)
[02:01:38.505] Build status: STARTED
[02:01:38.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:26:0) after 9m23s
[02:11:01.535] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:26:0)
[02:11:01.564] Build status: STARTED
[02:11:01.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:27:0) after 1m0s
[02:12:01.726] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:27:0)
[02:12:01.749] Build status: STARTED
[02:12:01.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:28:0) after 3m3s
[02:15:05.038] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:28:0)
[02:15:05.059] Build status: STARTED
[02:15:05.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:29:0) after 9m18s
[02:24:23.129] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:29:0)
[02:24:23.150] Build status: STARTED
[02:24:23.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:30:0) after 5m56s
[02:30:19.164] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:30:0)
[02:30:19.186] Build status: STARTED
[02:30:19.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:31:0) after 9m32s
[02:39:51.563] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:31:0)
[02:39:51.583] Build status: STARTED
[02:39:51.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:32:0) after 3m36s
[02:43:27.609] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:32:0)
[02:43:27.640] Build status: STARTED
[02:43:27.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:33:0) after 7m34s
[02:51:02.052] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:33:0)
[02:51:02.125] Build status: STARTED
[02:51:02.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:34:0) after 8m40s
[02:59:42.153] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:34:0)
[02:59:42.178] Build status: STARTED
[02:59:42.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:35:0) after 6m2s
[03:05:44.254] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:35:0)
[03:05:44.288] Build status: STARTED
[03:05:44.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:36:0) after 2m44s
[03:08:28.373] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:36:0)
[03:08:28.399] Build status: STARTED
[03:08:28.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:37:0) after 9m58s
[03:18:26.892] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:37:0)
[03:18:26.910] Build status: STARTED
[03:18:26.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:38:0) after 9m26s
[03:27:53.080] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:38:0)
[03:27:53.103] Build status: STARTED
[03:27:53.103] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:39:0) after 5m6s
[03:32:59.359] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:39:0)
[03:32:59.381] Build status: STARTED
[03:32:59.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:40:0) after 3m2s
[03:36:01.466] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:40:0)
[03:36:01.503] Build status: STARTED
[03:36:01.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:41:0) after 2m22s
[03:38:23.532] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:41:0)
[03:38:23.559] Build status: STARTED
[03:38:23.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:42:0) after 1m11s
[03:39:34.600] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:42:0)
[03:39:34.625] Build status: STARTED
[03:39:34.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:43:0) after 2m0s
[03:41:34.648] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:43:0)
[03:41:34.671] Build status: STARTED
[03:41:34.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:44:0) after 3m48s
[03:45:22.728] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:44:0)
[03:45:22.748] Build status: STARTED
[03:45:22.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:45:0) after 3m45s
[03:49:08.059] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:45:0)
[03:49:08.089] Build status: STARTED
[03:49:08.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:46:0) after 5m34s
[03:54:42.126] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:46:0)
[03:54:42.149] Build status: STARTED
[03:54:42.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:47:0) after 9m23s
[04:04:05.181] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:47:0)
[04:04:05.205] Build status: STARTED
[04:04:05.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:48:0) after 4m29s
[04:08:34.245] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:48:0)
[04:08:34.267] Build status: STARTED
[04:08:34.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:49:0) after 1m36s
[04:10:10.787] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:49:0)
[04:10:10.823] Build status: STARTED
[04:10:10.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:50:0) after 5m7s
[04:15:17.825] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:50:0)
[04:15:17.848] Build status: STARTED
[04:15:17.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:51:0) after 3m54s
[04:19:11.884] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:51:0)
[04:19:11.910] Build status: STARTED
[04:19:11.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:52:0) after 8m58s
[04:28:09.949] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:52:0)
[04:28:09.975] Build status: STARTED
[04:28:09.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:53:0) after 5m57s
[04:34:07.044] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:53:0)
[04:34:07.101] Build status: STARTED
[04:34:07.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:54:0) after 8m55s
[04:43:02.565] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:54:0)
[04:43:02.586] Build status: STARTED
[04:43:02.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:55:0) after 7m18s
[04:50:20.684] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:55:0)
[04:50:20.718] Build status: STARTED
[04:50:20.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:56:0) after 4m27s
[04:54:47.760] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:56:0)
[04:54:47.807] Build status: STARTED
[04:54:47.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:57:0) after 5m24s
[05:00:11.950] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:57:0)
[05:00:11.998] Build status: STARTED
[05:00:11.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:58:0) after 2m23s
[05:02:35.661] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:58:0)
[05:02:35.682] Build status: STARTED
[05:02:35.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:59:0) after 2m51s
[05:05:26.789] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:59:0)
[05:05:26.811] Build status: STARTED
[05:05:26.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:60:0) after 9m1s
[05:14:28.679] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:60:0)
[05:14:28.703] Build status: STARTED
[05:14:28.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:61:0) after 9m58s
[05:24:26.686] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:61:0)
[05:24:26.780] Build status: STARTED
[05:24:26.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:62:0) after 8m20s
[05:32:46.919] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:62:0)
[05:32:46.953] Build status: STARTED
[05:32:46.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:63:0) after 8m20s
[05:41:07.404] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:63:0)
[05:41:07.446] Build status: STARTED
[05:41:07.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:64:0) after 2m41s
[05:43:48.555] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:64:0)
[05:43:48.578] Build status: STARTED
[05:43:48.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:65:0) after 8m2s
[05:51:50.621] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:65:0)
[05:51:50.711] Build status: STARTED
[05:51:50.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:66:0) after 2m50s
[05:54:40.747] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:66:0)
[05:54:40.800] Build status: STARTED
[05:54:40.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:67:0) after 3m17s
[05:57:58.010] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:67:0)
[05:57:58.037] Build status: STARTED
[05:57:58.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:68:0) after 5m55s
[06:03:53.121] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:68:0)
[06:03:53.145] Build status: STARTED
[06:03:53.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:69:0) after 1m0s
[06:04:53.195] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:69:0)
[06:04:53.220] Build status: STARTED
[06:04:53.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:70:0) after 9m25s
[06:14:18.362] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:70:0)
[06:14:18.383] Build status: STARTED
[06:14:18.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:71:0) after 4m47s
[06:19:05.416] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:71:0)
[06:19:05.438] Build status: STARTED
[06:19:05.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:72:0) after 9m31s
[06:28:36.581] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:72:0)
[06:28:36.620] Build status: STARTED
[06:28:36.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:73:0) after 1m2s
[06:29:38.654] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:73:0)
[06:29:38.677] Build status: STARTED
[06:29:38.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:74:0) after 4m12s
[06:33:51.012] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:74:0)
[06:33:51.034] Build status: STARTED
[06:33:51.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:75:0) after 9m14s
[06:43:05.129] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:75:0)
[06:43:05.156] Build status: STARTED
[06:43:05.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:76:0) after 5m28s
[06:48:33.239] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:76:0)
[06:48:33.266] Build status: STARTED
[06:48:33.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:77:0) after 7m0s
[06:55:33.292] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:77:0)
[06:55:33.315] Build status: STARTED
[06:55:33.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:78:0) after 4m7s
[06:59:40.374] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:78:0)
[06:59:40.415] Build status: STARTED
[06:59:40.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:79:0) after 6m15s
[07:05:55.445] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:79:0)
[07:05:55.474] Build status: STARTED
[07:05:55.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:80:0) after 1m2s
[07:06:57.569] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:80:0)
[07:06:57.597] Build status: STARTED
[07:06:57.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:81:0) after 9m59s
[07:16:56.630] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:81:0)
[07:16:56.653] Build status: STARTED
[07:16:56.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:82:0) after 1m22s
[07:18:18.696] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:82:0)
[07:18:18.720] Build status: STARTED
[07:18:18.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:83:0) after 8m52s
[07:27:10.837] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:83:0)
[07:27:10.901] Build status: STARTED
[07:27:10.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:84:0) after 8m37s
[07:35:48.150] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:84:0)
[07:35:48.259] Build status: STARTED
[07:35:48.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:85:0) after 4m41s
[07:40:29.397] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:85:0)
[07:40:29.421] Build status: STARTED
[07:40:29.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:86:0) after 7m24s
[07:47:53.449] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:86:0)
[07:47:53.474] Build status: STARTED
[07:47:53.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:87:0) after 1m46s
[07:49:39.506] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:87:0)
[07:49:39.526] Build status: STARTED
[07:49:39.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:88:0) after 4m57s
[07:54:36.678] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:88:0)
[07:54:36.706] Build status: STARTED
[07:54:36.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:89:0) after 4m21s
[07:58:57.789] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:89:0)
[07:58:57.815] Build status: STARTED
[07:58:57.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:90:0) after 3m48s
[08:02:45.880] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:90:0)
[08:02:45.910] Build status: STARTED
[08:02:45.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:91:0) after 9m0s
[08:11:46.085] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:91:0)
[08:11:46.107] Build status: STARTED
[08:11:46.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:92:0) after 6m37s
[08:18:23.148] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:92:0)
[08:18:23.176] Build status: STARTED
[08:18:23.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:93:0) after 6m15s
[08:24:38.220] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:93:0)
[08:24:38.251] Build status: STARTED
[08:24:38.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:94:0) after 6m33s
[08:31:11.471] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:94:0)
[08:31:11.495] Build status: STARTED
[08:31:11.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:95:0) after 4m24s
[08:35:35.632] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:95:0)
[08:35:35.762] Build status: STARTED
[08:35:35.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:96:0) after 5m59s
[08:41:34.959] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:96:0)
[08:41:34.986] Build status: STARTED
[08:41:34.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:97:0) after 7m23s
[08:48:58.083] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:97:0)
[08:48:58.173] Build status: STARTED
[08:48:58.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:98:0) after 9m20s
[08:58:18.583] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:98:0)
[08:58:18.608] Build status: STARTED
[08:58:18.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:99:0) after 1m22s
[08:59:40.642] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:99:0)
[08:59:40.679] Build status: STARTED
[08:59:40.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:100:0) after 7m33s
[09:07:13.746] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:100:0)
[09:07:13.771] Build status: STARTED
[09:07:13.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:101:0) after 5m4s
[09:12:17.829] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:101:0)
[09:12:17.853] Build status: STARTED
[09:12:17.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:102:0) after 8m42s
[09:20:59.898] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:102:0)
[09:20:59.926] Build status: STARTED
[09:20:59.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:103:0) after 8m59s
[09:29:59.111] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:103:0)
[09:29:59.133] Build status: STARTED
[09:29:59.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:104:0) after 5m45s
[09:35:44.162] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:104:0)
[09:35:44.187] Build status: STARTED
[09:35:44.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:105:0) after 5m58s
[09:41:42.279] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:105:0)
[09:41:42.340] Build status: STARTED
[09:41:42.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:106:0) after 6m45s
[09:48:27.921] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:106:0)
[09:48:27.954] Build status: STARTED
[09:48:27.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:107:0) after 1m52s
[09:50:20.139] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:107:0)
[09:50:20.161] Build status: STARTED
[09:50:20.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:108:0) after 4m19s
[09:54:39.292] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:108:0)
[09:54:39.318] Build status: STARTED
[09:54:39.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:109:0) after 9m48s
[10:04:27.450] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:109:0)
[10:04:27.536] Build status: STARTED
[10:04:27.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:110:0) after 3m54s
[10:08:21.588] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:110:0)
[10:08:21.619] Build status: STARTED
[10:08:21.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:111:0) after 2m3s
[10:10:24.935] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:111:0)
[10:10:24.957] Build status: STARTED
[10:10:24.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:112:0) after 3m13s
[10:13:38.074] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:112:0)
[10:13:38.108] Build status: STARTED
[10:13:38.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:113:0) after 7m39s
[10:21:17.273] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:113:0)
[10:21:17.302] Build status: STARTED
[10:21:17.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:114:0) after 8m27s
[10:29:44.335] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:114:0)
[10:29:44.398] Build status: STARTED
[10:29:44.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:115:0) after 9m16s
[10:39:00.612] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:115:0)
[10:39:00.638] Build status: STARTED
[10:39:00.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:116:0) after 3m46s
[10:42:46.693] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:116:0)
[10:42:46.746] Build status: STARTED
[10:42:46.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:117:0) after 1m57s
[10:44:43.774] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:117:0)
[10:44:43.801] Build status: STARTED
[10:44:43.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:118:0) after 8m4s
[10:52:47.848] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:118:0)
[10:52:47.872] Build status: STARTED
[10:52:47.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:119:0) after 2m8s
[10:54:55.905] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:119:0)
[10:54:55.961] Build status: STARTED
[10:54:55.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:120:0) after 7m53s
[11:02:49.037] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:120:0)
[11:02:49.071] Build status: STARTED
[11:02:49.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:121:0) after 9m5s
[11:11:54.426] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:121:0)
[11:11:54.501] Build status: STARTED
[11:11:54.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:122:0) after 2m19s
[11:14:13.533] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:122:0)
[11:14:13.555] Build status: STARTED
[11:14:13.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:123:0) after 4m12s
[11:18:25.593] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:123:0)
[11:18:25.614] Build status: STARTED
[11:18:25.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:124:0) after 4m14s
[11:22:39.796] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:124:0)
[11:22:39.817] Build status: STARTED
[11:22:39.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:125:0) after 4m18s
[11:26:57.971] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:125:0)
[11:26:57.995] Build status: STARTED
[11:26:57.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:126:0) after 8m55s
[11:35:53.058] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:126:0)
[11:35:53.104] Build status: STARTED
[11:35:53.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:127:0) after 6m28s
[11:42:21.144] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:127:0)
[11:42:21.187] Build status: STARTED
[11:42:21.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:128:0) after 2m42s
[11:45:03.502] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:128:0)
[11:45:03.532] Build status: STARTED
[11:45:03.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:129:0) after 9m32s
[11:54:35.676] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:129:0)
[11:54:35.749] Build status: STARTED
[11:54:35.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:130:0) after 2m35s
[11:57:10.835] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:130:0)
[11:57:10.860] Build status: STARTED
[11:57:10.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:131:0) after 9m33s
[12:06:44.042] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:131:0)
[12:06:44.074] Build status: STARTED
[12:06:44.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:132:0) after 3m8s
[12:09:52.232] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:132:0)
[12:09:52.272] Build status: STARTED
[12:09:52.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:133:0) after 7m50s
[12:17:42.511] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:133:0)
[12:17:42.532] Build status: STARTED
[12:17:42.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:134:0) after 1m28s
[12:19:10.714] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:134:0)
[12:19:10.745] Build status: STARTED
[12:19:10.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:135:0) after 8m43s
[12:27:53.823] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:135:0)
[12:27:53.849] Build status: STARTED
[12:27:53.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:136:0) after 7m21s
[12:35:15.101] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:136:0)
[12:35:15.136] Build status: STARTED
[12:35:15.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:137:0) after 2m27s
[12:37:42.144] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:137:0)
[12:37:42.166] Build status: STARTED
[12:37:42.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:138:0) after 2m35s
[12:40:17.188] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:138:0)
[12:40:17.211] Build status: STARTED
[12:40:17.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:139:0) after 1m27s
[12:41:44.205] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:139:0)
[12:41:44.247] Build status: STARTED
[12:41:44.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:140:0) after 9m10s
[12:50:54.494] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:140:0)
[12:50:54.552] Build status: STARTED
[12:50:54.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:141:0) after 6m59s
[12:57:53.602] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:141:0)
[12:57:53.628] Build status: STARTED
[12:57:53.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:142:0) after 5m16s
[13:03:09.667] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:142:0)
[13:03:09.697] Build status: STARTED
[13:03:09.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:143:0) after 9m55s
[13:13:04.786] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:143:0)
[13:13:04.811] Build status: STARTED
[13:13:04.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:144:0) after 1m26s
[13:14:30.882] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:144:0)
[13:14:30.961] Build status: STARTED
[13:14:30.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:145:0) after 4m22s
[13:18:52.997] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:145:0)
[13:18:53.027] Build status: STARTED
[13:18:53.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:146:0) after 9m41s
[13:28:34.267] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:146:0)
[13:28:34.294] Build status: STARTED
[13:28:34.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8962272682853552016:147:0) after 9m40s
[13:33:07.495] Received PubSub notification, asking Buildbucket for the build status
[13:33:07.523] Build:
{
"id": "8796842620893933281",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 28446,
"createdBy": "project:chromium",
"createTime": "2022-11-21T23:42:29.193038246Z",
"startTime": "2022-11-21T23:47:15.560640Z",
"endTime": "2022-11-22T13:33:07.029822957Z",
"updateTime": "2022-11-22T13:33:07.029822957Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4cf15282e6be620a370fe46bf4ead1ca93f36c6e",
"ref": "refs/heads/main"
}
}
}
[13:33:07.523] Invocation finished in 13h50m39.581581668s with status FAILED