[21:14:10.263] New invocation is queued and will start shortly
[21:14:11.394] Starting the invocation (attempt 1)
[21:14:11.432] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/3acf50e2934619788a1ca3903d22a4e9988392c5"
[21:14:11.432] Popped gitiles commit info from properties and tags
[21:14:11.432] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:14:11.432] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:14:11.433] Buildbucket request:
{
"requestId": "8991997817739939648",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3acf50e2934619788a1ca3903d22a4e9988392c5",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8991997817739939648"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:14:12.188] Scheduled build:
{
"id": "8826567755801157249",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26388,
"createdBy": "project:chromium",
"createTime": "2021-12-28T21:14:11.480852561Z",
"updateTime": "2021-12-28T21:14:11.480852561Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3acf50e2934619788a1ca3903d22a4e9988392c5",
"ref": "refs/heads/main"
}
}
}
[21:14:12.188] Task URL: https://cr-buildbucket.appspot.com/build/8826567755801157249
[21:14:12.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:2:0) after 3m24s
[21:17:36.247] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:2:0)
[21:17:36.264] Build status: SCHEDULED
[21:17:36.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:3:0) after 5m40s
[21:23:16.404] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:3:0)
[21:23:16.430] Build status: SCHEDULED
[21:23:16.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:4:0) after 7m38s
[21:30:54.473] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:4:0)
[21:30:54.539] Build status: SCHEDULED
[21:30:54.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:5:0) after 7m7s
[21:38:01.571] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:5:0)
[21:38:01.603] Build status: SCHEDULED
[21:38:01.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:6:0) after 4m58s
[21:42:59.621] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:6:0)
[21:42:59.641] Build status: SCHEDULED
[21:42:59.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:7:0) after 7m29s
[21:44:21.749] Received PubSub notification, asking Buildbucket for the build status
[21:44:21.770] Build status: STARTED
[21:50:28.761] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:7:0)
[21:50:28.779] Build status: STARTED
[21:50:28.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:9:0) after 5m10s
[21:55:38.802] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:9:0)
[21:55:38.845] Build status: STARTED
[21:55:38.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:10:0) after 9m31s
[22:05:10.170] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:10:0)
[22:05:10.191] Build status: STARTED
[22:05:10.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:11:0) after 2m50s
[22:08:00.216] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:11:0)
[22:08:00.271] Build status: STARTED
[22:08:00.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:12:0) after 4m26s
[22:12:26.418] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:12:0)
[22:12:26.443] Build status: STARTED
[22:12:26.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:13:0) after 8m34s
[22:21:00.586] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:13:0)
[22:21:00.612] Build status: STARTED
[22:21:00.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:14:0) after 6m34s
[22:27:34.655] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:14:0)
[22:27:34.675] Build status: STARTED
[22:27:34.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:15:0) after 1m47s
[22:29:21.700] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:15:0)
[22:29:21.784] Build status: STARTED
[22:29:21.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:16:0) after 1m17s
[22:30:38.805] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:16:0)
[22:30:38.830] Build status: STARTED
[22:30:38.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:17:0) after 5m49s
[22:36:27.902] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:17:0)
[22:36:27.921] Build status: STARTED
[22:36:27.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:18:0) after 2m39s
[22:39:06.944] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:18:0)
[22:39:06.986] Build status: STARTED
[22:39:06.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:19:0) after 5m45s
[22:44:51.991] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:19:0)
[22:44:52.011] Build status: STARTED
[22:44:52.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:20:0) after 7m3s
[22:51:55.066] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:20:0)
[22:51:55.168] Build status: STARTED
[22:51:55.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:21:0) after 5m35s
[22:57:30.245] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:21:0)
[22:57:30.264] Build status: STARTED
[22:57:30.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:22:0) after 1m42s
[22:59:12.346] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:22:0)
[22:59:12.365] Build status: STARTED
[22:59:12.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:23:0) after 8m1s
[23:07:13.411] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:23:0)
[23:07:13.430] Build status: STARTED
[23:07:13.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:24:0) after 9m19s
[23:16:32.559] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:24:0)
[23:16:32.578] Build status: STARTED
[23:16:32.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:25:0) after 7m36s
[23:24:08.619] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:25:0)
[23:24:08.661] Build status: STARTED
[23:24:08.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:26:0) after 3m46s
[23:27:54.757] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:26:0)
[23:27:54.776] Build status: STARTED
[23:27:54.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:27:0) after 8m29s
[23:36:23.799] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:27:0)
[23:36:23.831] Build status: STARTED
[23:36:23.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:28:0) after 7m10s
[23:43:33.850] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:28:0)
[23:43:33.868] Build status: STARTED
[23:43:33.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:29:0) after 2m31s
[23:46:04.887] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:29:0)
[23:46:04.907] Build status: STARTED
[23:46:04.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:30:0) after 6m11s
[23:52:15.932] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:30:0)
[23:52:15.966] Build status: STARTED
[23:52:15.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:31:0) after 9m47s
[00:02:03.268] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:31:0)
[00:02:03.291] Build status: STARTED
[00:02:03.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:32:0) after 8m57s
[00:11:00.394] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:32:0)
[00:11:00.447] Build status: STARTED
[00:11:00.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:33:0) after 1m48s
[00:12:48.506] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:33:0)
[00:12:48.531] Build status: STARTED
[00:12:48.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:34:0) after 9m40s
[00:22:28.714] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:34:0)
[00:22:28.735] Build status: STARTED
[00:22:28.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:35:0) after 5m44s
[00:28:12.856] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:35:0)
[00:28:12.889] Build status: STARTED
[00:28:12.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:36:0) after 8m33s
[00:36:45.910] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:36:0)
[00:36:45.929] Build status: STARTED
[00:36:45.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:37:0) after 2m35s
[00:39:20.948] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:37:0)
[00:39:20.976] Build status: STARTED
[00:39:20.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:38:0) after 1m4s
[00:40:25.110] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:38:0)
[00:40:25.130] Build status: STARTED
[00:40:25.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:39:0) after 2m19s
[00:42:44.213] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:39:0)
[00:42:44.248] Build status: STARTED
[00:42:44.248] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:40:0) after 8m34s
[00:51:18.559] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:40:0)
[00:51:18.588] Build status: STARTED
[00:51:18.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:41:0) after 8m57s
[01:00:15.610] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:41:0)
[01:00:15.628] Build status: STARTED
[01:00:15.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:42:0) after 7m46s
[01:08:01.748] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:42:0)
[01:08:01.800] Build status: STARTED
[01:08:01.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:43:0) after 9m13s
[01:17:14.869] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:43:0)
[01:17:14.888] Build status: STARTED
[01:17:14.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:44:0) after 5m53s
[01:23:07.937] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:44:0)
[01:23:07.970] Build status: STARTED
[01:23:07.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:45:0) after 5m18s
[01:28:25.990] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:45:0)
[01:28:26.011] Build status: STARTED
[01:28:26.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:46:0) after 1m55s
[01:30:21.032] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:46:0)
[01:30:21.113] Build status: STARTED
[01:30:21.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:47:0) after 3m16s
[01:33:37.377] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:47:0)
[01:33:37.459] Build status: STARTED
[01:33:37.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:48:0) after 9m14s
[01:42:51.489] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:48:0)
[01:42:51.511] Build status: STARTED
[01:42:51.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:49:0) after 1m58s
[01:44:49.614] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:49:0)
[01:44:49.632] Build status: STARTED
[01:44:49.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:50:0) after 2m2s
[01:46:51.677] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:50:0)
[01:46:51.697] Build status: STARTED
[01:46:51.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:51:0) after 2m18s
[01:49:09.720] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:51:0)
[01:49:09.765] Build status: STARTED
[01:49:09.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:52:0) after 8m50s
[01:57:59.852] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:52:0)
[01:57:59.870] Build status: STARTED
[01:57:59.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:53:0) after 4m37s
[02:02:37.305] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:53:0)
[02:02:37.338] Build status: STARTED
[02:02:37.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:54:0) after 2m54s
[02:05:31.362] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:54:0)
[02:05:31.552] Build status: STARTED
[02:05:31.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:55:0) after 8m26s
[02:13:57.655] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:55:0)
[02:13:57.685] Build status: STARTED
[02:13:57.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:56:0) after 1m0s
[02:14:57.745] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:56:0)
[02:14:57.770] Build status: STARTED
[02:14:57.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:57:0) after 8m19s
[02:23:16.891] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:57:0)
[02:23:16.912] Build status: STARTED
[02:23:16.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:58:0) after 8m5s
[02:31:21.931] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:58:0)
[02:31:21.971] Build status: STARTED
[02:31:21.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:59:0) after 9m18s
[02:40:40.114] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:59:0)
[02:40:40.134] Build status: STARTED
[02:40:40.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:60:0) after 9m9s
[02:49:49.138] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:60:0)
[02:49:49.177] Build status: STARTED
[02:49:49.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:61:0) after 8m13s
[02:58:02.196] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:61:0)
[02:58:02.221] Build status: STARTED
[02:58:02.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:62:0) after 7m29s
[03:05:31.243] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:62:0)
[03:05:31.270] Build status: STARTED
[03:05:31.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:63:0) after 3m34s
[03:09:05.262] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:63:0)
[03:09:05.280] Build status: STARTED
[03:09:05.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:64:0) after 1m58s
[03:11:03.509] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:64:0)
[03:11:03.540] Build status: STARTED
[03:11:03.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:65:0) after 3m16s
[03:14:19.540] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:65:0)
[03:14:19.564] Build status: STARTED
[03:14:19.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:66:0) after 8m33s
[03:22:52.595] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:66:0)
[03:22:52.680] Build status: STARTED
[03:22:52.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:67:0) after 8m33s
[03:31:25.707] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:67:0)
[03:31:25.735] Build status: STARTED
[03:31:25.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:68:0) after 5m16s
[03:36:41.909] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:68:0)
[03:36:41.927] Build status: STARTED
[03:36:41.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:69:0) after 9m46s
[03:46:28.044] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:69:0)
[03:46:28.063] Build status: STARTED
[03:46:28.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:70:0) after 3m32s
[03:50:00.151] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:70:0)
[03:50:00.174] Build status: STARTED
[03:50:00.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:71:0) after 5m53s
[03:55:53.196] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:71:0)
[03:55:53.258] Build status: STARTED
[03:55:53.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:72:0) after 5m6s
[04:00:59.429] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:72:0)
[04:00:59.461] Build status: STARTED
[04:00:59.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:73:0) after 7m56s
[04:08:55.713] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:73:0)
[04:08:55.737] Build status: STARTED
[04:08:55.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:74:0) after 7m4s
[04:15:59.789] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:74:0)
[04:15:59.844] Build status: STARTED
[04:15:59.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:75:0) after 7m52s
[04:23:52.070] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:75:0)
[04:23:52.098] Build status: STARTED
[04:23:52.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:76:0) after 5m8s
[04:29:00.322] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:76:0)
[04:29:00.348] Build status: STARTED
[04:29:00.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:77:0) after 3m36s
[04:32:36.663] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:77:0)
[04:32:36.693] Build status: STARTED
[04:32:36.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:78:0) after 6m21s
[04:38:57.719] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:78:0)
[04:38:57.734] Build status: STARTED
[04:38:57.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:79:0) after 9m52s
[04:48:49.757] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:79:0)
[04:48:49.792] Build status: STARTED
[04:48:49.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:80:0) after 5m36s
[04:54:25.944] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:80:0)
[04:54:25.962] Build status: STARTED
[04:54:25.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:81:0) after 2m3s
[04:56:29.050] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:81:0)
[04:56:29.076] Build status: STARTED
[04:56:29.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:82:0) after 7m44s
[05:04:13.276] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:82:0)
[05:04:13.294] Build status: STARTED
[05:04:13.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:83:0) after 4m9s
[05:08:22.314] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:83:0)
[05:08:22.339] Build status: STARTED
[05:08:22.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:84:0) after 2m44s
[05:11:06.411] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:84:0)
[05:11:06.444] Build status: STARTED
[05:11:06.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:85:0) after 6m13s
[05:17:19.469] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:85:0)
[05:17:19.487] Build status: STARTED
[05:17:19.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:86:0) after 2m9s
[05:19:28.752] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:86:0)
[05:19:28.781] Build status: STARTED
[05:19:28.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:87:0) after 8m1s
[05:27:29.868] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:87:0)
[05:27:29.886] Build status: STARTED
[05:27:29.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:88:0) after 8m56s
[05:36:26.010] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:88:0)
[05:36:26.040] Build status: STARTED
[05:36:26.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:89:0) after 2m26s
[05:38:52.223] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:89:0)
[05:38:52.281] Build status: STARTED
[05:38:52.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:90:0) after 1m21s
[05:40:13.303] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:90:0)
[05:40:13.323] Build status: STARTED
[05:40:13.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:91:0) after 4m30s
[05:44:43.446] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:91:0)
[05:44:43.469] Build status: STARTED
[05:44:43.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:92:0) after 9m44s
[05:54:27.638] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:92:0)
[05:54:27.669] Build status: STARTED
[05:54:27.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:93:0) after 9m6s
[06:03:33.691] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:93:0)
[06:03:33.711] Build status: STARTED
[06:03:33.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:94:0) after 6m2s
[06:09:35.767] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:94:0)
[06:09:35.800] Build status: STARTED
[06:09:35.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:95:0) after 2m28s
[06:12:03.841] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:95:0)
[06:12:03.912] Build status: STARTED
[06:12:03.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:96:0) after 2m56s
[06:14:59.933] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:96:0)
[06:14:59.951] Build status: STARTED
[06:14:59.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:97:0) after 6m53s
[06:21:53.001] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:97:0)
[06:21:53.024] Build status: STARTED
[06:21:53.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:98:0) after 1m25s
[06:23:18.076] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:98:0)
[06:23:18.096] Build status: STARTED
[06:23:18.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:99:0) after 3m45s
[06:27:03.125] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:99:0)
[06:27:03.154] Build status: STARTED
[06:27:03.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:100:0) after 1m43s
[06:28:46.176] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:100:0)
[06:28:46.198] Build status: STARTED
[06:28:46.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:101:0) after 3m29s
[06:32:15.389] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:101:0)
[06:32:15.495] Build status: STARTED
[06:32:15.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:102:0) after 1m48s
[06:34:03.535] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:102:0)
[06:34:03.575] Build status: STARTED
[06:34:03.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:103:0) after 6m26s
[06:40:29.600] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:103:0)
[06:40:29.618] Build status: STARTED
[06:40:29.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:104:0) after 6m4s
[06:46:33.804] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:104:0)
[06:46:33.831] Build status: STARTED
[06:46:33.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:105:0) after 4m57s
[06:51:33.362] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:105:0)
[06:51:33.381] Build status: STARTED
[06:51:33.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:106:0) after 4m4s
[06:55:37.506] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:106:0)
[06:55:37.527] Build status: STARTED
[06:55:37.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:107:0) after 3m36s
[06:59:13.569] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:107:0)
[06:59:13.595] Build status: STARTED
[06:59:13.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:108:0) after 6m12s
[07:05:25.636] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:108:0)
[07:05:25.753] Build status: STARTED
[07:05:25.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:109:0) after 3m1s
[07:08:26.802] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:109:0)
[07:08:26.820] Build status: STARTED
[07:08:26.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:110:0) after 6m23s
[07:14:49.866] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:110:0)
[07:14:49.886] Build status: STARTED
[07:14:49.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:111:0) after 5m50s
[07:20:39.982] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:111:0)
[07:20:40.007] Build status: STARTED
[07:20:40.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:112:0) after 9m54s
[07:30:34.150] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:112:0)
[07:30:34.176] Build status: STARTED
[07:30:34.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:113:0) after 6m34s
[07:37:08.409] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:113:0)
[07:37:08.455] Build status: STARTED
[07:37:08.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:114:0) after 5m22s
[07:42:30.513] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:114:0)
[07:42:30.545] Build status: STARTED
[07:42:30.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:115:0) after 8m8s
[07:50:38.819] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:115:0)
[07:50:38.846] Build status: STARTED
[07:50:38.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:116:0) after 1m32s
[07:52:10.983] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:116:0)
[07:52:11.001] Build status: STARTED
[07:52:11.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:117:0) after 6m16s
[07:58:27.208] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:117:0)
[07:58:27.226] Build status: STARTED
[07:58:27.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:118:0) after 5m7s
[08:03:34.247] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:118:0)
[08:03:34.265] Build status: STARTED
[08:03:34.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:119:0) after 1m9s
[08:04:43.308] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:119:0)
[08:04:43.338] Build status: STARTED
[08:04:43.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:120:0) after 7m53s
[08:12:36.364] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:120:0)
[08:12:36.381] Build status: STARTED
[08:12:36.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:121:0) after 6m52s
[08:19:28.413] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:121:0)
[08:19:28.435] Build status: STARTED
[08:19:28.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8991997817739939648:122:0) after 3m44s
[08:20:03.374] Received PubSub notification, asking Buildbucket for the build status
[08:20:03.390] Build:
{
"id": "8826567755801157249",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26388,
"createdBy": "project:chromium",
"createTime": "2021-12-28T21:14:11.480852561Z",
"startTime": "2021-12-28T21:44:21.203066Z",
"endTime": "2021-12-29T08:20:02.555891844Z",
"updateTime": "2021-12-29T08:20:02.555891844Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3acf50e2934619788a1ca3903d22a4e9988392c5",
"ref": "refs/heads/main"
}
}
}
[08:20:03.390] Invocation finished in 11h5m53.142544122s with status FAILED