[23:00:23.146] New invocation is queued and will start shortly
[23:00:24.195] Starting the invocation (attempt 1)
[23:00:24.246] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/0bfecb016b364eb05e8e80dac0ce31327aec780f"
[23:00:24.246] Popped gitiles commit info from properties and tags
[23:00:24.246] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:00:24.246] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:00:24.247] Buildbucket request:
{
"requestId": "8992806507985528320",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0bfecb016b364eb05e8e80dac0ce31327aec780f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8992806507985528320"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:00:24.842] Scheduled build:
{
"id": "8827376446061250977",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26368,
"createdBy": "project:chromium",
"createTime": "2021-12-19T23:00:24.349446610Z",
"updateTime": "2021-12-19T23:00:24.349446610Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0bfecb016b364eb05e8e80dac0ce31327aec780f",
"ref": "refs/heads/main"
}
},
"canary": true
}
[23:00:24.842] Task URL: https://cr-buildbucket.appspot.com/build/8827376446061250977
[23:00:24.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:2:0) after 9m39s
[23:10:03.869] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:2:0)
[23:10:03.890] Build status: SCHEDULED
[23:10:03.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:3:0) after 3m59s
[23:12:54.946] Received PubSub notification, asking Buildbucket for the build status
[23:12:54.974] Build status: STARTED
[23:14:03.096] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:3:0)
[23:14:03.117] Build status: STARTED
[23:14:03.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:5:0) after 3m14s
[23:17:17.134] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:5:0)
[23:17:17.160] Build status: STARTED
[23:17:17.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:6:0) after 4m8s
[23:21:25.251] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:6:0)
[23:21:25.281] Build status: STARTED
[23:21:25.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:7:0) after 2m34s
[23:24:00.090] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:7:0)
[23:24:00.130] Build status: STARTED
[23:24:00.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:8:0) after 7m29s
[23:31:29.331] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:8:0)
[23:31:29.361] Build status: STARTED
[23:31:29.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:9:0) after 3m53s
[23:35:22.381] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:9:0)
[23:35:22.400] Build status: STARTED
[23:35:22.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:10:0) after 5m54s
[23:41:16.430] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:10:0)
[23:41:16.457] Build status: STARTED
[23:41:16.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:11:0) after 6m58s
[23:48:14.680] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:11:0)
[23:48:14.739] Build status: STARTED
[23:48:14.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:12:0) after 1m28s
[23:49:42.865] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:12:0)
[23:49:42.889] Build status: STARTED
[23:49:42.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:13:0) after 6m52s
[23:56:34.908] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:13:0)
[23:56:34.946] Build status: STARTED
[23:56:34.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:14:0) after 8m16s
[00:04:50.962] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:14:0)
[00:04:50.981] Build status: STARTED
[00:04:50.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:15:0) after 7m53s
[00:12:44.137] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:15:0)
[00:12:44.157] Build status: STARTED
[00:12:44.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:16:0) after 8m17s
[00:21:01.198] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:16:0)
[00:21:01.248] Build status: STARTED
[00:21:01.248] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:17:0) after 4m19s
[00:25:20.584] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:17:0)
[00:25:20.605] Build status: STARTED
[00:25:20.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:18:0) after 3m21s
[00:28:42.330] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:18:0)
[00:28:42.363] Build status: STARTED
[00:28:42.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:19:0) after 3m17s
[00:31:59.600] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:19:0)
[00:31:59.621] Build status: STARTED
[00:31:59.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:20:0) after 1m11s
[00:33:11.065] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:20:0)
[00:33:11.083] Build status: STARTED
[00:33:11.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:21:0) after 1m7s
[00:34:19.652] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:21:0)
[00:34:19.679] Build status: STARTED
[00:34:19.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:22:0) after 7m2s
[00:41:21.755] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:22:0)
[00:41:21.787] Build status: STARTED
[00:41:21.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:23:0) after 7m58s
[00:49:20.671] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:23:0)
[00:49:20.701] Build status: STARTED
[00:49:20.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:24:0) after 8m19s
[00:57:39.897] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:24:0)
[00:57:39.937] Build status: STARTED
[00:57:39.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:25:0) after 8m3s
[01:05:42.955] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:25:0)
[01:05:42.992] Build status: STARTED
[01:05:42.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:26:0) after 4m27s
[01:10:10.116] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:26:0)
[01:10:10.143] Build status: STARTED
[01:10:10.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:27:0) after 2m3s
[01:12:13.163] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:27:0)
[01:12:13.195] Build status: STARTED
[01:12:13.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:28:0) after 3m18s
[01:15:31.213] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:28:0)
[01:15:31.240] Build status: STARTED
[01:15:31.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:29:0) after 7m3s
[01:22:34.261] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:29:0)
[01:22:34.279] Build status: STARTED
[01:22:34.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:30:0) after 1m53s
[01:24:27.488] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:30:0)
[01:24:27.529] Build status: STARTED
[01:24:27.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:31:0) after 3m21s
[01:27:48.547] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:31:0)
[01:27:48.580] Build status: STARTED
[01:27:48.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:32:0) after 5m21s
[01:33:09.597] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:32:0)
[01:33:09.629] Build status: STARTED
[01:33:09.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:33:0) after 2m38s
[01:35:47.655] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:33:0)
[01:35:47.687] Build status: STARTED
[01:35:47.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:34:0) after 2m21s
[01:38:08.705] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:34:0)
[01:38:08.724] Build status: STARTED
[01:38:08.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:35:0) after 3m6s
[01:41:14.742] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:35:0)
[01:41:14.791] Build status: STARTED
[01:41:14.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:36:0) after 4m47s
[01:46:01.813] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:36:0)
[01:46:01.834] Build status: STARTED
[01:46:01.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:37:0) after 8m17s
[01:54:18.985] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:37:0)
[01:54:19.007] Build status: STARTED
[01:54:19.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:38:0) after 6m32s
[02:00:51.025] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:38:0)
[02:00:51.123] Build status: STARTED
[02:00:51.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:39:0) after 8m26s
[02:09:17.324] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:39:0)
[02:09:17.351] Build status: STARTED
[02:09:17.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:40:0) after 6m18s
[02:15:35.413] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:40:0)
[02:15:35.439] Build status: STARTED
[02:15:35.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:41:0) after 1m57s
[02:17:32.456] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:41:0)
[02:17:32.484] Build status: STARTED
[02:17:32.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:42:0) after 1m3s
[02:18:35.600] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:42:0)
[02:18:35.754] Build status: STARTED
[02:18:35.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:43:0) after 5m53s
[02:24:28.822] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:43:0)
[02:24:28.844] Build status: STARTED
[02:24:28.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:44:0) after 2m17s
[02:26:45.876] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:44:0)
[02:26:45.912] Build status: STARTED
[02:26:45.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:45:0) after 4m15s
[02:31:00.946] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:45:0)
[02:31:00.966] Build status: STARTED
[02:31:00.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:46:0) after 6m2s
[02:37:02.983] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:46:0)
[02:37:03.034] Build status: STARTED
[02:37:03.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:47:0) after 9m32s
[02:46:35.052] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:47:0)
[02:46:35.077] Build status: STARTED
[02:46:35.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:48:0) after 4m39s
[02:51:14.169] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:48:0)
[02:51:14.221] Build status: STARTED
[02:51:14.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:49:0) after 2m14s
[02:53:28.241] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:49:0)
[02:53:28.270] Build status: STARTED
[02:53:28.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:50:0) after 3m46s
[02:57:14.291] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:50:0)
[02:57:14.328] Build status: STARTED
[02:57:14.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:51:0) after 9m8s
[03:06:22.347] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:51:0)
[03:06:22.388] Build status: STARTED
[03:06:22.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:52:0) after 3m20s
[03:09:42.443] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:52:0)
[03:09:42.462] Build status: STARTED
[03:09:42.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:53:0) after 9m18s
[03:19:00.490] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:53:0)
[03:19:00.510] Build status: STARTED
[03:19:00.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:54:0) after 9m29s
[03:28:29.623] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:54:0)
[03:28:29.645] Build status: STARTED
[03:28:29.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:55:0) after 9m11s
[03:37:40.653] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:55:0)
[03:37:40.687] Build status: STARTED
[03:37:40.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:56:0) after 8m52s
[03:46:32.771] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:56:0)
[03:46:32.810] Build status: STARTED
[03:46:32.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:57:0) after 9m42s
[03:56:14.830] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:57:0)
[03:56:14.861] Build status: STARTED
[03:56:14.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:58:0) after 8m37s
[04:04:51.979] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:58:0)
[04:04:52.009] Build status: STARTED
[04:04:52.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:59:0) after 7m30s
[04:12:22.032] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:59:0)
[04:12:22.064] Build status: STARTED
[04:12:22.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:60:0) after 1m38s
[04:14:00.084] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:60:0)
[04:14:00.105] Build status: STARTED
[04:14:00.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:61:0) after 9m14s
[04:23:14.124] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:61:0)
[04:23:14.144] Build status: STARTED
[04:23:14.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:62:0) after 3m53s
[04:27:07.164] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:62:0)
[04:27:07.200] Build status: STARTED
[04:27:07.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:63:0) after 7m45s
[04:34:52.784] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:63:0)
[04:34:52.866] Build status: STARTED
[04:34:52.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:64:0) after 2m49s
[04:37:42.181] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:64:0)
[04:37:42.200] Build status: STARTED
[04:37:42.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:65:0) after 9m47s
[04:47:29.219] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:65:0)
[04:47:29.276] Build status: STARTED
[04:47:29.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:66:0) after 1m2s
[04:48:31.847] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:66:0)
[04:48:31.888] Build status: STARTED
[04:48:31.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:67:0) after 3m41s
[04:52:13.256] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:67:0)
[04:52:13.283] Build status: STARTED
[04:52:13.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:68:0) after 2m52s
[04:55:05.405] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:68:0)
[04:55:05.875] Build status: STARTED
[04:55:05.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:69:0) after 9m28s
[05:04:34.373] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:69:0)
[05:04:34.404] Build status: STARTED
[05:04:34.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:70:0) after 7m45s
[05:12:19.423] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:70:0)
[05:12:19.443] Build status: STARTED
[05:12:19.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:71:0) after 1m19s
[05:13:38.517] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:71:0)
[05:13:38.538] Build status: STARTED
[05:13:38.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:72:0) after 9m38s
[05:23:16.557] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:72:0)
[05:23:16.576] Build status: STARTED
[05:23:16.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:73:0) after 7m2s
[05:30:18.679] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:73:0)
[05:30:18.716] Build status: STARTED
[05:30:18.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:74:0) after 7m13s
[05:37:31.738] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:74:0)
[05:37:31.758] Build status: STARTED
[05:37:31.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:75:0) after 4m10s
[05:41:41.833] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:75:0)
[05:41:41.856] Build status: STARTED
[05:41:41.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:76:0) after 6m38s
[05:48:19.983] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:76:0)
[05:48:20.008] Build status: STARTED
[05:48:20.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:77:0) after 9m15s
[05:57:35.895] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:77:0)
[05:57:35.914] Build status: STARTED
[05:57:35.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:78:0) after 8m26s
[06:06:01.900] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:78:0)
[06:06:01.965] Build status: STARTED
[06:06:01.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:79:0) after 2m11s
[06:08:12.976] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:79:0)
[06:08:13.026] Build status: STARTED
[06:08:13.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:80:0) after 3m47s
[06:12:00.046] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:80:0)
[06:12:00.094] Build status: STARTED
[06:12:00.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:81:0) after 3m44s
[06:15:44.116] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:81:0)
[06:15:44.165] Build status: STARTED
[06:15:44.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:82:0) after 8m4s
[06:23:49.242] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:82:0)
[06:23:49.270] Build status: STARTED
[06:23:49.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:83:0) after 2m11s
[06:26:00.299] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:83:0)
[06:26:00.324] Build status: STARTED
[06:26:00.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:84:0) after 5m52s
[06:31:52.480] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:84:0)
[06:31:52.499] Build status: STARTED
[06:31:52.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:85:0) after 7m58s
[06:39:50.598] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:85:0)
[06:39:50.664] Build status: STARTED
[06:39:50.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:86:0) after 1m1s
[06:40:51.686] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:86:0)
[06:40:51.718] Build status: STARTED
[06:40:51.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:87:0) after 5m58s
[06:46:49.837] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:87:0)
[06:46:49.865] Build status: STARTED
[06:46:49.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:88:0) after 1m51s
[06:48:40.882] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:88:0)
[06:48:40.914] Build status: STARTED
[06:48:40.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:89:0) after 4m35s
[06:53:15.918] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:89:0)
[06:53:15.939] Build status: STARTED
[06:53:15.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:90:0) after 8m5s
[07:01:20.961] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:90:0)
[07:01:20.985] Build status: STARTED
[07:01:20.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:91:0) after 6m55s
[07:08:16.011] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:91:0)
[07:08:16.039] Build status: STARTED
[07:08:16.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:92:0) after 9m48s
[07:18:04.214] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:92:0)
[07:18:04.242] Build status: STARTED
[07:18:04.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:93:0) after 8m30s
[07:26:34.274] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:93:0)
[07:26:34.323] Build status: STARTED
[07:26:34.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:94:0) after 2m14s
[07:28:48.301] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:94:0)
[07:28:48.335] Build status: STARTED
[07:28:48.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:95:0) after 2m48s
[07:31:36.377] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:95:0)
[07:31:36.394] Build status: STARTED
[07:31:36.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:96:0) after 8m58s
[07:40:34.451] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:96:0)
[07:40:34.490] Build status: STARTED
[07:40:34.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:97:0) after 8m43s
[07:49:17.626] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:97:0)
[07:49:17.654] Build status: STARTED
[07:49:17.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:98:0) after 5m37s
[07:54:54.678] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:98:0)
[07:54:54.705] Build status: STARTED
[07:54:54.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:99:0) after 7m49s
[08:02:44.058] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:99:0)
[08:02:44.085] Build status: STARTED
[08:02:44.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:100:0) after 2m46s
[08:05:30.121] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:100:0)
[08:05:30.156] Build status: STARTED
[08:05:30.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:101:0) after 8m27s
[08:13:57.203] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:101:0)
[08:13:57.258] Build status: STARTED
[08:13:57.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:102:0) after 7m51s
[08:21:48.338] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:102:0)
[08:21:48.358] Build status: STARTED
[08:21:48.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:103:0) after 8m48s
[08:30:36.433] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:103:0)
[08:30:36.460] Build status: STARTED
[08:30:36.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:104:0) after 1m26s
[08:32:02.537] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:104:0)
[08:32:02.569] Build status: STARTED
[08:32:02.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:105:0) after 1m6s
[08:33:08.649] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:105:0)
[08:33:08.670] Build status: STARTED
[08:33:08.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:106:0) after 2m53s
[08:36:01.778] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:106:0)
[08:36:01.826] Build status: STARTED
[08:36:01.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:107:0) after 7m55s
[08:43:56.847] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:107:0)
[08:43:56.881] Build status: STARTED
[08:43:56.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:108:0) after 6m14s
[08:50:11.157] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:108:0)
[08:50:11.187] Build status: STARTED
[08:50:11.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:109:0) after 1m5s
[08:51:16.210] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:109:0)
[08:51:16.236] Build status: STARTED
[08:51:16.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:110:0) after 8m22s
[08:59:39.294] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:110:0)
[08:59:39.333] Build status: STARTED
[08:59:39.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:111:0) after 9m34s
[09:09:13.356] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:111:0)
[09:09:13.454] Build status: STARTED
[09:09:13.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:112:0) after 9m13s
[09:18:26.475] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:112:0)
[09:18:26.666] Build status: STARTED
[09:18:26.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:113:0) after 7m23s
[09:25:50.246] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:113:0)
[09:25:50.270] Build status: STARTED
[09:25:50.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:114:0) after 9m58s
[09:35:48.291] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:114:0)
[09:35:48.314] Build status: STARTED
[09:35:48.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:115:0) after 3m55s
[09:39:43.334] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:115:0)
[09:39:43.364] Build status: STARTED
[09:39:43.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8992806507985528320:116:0) after 3m10s
[09:42:19.667] Received PubSub notification, asking Buildbucket for the build status
[09:42:19.702] Build:
{
"id": "8827376446061250977",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26368,
"createdBy": "project:chromium",
"createTime": "2021-12-19T23:00:24.349446610Z",
"startTime": "2021-12-19T23:12:52.152245Z",
"endTime": "2021-12-20T09:41:49.734615921Z",
"updateTime": "2021-12-20T09:41:49.734615921Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0bfecb016b364eb05e8e80dac0ce31327aec780f",
"ref": "refs/heads/main"
}
},
"canary": true
}
[09:42:19.702] Invocation finished in 10h41m56.570774305s with status FAILED