[16:32:48.880] New invocation is queued and will start shortly
[16:32:49.969] Starting the invocation (attempt 1)
[16:32:50.004] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/7457644df49e6c23062ecab358da62b3fd960c39"
[16:32:50.004] Popped gitiles commit info from properties and tags
[16:32:50.004] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:32:50.004] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:32:50.004] Buildbucket request:
{
"requestId": "9012218642659781584",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7457644df49e6c23062ecab358da62b3fd960c39",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9012218642659781584"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:32:50.895] Scheduled build:
{
"id": "8846788580669506384",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 24996,
"createdBy": "project:chromium",
"createTime": "2021-05-19T16:32:50.147783Z",
"updateTime": "2021-05-19T16:32:50.775961Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7457644df49e6c23062ecab358da62b3fd960c39",
"ref": "refs/heads/master"
}
}
}
[16:32:50.895] Task URL: https://cr-buildbucket.appspot.com/build/8846788580669506384
[16:32:50.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:2:0) after 8m43s
[16:33:25.619] Received PubSub notification, asking Buildbucket for the build status
[16:33:25.650] Build status: STARTED
[16:41:34.050] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:2:0)
[16:41:34.084] Build status: STARTED
[16:41:34.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:4:0) after 8m30s
[16:50:04.226] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:4:0)
[16:50:04.255] Build status: STARTED
[16:50:04.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:5:0) after 4m54s
[16:54:58.276] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:5:0)
[16:54:58.328] Build status: STARTED
[16:54:58.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:6:0) after 5m28s
[17:00:26.347] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:6:0)
[17:00:26.377] Build status: STARTED
[17:00:26.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:7:0) after 2m26s
[17:02:52.428] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:7:0)
[17:02:52.511] Build status: STARTED
[17:02:52.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:8:0) after 8m39s
[17:11:31.561] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:8:0)
[17:11:31.622] Build status: STARTED
[17:11:31.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:9:0) after 1m3s
[17:12:34.875] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:9:0)
[17:12:34.904] Build status: STARTED
[17:12:34.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:10:0) after 2m23s
[17:14:58.185] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:10:0)
[17:14:58.213] Build status: STARTED
[17:14:58.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:11:0) after 3m4s
[17:18:02.410] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:11:0)
[17:18:02.464] Build status: STARTED
[17:18:02.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:12:0) after 8m35s
[17:26:37.535] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:12:0)
[17:26:37.567] Build status: STARTED
[17:26:37.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:13:0) after 1m4s
[17:27:41.674] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:13:0)
[17:27:41.701] Build status: STARTED
[17:27:41.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:14:0) after 4m23s
[17:32:04.869] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:14:0)
[17:32:04.897] Build status: STARTED
[17:32:04.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:15:0) after 6m39s
[17:38:43.920] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:15:0)
[17:38:43.950] Build status: STARTED
[17:38:43.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:16:0) after 1m50s
[17:40:34.141] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:16:0)
[17:40:34.173] Build status: STARTED
[17:40:34.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:17:0) after 5m36s
[17:46:10.200] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:17:0)
[17:46:10.234] Build status: STARTED
[17:46:10.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:18:0) after 3m58s
[17:50:08.249] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:18:0)
[17:50:08.279] Build status: STARTED
[17:50:08.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:19:0) after 6m33s
[17:56:41.576] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:19:0)
[17:56:41.604] Build status: STARTED
[17:56:41.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:20:0) after 4m31s
[18:01:13.004] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:20:0)
[18:01:13.041] Build status: STARTED
[18:01:13.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:21:0) after 8m58s
[18:10:11.317] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:21:0)
[18:10:11.350] Build status: STARTED
[18:10:11.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:22:0) after 3m11s
[18:13:22.553] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:22:0)
[18:13:22.592] Build status: STARTED
[18:13:22.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:23:0) after 7m40s
[18:21:02.622] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:23:0)
[18:21:02.658] Build status: STARTED
[18:21:02.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:24:0) after 6m13s
[18:27:15.839] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:24:0)
[18:27:15.872] Build status: STARTED
[18:27:15.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:25:0) after 6m8s
[18:33:23.891] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:25:0)
[18:33:23.923] Build status: STARTED
[18:33:23.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:26:0) after 8m53s
[18:42:17.039] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:26:0)
[18:42:17.077] Build status: STARTED
[18:42:17.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:27:0) after 8m48s
[18:51:05.267] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:27:0)
[18:51:05.312] Build status: STARTED
[18:51:05.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:28:0) after 6m53s
[18:57:58.432] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:28:0)
[18:57:58.465] Build status: STARTED
[18:57:58.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:29:0) after 5m5s
[19:03:03.731] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:29:0)
[19:03:03.758] Build status: STARTED
[19:03:03.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:30:0) after 9m39s
[19:12:42.859] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:30:0)
[19:12:42.948] Build status: STARTED
[19:12:42.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:31:0) after 8m22s
[19:21:04.975] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:31:0)
[19:21:05.015] Build status: STARTED
[19:21:05.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:32:0) after 7m38s
[19:28:43.057] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:32:0)
[19:28:43.088] Build status: STARTED
[19:28:43.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:33:0) after 7m3s
[19:35:46.113] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:33:0)
[19:35:46.141] Build status: STARTED
[19:35:46.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:34:0) after 6m39s
[19:42:25.167] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:34:0)
[19:42:25.197] Build status: STARTED
[19:42:25.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:35:0) after 6m28s
[19:48:53.296] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:35:0)
[19:48:53.333] Build status: STARTED
[19:48:53.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:36:0) after 8m3s
[19:56:56.642] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:36:0)
[19:56:56.680] Build status: STARTED
[19:56:56.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:37:0) after 7m23s
[20:04:19.680] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:37:0)
[20:04:19.715] Build status: STARTED
[20:04:19.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:38:0) after 2m23s
[20:06:42.786] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:38:0)
[20:06:42.839] Build status: STARTED
[20:06:42.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:39:0) after 8m22s
[20:15:04.903] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:39:0)
[20:15:04.998] Build status: STARTED
[20:15:04.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:40:0) after 2m52s
[20:17:57.144] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:40:0)
[20:17:57.172] Build status: STARTED
[20:17:57.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:41:0) after 2m29s
[20:20:26.374] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:41:0)
[20:20:26.423] Build status: STARTED
[20:20:26.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:42:0) after 4m8s
[20:24:34.496] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:42:0)
[20:24:34.535] Build status: STARTED
[20:24:34.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:43:0) after 8m38s
[20:33:12.632] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:43:0)
[20:33:12.675] Build status: STARTED
[20:33:12.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:44:0) after 7m20s
[20:40:32.694] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:44:0)
[20:40:32.727] Build status: STARTED
[20:40:32.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:45:0) after 8m5s
[20:48:37.991] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:45:0)
[20:48:38.024] Build status: STARTED
[20:48:38.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:46:0) after 2m34s
[20:51:12.253] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:46:0)
[20:51:12.283] Build status: STARTED
[20:51:12.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:47:0) after 5m59s
[20:57:11.399] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:47:0)
[20:57:11.441] Build status: STARTED
[20:57:11.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:48:0) after 2m12s
[20:59:24.042] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:48:0)
[20:59:24.076] Build status: STARTED
[20:59:24.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:49:0) after 4m39s
[21:04:03.108] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:49:0)
[21:04:03.138] Build status: STARTED
[21:04:03.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:50:0) after 6m32s
[21:10:35.179] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:50:0)
[21:10:35.216] Build status: STARTED
[21:10:35.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:51:0) after 5m32s
[21:16:07.918] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:51:0)
[21:16:07.949] Build status: STARTED
[21:16:07.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:52:0) after 1m2s
[21:17:09.982] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:52:0)
[21:17:10.009] Build status: STARTED
[21:17:10.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:53:0) after 9m27s
[21:26:37.031] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:53:0)
[21:26:37.064] Build status: STARTED
[21:26:37.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:54:0) after 9m35s
[21:36:12.396] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:54:0)
[21:36:12.426] Build status: STARTED
[21:36:12.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:55:0) after 4m51s
[21:41:03.652] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:55:0)
[21:41:03.729] Build status: STARTED
[21:41:03.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:56:0) after 2m7s
[21:43:11.074] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:56:0)
[21:43:11.160] Build status: STARTED
[21:43:11.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:57:0) after 8m43s
[21:51:54.411] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:57:0)
[21:51:54.441] Build status: STARTED
[21:51:54.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:58:0) after 2m58s
[21:54:52.682] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:58:0)
[21:54:52.733] Build status: STARTED
[21:54:52.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:59:0) after 1m45s
[21:56:37.727] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:59:0)
[21:56:37.754] Build status: STARTED
[21:56:37.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:60:0) after 3m32s
[22:00:10.294] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:60:0)
[22:00:10.336] Build status: STARTED
[22:00:10.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:61:0) after 5m12s
[22:05:22.360] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:61:0)
[22:05:22.414] Build status: STARTED
[22:05:22.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:62:0) after 1m35s
[22:06:57.445] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:62:0)
[22:06:57.494] Build status: STARTED
[22:06:57.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:63:0) after 6m30s
[22:13:27.530] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:63:0)
[22:13:27.561] Build status: STARTED
[22:13:27.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:64:0) after 8m8s
[22:21:35.623] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:64:0)
[22:21:35.669] Build status: STARTED
[22:21:35.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:65:0) after 4m23s
[22:25:58.691] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:65:0)
[22:25:58.717] Build status: STARTED
[22:25:58.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:66:0) after 1m53s
[22:27:52.044] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:66:0)
[22:27:52.072] Build status: STARTED
[22:27:52.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:67:0) after 9m15s
[22:37:07.112] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:67:0)
[22:37:07.151] Build status: STARTED
[22:37:07.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:68:0) after 1m12s
[22:38:19.192] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:68:0)
[22:38:19.222] Build status: STARTED
[22:38:19.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:69:0) after 1m15s
[22:39:34.342] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:69:0)
[22:39:34.370] Build status: STARTED
[22:39:34.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:70:0) after 9m1s
[22:48:35.353] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:70:0)
[22:48:35.382] Build status: STARTED
[22:48:35.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:71:0) after 8m18s
[22:56:53.412] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:71:0)
[22:56:53.467] Build status: STARTED
[22:56:53.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:72:0) after 9m55s
[23:06:48.485] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:72:0)
[23:06:48.517] Build status: STARTED
[23:06:48.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:73:0) after 6m34s
[23:13:22.646] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:73:0)
[23:13:22.718] Build status: STARTED
[23:13:22.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:74:0) after 6m58s
[23:20:20.745] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:74:0)
[23:20:20.924] Build status: STARTED
[23:20:20.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:75:0) after 9m51s
[23:30:12.137] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:75:0)
[23:30:12.165] Build status: STARTED
[23:30:12.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:76:0) after 8m17s
[23:38:29.266] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:76:0)
[23:38:29.293] Build status: STARTED
[23:38:29.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:77:0) after 2m22s
[23:40:51.277] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:77:0)
[23:40:51.361] Build status: STARTED
[23:40:51.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:78:0) after 9m12s
[23:50:03.402] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:78:0)
[23:50:03.428] Build status: STARTED
[23:50:03.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:79:0) after 2m23s
[23:52:26.583] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:79:0)
[23:52:26.625] Build status: STARTED
[23:52:26.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:80:0) after 6m42s
[23:59:08.645] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:80:0)
[23:59:08.731] Build status: STARTED
[23:59:08.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:81:0) after 2m21s
[00:01:29.877] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:81:0)
[00:01:29.909] Build status: STARTED
[00:01:29.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:82:0) after 4m19s
[00:05:48.945] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:82:0)
[00:05:48.982] Build status: STARTED
[00:05:48.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:83:0) after 5m2s
[00:10:51.072] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:83:0)
[00:10:51.099] Build status: STARTED
[00:10:51.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:84:0) after 4m47s
[00:15:38.135] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:84:0)
[00:15:38.173] Build status: STARTED
[00:15:38.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:85:0) after 1m49s
[00:17:27.431] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:85:0)
[00:17:27.732] Build status: STARTED
[00:17:27.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:86:0) after 1m5s
[00:18:32.973] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:86:0)
[00:18:33.006] Build status: STARTED
[00:18:33.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:87:0) after 5m38s
[00:24:11.225] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:87:0)
[00:24:11.255] Build status: STARTED
[00:24:11.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:88:0) after 7m35s
[00:31:46.441] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:88:0)
[00:31:46.469] Build status: STARTED
[00:31:46.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:89:0) after 2m41s
[00:34:27.587] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:89:0)
[00:34:27.621] Build status: STARTED
[00:34:27.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:90:0) after 8m19s
[00:42:46.657] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:90:0)
[00:42:46.693] Build status: STARTED
[00:42:46.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:91:0) after 4m39s
[00:47:25.811] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:91:0)
[00:47:25.844] Build status: STARTED
[00:47:25.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:92:0) after 4m22s
[00:51:48.026] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:92:0)
[00:51:48.057] Build status: STARTED
[00:51:48.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:93:0) after 6m16s
[00:58:04.173] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:93:0)
[00:58:04.208] Build status: STARTED
[00:58:04.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:94:0) after 3m33s
[01:01:37.660] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:94:0)
[01:01:37.696] Build status: STARTED
[01:01:37.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:95:0) after 7m16s
[01:08:53.733] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:95:0)
[01:08:53.782] Build status: STARTED
[01:08:53.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:96:0) after 5m24s
[01:14:17.868] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:96:0)
[01:14:17.900] Build status: STARTED
[01:14:17.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:97:0) after 8m45s
[01:23:03.051] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:97:0)
[01:23:03.114] Build status: STARTED
[01:23:03.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:98:0) after 4m42s
[01:27:45.135] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:98:0)
[01:27:45.166] Build status: STARTED
[01:27:45.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:99:0) after 8m59s
[01:36:44.200] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:99:0)
[01:36:44.249] Build status: STARTED
[01:36:44.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:100:0) after 1m1s
[01:37:45.281] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:100:0)
[01:37:45.317] Build status: STARTED
[01:37:45.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:101:0) after 9m46s
[01:47:31.375] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:101:0)
[01:47:31.427] Build status: STARTED
[01:47:31.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:102:0) after 5m27s
[01:52:58.490] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:102:0)
[01:52:58.514] Build status: STARTED
[01:52:58.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:103:0) after 6m45s
[01:59:43.533] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:103:0)
[01:59:43.565] Build status: STARTED
[01:59:43.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:104:0) after 8m53s
[02:08:36.685] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:104:0)
[02:08:36.719] Build status: STARTED
[02:08:36.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:105:0) after 6m13s
[02:14:49.848] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:105:0)
[02:14:49.883] Build status: STARTED
[02:14:49.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:106:0) after 5m57s
[02:20:47.192] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:106:0)
[02:20:47.254] Build status: STARTED
[02:20:47.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:107:0) after 6m10s
[02:26:57.276] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:107:0)
[02:26:57.304] Build status: STARTED
[02:26:57.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:108:0) after 1m53s
[02:28:50.375] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:108:0)
[02:28:50.554] Build status: STARTED
[02:28:50.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:109:0) after 3m1s
[02:31:51.650] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:109:0)
[02:31:51.681] Build status: STARTED
[02:31:51.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:110:0) after 4m22s
[02:36:13.801] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:110:0)
[02:36:13.829] Build status: STARTED
[02:36:13.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:111:0) after 9m12s
[02:45:25.864] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:111:0)
[02:45:25.893] Build status: STARTED
[02:45:25.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:112:0) after 6m52s
[02:52:17.920] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:112:0)
[02:52:17.953] Build status: STARTED
[02:52:17.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:113:0) after 2m32s
[02:54:50.215] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:113:0)
[02:54:50.246] Build status: STARTED
[02:54:50.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:114:0) after 8m0s
[03:02:50.379] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:114:0)
[03:02:50.407] Build status: STARTED
[03:02:50.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:115:0) after 8m33s
[03:11:23.443] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:115:0)
[03:11:23.485] Build status: STARTED
[03:11:23.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:116:0) after 5m23s
[03:16:46.551] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:116:0)
[03:16:46.596] Build status: STARTED
[03:16:46.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9012218642659781584:117:0) after 9m44s
[03:23:57.576] Received PubSub notification, asking Buildbucket for the build status
[03:23:57.625] Build:
{
"id": "8846788580669506384",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 24996,
"createdBy": "project:chromium",
"createTime": "2021-05-19T16:32:50.147783Z",
"startTime": "2021-05-19T16:33:25.036823Z",
"endTime": "2021-05-20T03:23:57.023514008Z",
"updateTime": "2021-05-20T03:23:57.023951041Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7457644df49e6c23062ecab358da62b3fd960c39",
"ref": "refs/heads/master"
}
}
}
[03:23:57.625] Invocation finished in 10h51m8.760246579s with status FAILED