[21:52:30.783] New invocation is queued and will start shortly
[21:52:36.590] Starting the invocation (attempt 1)
[21:52:36.632] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/8c8af34fd95369c01fa10d84ad5e8b34c60d1028"
[21:52:36.632] Popped gitiles commit info from properties and tags
[21:52:36.632] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:52:36.632] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:52:36.632] Buildbucket request:
{
"requestId": "8963819748926999408",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8c8af34fd95369c01fa10d84ad5e8b34c60d1028",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8963819748926999408"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:52:37.255] Scheduled build:
{
"id": "8798389681990050433",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 28366,
"createdBy": "project:chromium",
"createTime": "2022-11-04T21:52:36.760390998Z",
"updateTime": "2022-11-04T21:52:36.760390998Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8c8af34fd95369c01fa10d84ad5e8b34c60d1028",
"ref": "refs/heads/main"
}
}
}
[21:52:37.255] Task URL: https://cr-buildbucket.appspot.com/build/8798389681990050433
[21:52:37.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:2:0) after 2m46s
[21:55:23.417] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:2:0)
[21:55:23.441] Build status: SCHEDULED
[21:55:23.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:3:0) after 2m14s
[21:55:25.847] Received PubSub notification, asking Buildbucket for the build status
[21:55:25.872] Build status: STARTED
[21:57:37.444] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:3:0)
[21:57:37.482] Build status: STARTED
[21:57:37.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:5:0) after 5m55s
[22:03:32.573] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:5:0)
[22:03:32.599] Build status: STARTED
[22:03:32.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:6:0) after 1m47s
[22:05:19.630] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:6:0)
[22:05:19.655] Build status: STARTED
[22:05:19.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:7:0) after 1m42s
[22:07:01.947] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:7:0)
[22:07:01.978] Build status: STARTED
[22:07:01.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:8:0) after 3m19s
[22:10:21.100] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:8:0)
[22:10:21.133] Build status: STARTED
[22:10:21.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:9:0) after 5m43s
[22:16:04.167] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:9:0)
[22:16:04.226] Build status: STARTED
[22:16:04.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:10:0) after 4m35s
[22:20:39.273] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:10:0)
[22:20:39.386] Build status: STARTED
[22:20:39.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:11:0) after 3m26s
[22:24:05.410] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:11:0)
[22:24:05.448] Build status: STARTED
[22:24:05.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:12:0) after 9m16s
[22:33:21.482] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:12:0)
[22:33:21.519] Build status: STARTED
[22:33:21.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:13:0) after 7m48s
[22:41:09.543] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:13:0)
[22:41:09.566] Build status: STARTED
[22:41:09.566] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:14:0) after 5m50s
[22:46:59.639] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:14:0)
[22:46:59.659] Build status: STARTED
[22:46:59.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:15:0) after 6m5s
[22:53:04.785] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:15:0)
[22:53:04.816] Build status: STARTED
[22:53:04.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:16:0) after 3m51s
[22:56:55.860] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:16:0)
[22:56:55.883] Build status: STARTED
[22:56:55.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:17:0) after 4m1s
[23:00:57.172] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:17:0)
[23:00:57.197] Build status: STARTED
[23:00:57.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:18:0) after 4m35s
[23:05:32.218] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:18:0)
[23:05:32.242] Build status: STARTED
[23:05:32.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:19:0) after 7m36s
[23:13:08.502] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:19:0)
[23:13:08.526] Build status: STARTED
[23:13:08.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:20:0) after 7m58s
[23:21:06.724] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:20:0)
[23:21:06.746] Build status: STARTED
[23:21:06.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:21:0) after 5m54s
[23:27:00.781] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:21:0)
[23:27:00.830] Build status: STARTED
[23:27:00.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:22:0) after 4m56s
[23:31:56.980] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:22:0)
[23:31:57.001] Build status: STARTED
[23:31:57.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:23:0) after 8m7s
[23:40:04.158] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:23:0)
[23:40:04.320] Build status: STARTED
[23:40:04.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:24:0) after 9m33s
[23:49:37.351] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:24:0)
[23:49:37.375] Build status: STARTED
[23:49:37.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:25:0) after 2m18s
[23:51:55.384] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:25:0)
[23:51:55.414] Build status: STARTED
[23:51:55.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:26:0) after 8m48s
[00:00:43.447] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:26:0)
[00:00:43.471] Build status: STARTED
[00:00:43.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:27:0) after 3m34s
[00:04:17.800] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:27:0)
[00:04:17.863] Build status: STARTED
[00:04:17.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:28:0) after 5m58s
[00:10:15.942] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:28:0)
[00:10:15.972] Build status: STARTED
[00:10:15.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:29:0) after 8m41s
[00:18:57.009] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:29:0)
[00:18:57.040] Build status: STARTED
[00:18:57.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:30:0) after 8m31s
[00:27:28.066] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:30:0)
[00:27:28.104] Build status: STARTED
[00:27:28.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:31:0) after 3m32s
[00:31:00.170] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:31:0)
[00:31:00.195] Build status: STARTED
[00:31:00.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:32:0) after 6m47s
[00:37:47.692] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:32:0)
[00:37:47.717] Build status: STARTED
[00:37:47.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:33:0) after 2m47s
[00:40:34.740] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:33:0)
[00:40:34.766] Build status: STARTED
[00:40:34.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:34:0) after 7m49s
[00:48:23.792] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:34:0)
[00:48:23.817] Build status: STARTED
[00:48:23.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:35:0) after 4m47s
[00:53:10.996] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:35:0)
[00:53:11.049] Build status: STARTED
[00:53:11.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:36:0) after 2m24s
[00:55:35.311] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:36:0)
[00:55:35.348] Build status: STARTED
[00:55:35.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:37:0) after 8m33s
[01:04:08.619] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:37:0)
[01:04:08.644] Build status: STARTED
[01:04:08.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:38:0) after 4m7s
[01:08:16.024] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:38:0)
[01:08:16.048] Build status: STARTED
[01:08:16.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:39:0) after 4m28s
[01:12:44.076] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:39:0)
[01:12:44.112] Build status: STARTED
[01:12:44.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:40:0) after 6m44s
[01:19:28.371] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:40:0)
[01:19:28.485] Build status: STARTED
[01:19:28.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:41:0) after 8m10s
[01:27:38.700] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:41:0)
[01:27:38.721] Build status: STARTED
[01:27:38.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:42:0) after 7m11s
[01:34:49.814] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:42:0)
[01:34:49.836] Build status: STARTED
[01:34:49.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:43:0) after 8m54s
[01:43:43.838] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:43:0)
[01:43:43.876] Build status: STARTED
[01:43:43.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:44:0) after 7m35s
[01:51:19.100] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:44:0)
[01:51:19.132] Build status: STARTED
[01:51:19.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:45:0) after 6m59s
[01:58:18.162] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:45:0)
[01:58:18.187] Build status: STARTED
[01:58:18.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:46:0) after 6m53s
[02:05:11.225] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:46:0)
[02:05:11.270] Build status: STARTED
[02:05:11.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:47:0) after 6m52s
[02:12:03.317] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:47:0)
[02:12:03.339] Build status: STARTED
[02:12:03.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:48:0) after 9m39s
[02:21:42.441] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:48:0)
[02:21:42.479] Build status: STARTED
[02:21:42.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:49:0) after 3m55s
[02:25:37.699] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:49:0)
[02:25:37.722] Build status: STARTED
[02:25:37.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:50:0) after 3m6s
[02:28:43.947] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:50:0)
[02:28:43.974] Build status: STARTED
[02:28:43.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:51:0) after 8m59s
[02:37:43.175] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:51:0)
[02:37:43.213] Build status: STARTED
[02:37:43.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:52:0) after 5m58s
[02:43:41.238] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:52:0)
[02:43:41.260] Build status: STARTED
[02:43:41.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:53:0) after 4m56s
[02:48:37.287] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:53:0)
[02:48:37.309] Build status: STARTED
[02:48:37.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:54:0) after 2m54s
[02:51:31.421] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:54:0)
[02:51:31.446] Build status: STARTED
[02:51:31.446] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:55:0) after 1m39s
[02:53:10.603] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:55:0)
[02:53:10.631] Build status: STARTED
[02:53:10.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:56:0) after 1m13s
[02:54:23.699] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:56:0)
[02:54:23.723] Build status: STARTED
[02:54:23.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:57:0) after 1m47s
[02:56:10.761] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:57:0)
[02:56:10.782] Build status: STARTED
[02:56:10.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:58:0) after 1m4s
[02:57:14.917] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:58:0)
[02:57:14.997] Build status: STARTED
[02:57:14.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:59:0) after 7m13s
[03:04:28.120] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:59:0)
[03:04:28.145] Build status: STARTED
[03:04:28.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:60:0) after 2m34s
[03:07:02.174] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:60:0)
[03:07:02.196] Build status: STARTED
[03:07:02.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:61:0) after 9m8s
[03:16:10.655] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:61:0)
[03:16:10.679] Build status: STARTED
[03:16:10.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:62:0) after 3m1s
[03:19:11.710] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:62:0)
[03:19:11.747] Build status: STARTED
[03:19:11.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:63:0) after 8m40s
[03:27:51.846] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:63:0)
[03:27:51.955] Build status: STARTED
[03:27:51.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:64:0) after 1m45s
[03:29:36.977] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:64:0)
[03:29:36.999] Build status: STARTED
[03:29:37.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:65:0) after 2m42s
[03:32:19.106] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:65:0)
[03:32:19.131] Build status: STARTED
[03:32:19.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:66:0) after 5m9s
[03:37:28.260] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:66:0)
[03:37:28.295] Build status: STARTED
[03:37:28.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:67:0) after 2m42s
[03:40:10.613] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:67:0)
[03:40:10.640] Build status: STARTED
[03:40:10.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:68:0) after 8m9s
[03:48:19.672] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:68:0)
[03:48:19.705] Build status: STARTED
[03:48:19.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:69:0) after 1m0s
[03:49:19.740] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:69:0)
[03:49:19.762] Build status: STARTED
[03:49:19.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:70:0) after 9m36s
[03:58:55.786] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:70:0)
[03:58:55.807] Build status: STARTED
[03:58:55.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:71:0) after 4m11s
[04:03:06.832] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:71:0)
[04:03:06.855] Build status: STARTED
[04:03:06.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:72:0) after 3m10s
[04:06:17.052] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:72:0)
[04:06:17.078] Build status: STARTED
[04:06:17.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:73:0) after 9m39s
[04:15:56.156] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:73:0)
[04:15:56.177] Build status: STARTED
[04:15:56.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:74:0) after 4m42s
[04:20:38.226] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:74:0)
[04:20:38.250] Build status: STARTED
[04:20:38.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:75:0) after 4m10s
[04:24:48.324] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:75:0)
[04:24:48.348] Build status: STARTED
[04:24:48.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:76:0) after 8m26s
[04:33:14.513] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:76:0)
[04:33:14.534] Build status: STARTED
[04:33:14.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:77:0) after 5m28s
[04:38:42.667] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:77:0)
[04:38:42.692] Build status: STARTED
[04:38:42.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:78:0) after 6m1s
[04:44:43.959] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:78:0)
[04:44:43.982] Build status: STARTED
[04:44:43.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:79:0) after 9m33s
[04:54:17.107] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:79:0)
[04:54:17.134] Build status: STARTED
[04:54:17.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:80:0) after 9m52s
[05:04:09.387] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:80:0)
[05:04:09.412] Build status: STARTED
[05:04:09.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:81:0) after 6m16s
[05:10:25.398] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:81:0)
[05:10:25.428] Build status: STARTED
[05:10:25.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:82:0) after 9m47s
[05:20:12.467] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:82:0)
[05:20:12.488] Build status: STARTED
[05:20:12.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:83:0) after 5m19s
[05:25:31.574] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:83:0)
[05:25:31.598] Build status: STARTED
[05:25:31.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:84:0) after 2m14s
[05:27:45.733] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:84:0)
[05:27:45.765] Build status: STARTED
[05:27:45.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:85:0) after 6m28s
[05:34:13.953] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:85:0)
[05:34:13.999] Build status: STARTED
[05:34:14.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:86:0) after 8m0s
[05:42:14.126] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:86:0)
[05:42:14.170] Build status: STARTED
[05:42:14.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:87:0) after 9m50s
[05:52:04.195] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:87:0)
[05:52:04.218] Build status: STARTED
[05:52:04.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:88:0) after 6m31s
[05:58:35.280] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:88:0)
[05:58:35.310] Build status: STARTED
[05:58:35.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:89:0) after 2m20s
[06:00:55.572] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:89:0)
[06:00:55.599] Build status: STARTED
[06:00:55.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:90:0) after 2m39s
[06:03:34.634] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:90:0)
[06:03:34.665] Build status: STARTED
[06:03:34.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:91:0) after 7m26s
[06:11:00.691] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:91:0)
[06:11:00.718] Build status: STARTED
[06:11:00.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:92:0) after 3m10s
[06:14:10.742] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:92:0)
[06:14:10.766] Build status: STARTED
[06:14:10.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:93:0) after 8m17s
[06:22:27.817] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:93:0)
[06:22:27.839] Build status: STARTED
[06:22:27.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:94:0) after 8m19s
[06:30:46.891] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:94:0)
[06:30:46.917] Build status: STARTED
[06:30:46.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:95:0) after 4m42s
[06:35:28.952] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:95:0)
[06:35:28.986] Build status: STARTED
[06:35:28.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:96:0) after 7m14s
[06:42:43.047] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:96:0)
[06:42:43.069] Build status: STARTED
[06:42:43.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:97:0) after 6m45s
[06:49:28.102] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:97:0)
[06:49:28.125] Build status: STARTED
[06:49:28.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:98:0) after 7m11s
[06:56:39.155] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:98:0)
[06:56:39.180] Build status: STARTED
[06:56:39.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:99:0) after 5m29s
[07:02:08.212] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:99:0)
[07:02:08.240] Build status: STARTED
[07:02:08.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:100:0) after 2m36s
[07:04:44.264] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:100:0)
[07:04:44.301] Build status: STARTED
[07:04:44.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:101:0) after 5m21s
[07:10:05.331] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:101:0)
[07:10:05.367] Build status: STARTED
[07:10:05.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:102:0) after 9m4s
[07:19:09.406] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:102:0)
[07:19:09.429] Build status: STARTED
[07:19:09.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:103:0) after 1m57s
[07:21:06.529] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:103:0)
[07:21:06.551] Build status: STARTED
[07:21:06.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:104:0) after 2m22s
[07:23:28.631] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:104:0)
[07:23:28.657] Build status: STARTED
[07:23:28.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:105:0) after 1m57s
[07:25:25.778] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:105:0)
[07:25:25.802] Build status: STARTED
[07:25:25.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:106:0) after 4m33s
[07:29:58.835] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:106:0)
[07:29:58.859] Build status: STARTED
[07:29:58.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:107:0) after 2m22s
[07:32:20.977] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:107:0)
[07:32:21.003] Build status: STARTED
[07:32:21.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:108:0) after 9m54s
[07:42:15.026] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:108:0)
[07:42:15.061] Build status: STARTED
[07:42:15.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:109:0) after 6m29s
[07:48:44.299] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:109:0)
[07:48:44.325] Build status: STARTED
[07:48:44.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:110:0) after 2m3s
[07:50:47.405] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:110:0)
[07:50:47.431] Build status: STARTED
[07:50:47.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:111:0) after 3m23s
[07:54:10.502] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:111:0)
[07:54:10.540] Build status: STARTED
[07:54:10.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:112:0) after 9m26s
[08:03:36.763] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:112:0)
[08:03:36.786] Build status: STARTED
[08:03:36.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:113:0) after 7m30s
[08:11:06.813] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:113:0)
[08:11:06.839] Build status: STARTED
[08:11:06.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:114:0) after 5m20s
[08:16:26.869] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:114:0)
[08:16:26.893] Build status: STARTED
[08:16:26.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:115:0) after 5m15s
[08:21:41.916] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:115:0)
[08:21:41.945] Build status: STARTED
[08:21:41.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:116:0) after 9m41s
[08:31:23.065] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:116:0)
[08:31:23.111] Build status: STARTED
[08:31:23.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:117:0) after 9m36s
[08:40:59.366] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:117:0)
[08:40:59.389] Build status: STARTED
[08:40:59.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:118:0) after 8m7s
[08:49:06.483] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:118:0)
[08:49:06.510] Build status: STARTED
[08:49:06.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:119:0) after 8m13s
[08:57:19.537] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:119:0)
[08:57:19.566] Build status: STARTED
[08:57:19.566] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:120:0) after 1m35s
[08:58:54.588] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:120:0)
[08:58:54.613] Build status: STARTED
[08:58:54.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:121:0) after 5m11s
[09:04:05.776] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:121:0)
[09:04:05.805] Build status: STARTED
[09:04:05.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:122:0) after 7m48s
[09:11:53.833] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:122:0)
[09:11:53.901] Build status: STARTED
[09:11:53.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:123:0) after 4m33s
[09:16:27.013] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:123:0)
[09:16:27.040] Build status: STARTED
[09:16:27.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:124:0) after 4m42s
[09:21:09.139] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:124:0)
[09:21:09.164] Build status: STARTED
[09:21:09.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:125:0) after 3m32s
[09:24:41.194] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:125:0)
[09:24:41.214] Build status: STARTED
[09:24:41.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:126:0) after 6m6s
[09:30:47.244] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:126:0)
[09:30:47.270] Build status: STARTED
[09:30:47.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:127:0) after 3m12s
[09:33:59.295] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:127:0)
[09:33:59.324] Build status: STARTED
[09:33:59.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:128:0) after 2m28s
[09:36:27.353] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:128:0)
[09:36:27.387] Build status: STARTED
[09:36:27.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:129:0) after 4m43s
[09:41:10.410] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:129:0)
[09:41:10.436] Build status: STARTED
[09:41:10.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:130:0) after 4m21s
[09:45:31.465] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:130:0)
[09:45:31.505] Build status: STARTED
[09:45:31.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:131:0) after 1m31s
[09:47:02.543] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:131:0)
[09:47:02.566] Build status: STARTED
[09:47:02.566] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:132:0) after 9m53s
[09:56:55.594] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:132:0)
[09:56:55.619] Build status: STARTED
[09:56:55.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:133:0) after 2m57s
[09:59:52.651] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:133:0)
[09:59:52.674] Build status: STARTED
[09:59:52.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:134:0) after 9m32s
[10:09:24.697] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:134:0)
[10:09:24.723] Build status: STARTED
[10:09:24.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:135:0) after 3m30s
[10:12:54.975] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:135:0)
[10:12:54.999] Build status: STARTED
[10:12:54.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:136:0) after 2m26s
[10:15:21.024] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:136:0)
[10:15:21.050] Build status: STARTED
[10:15:21.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:137:0) after 4m45s
[10:20:06.098] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:137:0)
[10:20:06.121] Build status: STARTED
[10:20:06.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:138:0) after 7m56s
[10:28:02.270] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:138:0)
[10:28:02.370] Build status: STARTED
[10:28:02.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:139:0) after 6m45s
[10:34:47.401] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:139:0)
[10:34:47.428] Build status: STARTED
[10:34:47.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:140:0) after 1m41s
[10:36:28.467] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:140:0)
[10:36:28.494] Build status: STARTED
[10:36:28.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:141:0) after 8m55s
[10:45:23.603] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:141:0)
[10:45:23.625] Build status: STARTED
[10:45:23.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:142:0) after 1m2s
[10:46:25.655] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:142:0)
[10:46:25.679] Build status: STARTED
[10:46:25.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:143:0) after 5m54s
[10:52:19.885] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:143:0)
[10:52:19.910] Build status: STARTED
[10:52:19.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:144:0) after 9m5s
[11:01:24.940] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:144:0)
[11:01:24.961] Build status: STARTED
[11:01:24.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:145:0) after 9m33s
[11:10:57.982] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:145:0)
[11:10:58.011] Build status: STARTED
[11:10:58.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:146:0) after 4m56s
[11:15:54.064] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:146:0)
[11:15:54.182] Build status: STARTED
[11:15:54.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8963819748926999408:147:0) after 1m42s
[11:16:53.084] Received PubSub notification, asking Buildbucket for the build status
[11:16:53.109] Build:
{
"id": "8798389681990050433",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 28366,
"createdBy": "project:chromium",
"createTime": "2022-11-04T21:52:36.760390998Z",
"startTime": "2022-11-04T21:55:25.304465Z",
"endTime": "2022-11-05T11:16:52.513874681Z",
"updateTime": "2022-11-05T11:16:52.513874681Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8c8af34fd95369c01fa10d84ad5e8b34c60d1028",
"ref": "refs/heads/main"
}
}
}
[11:16:53.109] Invocation finished in 13h24m22.347557035s with status FAILED