[22:30:53.130] New invocation is queued and will start shortly
[22:30:54.500] Starting the invocation (attempt 1)
[22:30:54.537] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/caa3de38039ac20520570d5fcb0e88843425bf02"
[22:30:54.537] Popped gitiles commit info from properties and tags
[22:30:54.537] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:30:54.537] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:30:54.537] Buildbucket request:
{
"requestId": "8980758967451067248",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "caa3de38039ac20520570d5fcb0e88843425bf02",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8980758967451067248"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:30:55.106] Scheduled build:
{
"id": "8815328905238990497",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26861,
"createdBy": "project:chromium",
"createTime": "2022-05-01T22:30:54.607708558Z",
"updateTime": "2022-05-01T22:30:54.607708558Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "caa3de38039ac20520570d5fcb0e88843425bf02",
"ref": "refs/heads/main"
}
}
}
[22:30:55.106] Task URL: https://cr-buildbucket.appspot.com/build/8815328905238990497
[22:30:55.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:2:0) after 8m50s
[22:39:45.133] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:2:0)
[22:39:45.169] Build status: SCHEDULED
[22:39:45.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:3:0) after 9m21s
[22:49:06.192] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:3:0)
[22:49:06.215] Build status: SCHEDULED
[22:49:06.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:4:0) after 4m42s
[22:53:48.234] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:4:0)
[22:53:48.257] Build status: SCHEDULED
[22:53:48.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:5:0) after 4m24s
[22:58:12.278] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:5:0)
[22:58:12.298] Build status: SCHEDULED
[22:58:12.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:6:0) after 5m53s
[23:04:05.317] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:6:0)
[23:04:05.338] Build status: SCHEDULED
[23:04:05.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:7:0) after 2m30s
[23:06:35.364] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:7:0)
[23:06:35.396] Build status: SCHEDULED
[23:06:35.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:8:0) after 6m52s
[23:13:27.419] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:8:0)
[23:13:27.439] Build status: SCHEDULED
[23:13:27.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:9:0) after 2m12s
[23:15:39.422] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:9:0)
[23:15:39.526] Build status: SCHEDULED
[23:15:39.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:10:0) after 6m2s
[23:17:56.769] Received PubSub notification, asking Buildbucket for the build status
[23:17:56.786] Build status: STARTED
[23:21:41.614] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:10:0)
[23:21:41.636] Build status: STARTED
[23:21:41.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:12:0) after 3m43s
[23:25:24.763] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:12:0)
[23:25:24.786] Build status: STARTED
[23:25:24.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:13:0) after 8m50s
[23:34:14.806] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:13:0)
[23:34:14.848] Build status: STARTED
[23:34:14.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:14:0) after 5m59s
[23:40:13.867] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:14:0)
[23:40:13.959] Build status: STARTED
[23:40:13.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:15:0) after 3m40s
[23:43:53.978] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:15:0)
[23:43:53.998] Build status: STARTED
[23:43:53.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:16:0) after 1m50s
[23:45:44.017] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:16:0)
[23:45:44.063] Build status: STARTED
[23:45:44.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:17:0) after 2m17s
[23:48:01.085] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:17:0)
[23:48:01.105] Build status: STARTED
[23:48:01.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:18:0) after 3m56s
[23:51:57.299] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:18:0)
[23:51:57.381] Build status: STARTED
[23:51:57.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:19:0) after 7m11s
[23:59:08.774] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:19:0)
[23:59:08.812] Build status: STARTED
[23:59:08.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:20:0) after 1m11s
[00:00:20.031] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:20:0)
[00:00:20.073] Build status: STARTED
[00:00:20.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:21:0) after 5m9s
[00:05:29.113] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:21:0)
[00:05:29.164] Build status: STARTED
[00:05:29.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:22:0) after 7m51s
[00:13:20.186] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:22:0)
[00:13:20.231] Build status: STARTED
[00:13:20.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:23:0) after 4m7s
[00:17:27.287] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:23:0)
[00:17:27.307] Build status: STARTED
[00:17:27.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:24:0) after 6m26s
[00:23:53.361] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:24:0)
[00:23:53.388] Build status: STARTED
[00:23:53.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:25:0) after 5m31s
[00:29:24.413] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:25:0)
[00:29:24.444] Build status: STARTED
[00:29:24.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:26:0) after 8m51s
[00:38:15.492] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:26:0)
[00:38:15.522] Build status: STARTED
[00:38:15.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:27:0) after 7m6s
[00:45:21.545] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:27:0)
[00:45:21.580] Build status: STARTED
[00:45:21.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:28:0) after 6m36s
[00:51:57.607] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:28:0)
[00:51:57.637] Build status: STARTED
[00:51:57.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:29:0) after 1m50s
[00:53:47.731] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:29:0)
[00:53:47.762] Build status: STARTED
[00:53:47.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:30:0) after 9m32s
[01:03:19.785] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:30:0)
[01:03:19.817] Build status: STARTED
[01:03:19.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:31:0) after 8m13s
[01:11:32.856] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:31:0)
[01:11:32.878] Build status: STARTED
[01:11:32.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:32:0) after 1m33s
[01:13:05.935] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:32:0)
[01:13:05.972] Build status: STARTED
[01:13:05.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:33:0) after 4m54s
[01:17:59.995] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:33:0)
[01:18:00.018] Build status: STARTED
[01:18:00.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:34:0) after 5m11s
[01:23:11.026] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:34:0)
[01:23:11.049] Build status: STARTED
[01:23:11.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:35:0) after 6m47s
[01:29:58.071] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:35:0)
[01:29:58.104] Build status: STARTED
[01:29:58.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:36:0) after 6m23s
[01:36:21.169] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:36:0)
[01:36:21.199] Build status: STARTED
[01:36:21.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:37:0) after 3m49s
[01:40:10.221] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:37:0)
[01:40:10.263] Build status: STARTED
[01:40:10.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:38:0) after 5m8s
[01:45:18.354] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:38:0)
[01:45:18.375] Build status: STARTED
[01:45:18.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:39:0) after 3m15s
[01:48:33.414] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:39:0)
[01:48:33.457] Build status: STARTED
[01:48:33.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:40:0) after 4m8s
[01:52:41.768] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:40:0)
[01:52:41.789] Build status: STARTED
[01:52:41.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:41:0) after 6m26s
[01:59:07.818] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:41:0)
[01:59:07.843] Build status: STARTED
[01:59:07.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:42:0) after 8m21s
[02:07:29.114] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:42:0)
[02:07:29.162] Build status: STARTED
[02:07:29.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:43:0) after 1m45s
[02:09:14.190] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:43:0)
[02:09:14.259] Build status: STARTED
[02:09:14.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:44:0) after 9m20s
[02:18:34.298] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:44:0)
[02:18:34.328] Build status: STARTED
[02:18:34.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:45:0) after 6m24s
[02:24:58.422] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:45:0)
[02:24:58.458] Build status: STARTED
[02:24:58.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:46:0) after 5m48s
[02:30:46.779] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:46:0)
[02:30:46.813] Build status: STARTED
[02:30:46.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:47:0) after 3m52s
[02:34:38.833] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:47:0)
[02:34:38.858] Build status: STARTED
[02:34:38.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:48:0) after 7m21s
[02:41:59.905] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:48:0)
[02:41:59.960] Build status: STARTED
[02:41:59.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:49:0) after 3m44s
[02:45:43.982] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:49:0)
[02:45:44.004] Build status: STARTED
[02:45:44.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:50:0) after 5m5s
[02:50:49.090] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:50:0)
[02:50:49.109] Build status: STARTED
[02:50:49.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:51:0) after 5m32s
[02:56:21.176] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:51:0)
[02:56:21.196] Build status: STARTED
[02:56:21.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:52:0) after 5m30s
[03:01:51.247] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:52:0)
[03:01:51.277] Build status: STARTED
[03:01:51.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:53:0) after 8m11s
[03:10:02.370] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:53:0)
[03:10:02.395] Build status: STARTED
[03:10:02.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:54:0) after 4m42s
[03:14:44.427] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:54:0)
[03:14:44.461] Build status: STARTED
[03:14:44.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:55:0) after 6m36s
[03:21:21.221] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:55:0)
[03:21:21.246] Build status: STARTED
[03:21:21.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:56:0) after 1m51s
[03:23:12.267] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:56:0)
[03:23:12.303] Build status: STARTED
[03:23:12.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:57:0) after 7m18s
[03:30:30.385] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:57:0)
[03:30:30.408] Build status: STARTED
[03:30:30.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:58:0) after 1m48s
[03:32:18.431] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:58:0)
[03:32:18.458] Build status: STARTED
[03:32:18.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:59:0) after 4m19s
[03:36:37.486] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:59:0)
[03:36:37.528] Build status: STARTED
[03:36:37.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:60:0) after 1m16s
[03:37:53.602] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:60:0)
[03:37:53.639] Build status: STARTED
[03:37:53.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:61:0) after 1m52s
[03:39:45.722] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:61:0)
[03:39:45.751] Build status: STARTED
[03:39:45.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:62:0) after 2m19s
[03:42:04.782] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:62:0)
[03:42:04.816] Build status: STARTED
[03:42:04.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:63:0) after 4m5s
[03:46:09.789] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:63:0)
[03:46:09.811] Build status: STARTED
[03:46:09.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:64:0) after 4m45s
[03:50:54.958] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:64:0)
[03:50:54.983] Build status: STARTED
[03:50:54.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:65:0) after 6m7s
[03:57:02.053] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:65:0)
[03:57:02.080] Build status: STARTED
[03:57:02.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:66:0) after 7m24s
[04:04:26.365] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:66:0)
[04:04:26.471] Build status: STARTED
[04:04:26.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:67:0) after 3m20s
[04:07:46.595] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:67:0)
[04:07:46.641] Build status: STARTED
[04:07:46.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:68:0) after 3m54s
[04:11:40.702] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:68:0)
[04:11:40.725] Build status: STARTED
[04:11:40.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:69:0) after 5m2s
[04:16:42.754] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:69:0)
[04:16:42.777] Build status: STARTED
[04:16:42.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:70:0) after 2m17s
[04:18:59.785] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:70:0)
[04:18:59.830] Build status: STARTED
[04:18:59.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:71:0) after 4m6s
[04:23:06.002] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:71:0)
[04:23:06.046] Build status: STARTED
[04:23:06.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:72:0) after 9m40s
[04:32:46.083] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:72:0)
[04:32:46.561] Build status: STARTED
[04:32:46.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:73:0) after 1m18s
[04:34:04.590] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:73:0)
[04:34:04.612] Build status: STARTED
[04:34:04.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:74:0) after 7m53s
[04:41:57.736] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:74:0)
[04:41:57.758] Build status: STARTED
[04:41:57.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:75:0) after 7m19s
[04:49:16.788] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:75:0)
[04:49:16.809] Build status: STARTED
[04:49:16.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:76:0) after 2m10s
[04:51:26.830] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:76:0)
[04:51:26.885] Build status: STARTED
[04:51:26.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:77:0) after 3m48s
[04:55:14.910] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:77:0)
[04:55:14.937] Build status: STARTED
[04:55:14.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:78:0) after 1m12s
[04:56:26.958] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:78:0)
[04:56:26.993] Build status: STARTED
[04:56:26.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:79:0) after 9m59s
[05:06:26.092] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:79:0)
[05:06:26.113] Build status: STARTED
[05:06:26.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:80:0) after 8m40s
[05:15:06.197] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:80:0)
[05:15:06.228] Build status: STARTED
[05:15:06.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:81:0) after 1m25s
[05:16:31.255] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:81:0)
[05:16:31.327] Build status: STARTED
[05:16:31.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:82:0) after 7m28s
[05:23:59.598] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:82:0)
[05:23:59.647] Build status: STARTED
[05:23:59.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:83:0) after 7m46s
[05:31:45.769] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:83:0)
[05:31:45.796] Build status: STARTED
[05:31:45.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:84:0) after 2m23s
[05:34:08.915] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:84:0)
[05:34:08.935] Build status: STARTED
[05:34:08.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:85:0) after 8m41s
[05:42:49.957] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:85:0)
[05:42:49.981] Build status: STARTED
[05:42:49.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:86:0) after 2m16s
[05:45:06.051] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:86:0)
[05:45:06.076] Build status: STARTED
[05:45:06.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:87:0) after 8m0s
[05:53:06.178] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:87:0)
[05:53:06.227] Build status: STARTED
[05:53:06.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:88:0) after 8m47s
[06:01:53.517] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:88:0)
[06:01:53.538] Build status: STARTED
[06:01:53.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:89:0) after 6m2s
[06:07:55.564] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:89:0)
[06:07:55.587] Build status: STARTED
[06:07:55.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:90:0) after 1m39s
[06:09:34.609] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:90:0)
[06:09:34.628] Build status: STARTED
[06:09:34.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:91:0) after 1m3s
[06:10:38.018] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:91:0)
[06:10:38.043] Build status: STARTED
[06:10:38.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:92:0) after 5m18s
[06:15:56.067] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:92:0)
[06:15:56.091] Build status: STARTED
[06:15:56.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:93:0) after 2m43s
[06:18:39.122] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:93:0)
[06:18:39.145] Build status: STARTED
[06:18:39.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:94:0) after 1m18s
[06:19:57.216] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:94:0)
[06:19:57.253] Build status: STARTED
[06:19:57.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:95:0) after 5m55s
[06:25:52.689] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:95:0)
[06:25:52.745] Build status: STARTED
[06:25:52.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:96:0) after 5m57s
[06:31:49.805] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:96:0)
[06:31:49.828] Build status: STARTED
[06:31:49.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:97:0) after 8m17s
[06:40:06.940] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:97:0)
[06:40:07.028] Build status: STARTED
[06:40:07.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:98:0) after 9m43s
[06:49:50.056] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:98:0)
[06:49:50.147] Build status: STARTED
[06:49:50.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:99:0) after 7m0s
[06:56:50.165] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:99:0)
[06:56:50.214] Build status: STARTED
[06:56:50.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:100:0) after 5m39s
[07:02:29.338] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:100:0)
[07:02:29.360] Build status: STARTED
[07:02:29.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:101:0) after 8m24s
[07:10:53.379] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:101:0)
[07:10:53.422] Build status: STARTED
[07:10:53.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:102:0) after 6m37s
[07:17:30.444] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:102:0)
[07:17:30.466] Build status: STARTED
[07:17:30.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:103:0) after 9m40s
[07:27:10.507] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:103:0)
[07:27:10.530] Build status: STARTED
[07:27:10.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:104:0) after 6m28s
[07:33:38.678] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:104:0)
[07:33:38.699] Build status: STARTED
[07:33:38.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:105:0) after 3m9s
[07:36:48.068] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:105:0)
[07:36:48.110] Build status: STARTED
[07:36:48.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:106:0) after 9m59s
[07:46:47.132] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:106:0)
[07:46:47.152] Build status: STARTED
[07:46:47.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:107:0) after 7m56s
[07:54:43.178] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:107:0)
[07:54:43.200] Build status: STARTED
[07:54:43.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:108:0) after 9m28s
[08:04:11.227] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:108:0)
[08:04:11.296] Build status: STARTED
[08:04:11.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:109:0) after 4m14s
[08:08:25.698] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:109:0)
[08:08:25.720] Build status: STARTED
[08:08:25.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:110:0) after 9m46s
[08:18:11.967] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:110:0)
[08:18:11.991] Build status: STARTED
[08:18:11.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:111:0) after 9m18s
[08:27:30.056] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:111:0)
[08:27:30.103] Build status: STARTED
[08:27:30.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:112:0) after 9m52s
[08:37:22.691] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:112:0)
[08:37:22.711] Build status: STARTED
[08:37:22.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:113:0) after 6m47s
[08:44:09.747] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:113:0)
[08:44:09.792] Build status: STARTED
[08:44:09.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:114:0) after 1m20s
[08:45:29.842] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:114:0)
[08:45:29.868] Build status: STARTED
[08:45:29.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:115:0) after 3m58s
[08:49:27.892] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:115:0)
[08:49:27.916] Build status: STARTED
[08:49:27.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:116:0) after 2m42s
[08:52:09.996] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:116:0)
[08:52:10.021] Build status: STARTED
[08:52:10.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:117:0) after 1m32s
[08:53:42.048] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:117:0)
[08:53:42.079] Build status: STARTED
[08:53:42.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:118:0) after 7m42s
[09:01:24.100] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:118:0)
[09:01:24.125] Build status: STARTED
[09:01:24.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:119:0) after 6m5s
[09:07:29.147] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:119:0)
[09:07:29.169] Build status: STARTED
[09:07:29.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:120:0) after 9m58s
[09:17:27.438] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:120:0)
[09:17:27.468] Build status: STARTED
[09:17:27.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:121:0) after 8m21s
[09:25:48.488] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:121:0)
[09:25:48.517] Build status: STARTED
[09:25:48.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:122:0) after 6m7s
[09:31:55.539] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:122:0)
[09:31:55.589] Build status: STARTED
[09:31:55.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:123:0) after 8m57s
[09:40:52.614] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:123:0)
[09:40:52.638] Build status: STARTED
[09:40:52.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:124:0) after 3m29s
[09:44:21.797] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:124:0)
[09:44:21.834] Build status: STARTED
[09:44:21.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:125:0) after 2m44s
[09:47:05.855] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:125:0)
[09:47:05.880] Build status: STARTED
[09:47:05.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:126:0) after 8m58s
[09:56:03.899] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:126:0)
[09:56:03.942] Build status: STARTED
[09:56:03.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:127:0) after 8m40s
[10:04:44.388] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:127:0)
[10:04:44.410] Build status: STARTED
[10:04:44.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:128:0) after 2m2s
[10:06:46.594] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:128:0)
[10:06:46.629] Build status: STARTED
[10:06:46.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8980758967451067248:129:0) after 8m36s
[10:10:45.136] Received PubSub notification, asking Buildbucket for the build status
[10:10:45.164] Build:
{
"id": "8815328905238990497",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26861,
"createdBy": "project:chromium",
"createTime": "2022-05-01T22:30:54.607708558Z",
"startTime": "2022-05-01T23:17:56.224517Z",
"endTime": "2022-05-02T10:10:44.816259537Z",
"updateTime": "2022-05-02T10:10:44.816259537Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "caa3de38039ac20520570d5fcb0e88843425bf02",
"ref": "refs/heads/main"
}
}
}
[10:10:45.164] Invocation finished in 11h39m52.050009289s with status FAILED