[21:11:52.794] New invocation is queued and will start shortly
[21:11:53.971] Starting the invocation (attempt 1)
[21:11:54.007] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/8a2187bbdac0d89a741ebf79e7fd6120eb957629"
[21:11:54.007] Popped gitiles commit info from properties and tags
[21:11:54.007] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:11:54.008] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:11:54.008] Buildbucket request:
{
"requestId": "8992360349752252560",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8a2187bbdac0d89a741ebf79e7fd6120eb957629",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8992360349752252560"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:11:54.663] Scheduled build:
{
"id": "8826930287751393969",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 15096,
"createdBy": "project:chromium",
"createTime": "2021-12-24T21:11:54.071098849Z",
"updateTime": "2021-12-24T21:11:54.071098849Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8a2187bbdac0d89a741ebf79e7fd6120eb957629",
"ref": "refs/heads/main"
}
},
"canary": true
}
[21:11:54.663] Task URL: https://cr-buildbucket.appspot.com/build/8826930287751393969
[21:11:54.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:2:0) after 2m24s
[21:11:58.030] Received PubSub notification, asking Buildbucket for the build status
[21:11:58.057] Build status: STARTED
[21:14:18.678] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:2:0)
[21:14:18.694] Build status: STARTED
[21:14:18.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:4:0) after 4m51s
[21:19:09.716] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:4:0)
[21:19:09.756] Build status: STARTED
[21:19:09.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:5:0) after 1m51s
[21:21:01.031] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:5:0)
[21:21:01.147] Build status: STARTED
[21:21:01.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:6:0) after 1m53s
[21:22:54.672] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:6:0)
[21:22:54.690] Build status: STARTED
[21:22:54.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:7:0) after 8m20s
[21:31:14.710] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:7:0)
[21:31:14.726] Build status: STARTED
[21:31:14.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:8:0) after 7m22s
[21:38:37.205] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:8:0)
[21:38:37.239] Build status: STARTED
[21:38:37.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:9:0) after 7m18s
[21:45:55.455] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:9:0)
[21:45:55.499] Build status: STARTED
[21:45:55.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:10:0) after 1m36s
[21:47:32.008] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:10:0)
[21:47:32.032] Build status: STARTED
[21:47:32.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:11:0) after 2m2s
[21:49:34.049] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:11:0)
[21:49:34.066] Build status: STARTED
[21:49:34.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:12:0) after 1m30s
[21:51:04.580] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:12:0)
[21:51:04.599] Build status: STARTED
[21:51:04.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:13:0) after 9m39s
[22:00:44.094] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:13:0)
[22:00:44.116] Build status: STARTED
[22:00:44.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:14:0) after 4m56s
[22:05:40.157] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:14:0)
[22:05:40.179] Build status: STARTED
[22:05:40.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:15:0) after 9m17s
[22:14:57.349] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:15:0)
[22:14:57.367] Build status: STARTED
[22:14:57.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:16:0) after 6m43s
[22:21:40.598] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:16:0)
[22:21:40.631] Build status: STARTED
[22:21:40.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:17:0) after 4m55s
[22:26:35.828] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:17:0)
[22:26:35.846] Build status: STARTED
[22:26:35.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:18:0) after 4m13s
[22:30:48.865] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:18:0)
[22:30:48.899] Build status: STARTED
[22:30:48.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:19:0) after 2m12s
[22:33:00.925] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:19:0)
[22:33:00.954] Build status: STARTED
[22:33:00.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:20:0) after 6m14s
[22:39:15.008] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:20:0)
[22:39:15.028] Build status: STARTED
[22:39:15.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:21:0) after 1m10s
[22:40:25.045] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:21:0)
[22:40:25.066] Build status: STARTED
[22:40:25.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:22:0) after 4m48s
[22:45:13.169] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:22:0)
[22:45:13.205] Build status: STARTED
[22:45:13.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:23:0) after 3m18s
[22:48:31.347] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:23:0)
[22:48:31.372] Build status: STARTED
[22:48:31.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:24:0) after 7m45s
[22:56:16.393] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:24:0)
[22:56:16.413] Build status: STARTED
[22:56:16.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:25:0) after 3m40s
[22:59:56.433] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:25:0)
[22:59:56.460] Build status: STARTED
[22:59:56.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:26:0) after 7m27s
[23:07:24.025] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:26:0)
[23:07:24.046] Build status: STARTED
[23:07:24.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:27:0) after 2m12s
[23:09:36.363] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:27:0)
[23:09:36.412] Build status: STARTED
[23:09:36.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:28:0) after 9m27s
[23:19:03.430] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:28:0)
[23:19:03.448] Build status: STARTED
[23:19:03.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:29:0) after 9m19s
[23:28:22.569] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:29:0)
[23:28:22.604] Build status: STARTED
[23:28:22.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:30:0) after 9m38s
[23:38:00.673] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:30:0)
[23:38:00.698] Build status: STARTED
[23:38:00.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:31:0) after 8m16s
[23:46:17.066] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:31:0)
[23:46:17.094] Build status: STARTED
[23:46:17.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:32:0) after 2m58s
[23:49:15.113] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:32:0)
[23:49:15.179] Build status: STARTED
[23:49:15.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:33:0) after 7m17s
[23:56:32.696] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:33:0)
[23:56:32.741] Build status: STARTED
[23:56:32.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:34:0) after 4m49s
[00:01:21.944] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:34:0)
[00:01:21.967] Build status: STARTED
[00:01:21.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:35:0) after 2m25s
[00:03:47.263] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:35:0)
[00:03:47.298] Build status: STARTED
[00:03:47.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:36:0) after 8m3s
[00:11:50.318] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:36:0)
[00:11:50.346] Build status: STARTED
[00:11:50.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:37:0) after 4m18s
[00:16:09.086] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:37:0)
[00:16:09.113] Build status: STARTED
[00:16:09.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:38:0) after 7m38s
[00:23:47.776] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:38:0)
[00:23:47.801] Build status: STARTED
[00:23:47.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:39:0) after 6m52s
[00:30:40.023] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:39:0)
[00:30:40.055] Build status: STARTED
[00:30:40.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:40:0) after 7m58s
[00:38:38.075] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:40:0)
[00:38:38.097] Build status: STARTED
[00:38:38.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:41:0) after 7m45s
[00:46:23.211] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:41:0)
[00:46:23.260] Build status: STARTED
[00:46:23.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:42:0) after 6m38s
[00:53:01.429] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:42:0)
[00:53:01.464] Build status: STARTED
[00:53:01.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:43:0) after 8m32s
[01:01:33.486] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:43:0)
[01:01:33.505] Build status: STARTED
[01:01:33.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:44:0) after 7m33s
[01:09:06.643] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:44:0)
[01:09:06.664] Build status: STARTED
[01:09:06.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:45:0) after 4m14s
[01:13:20.888] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:45:0)
[01:13:20.907] Build status: STARTED
[01:13:20.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:46:0) after 8m31s
[01:21:51.932] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:46:0)
[01:21:51.954] Build status: STARTED
[01:21:51.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:47:0) after 1m39s
[01:23:30.975] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:47:0)
[01:23:31.047] Build status: STARTED
[01:23:31.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:48:0) after 7m57s
[01:31:28.069] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:48:0)
[01:31:28.101] Build status: STARTED
[01:31:28.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:49:0) after 4m33s
[01:36:01.182] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:49:0)
[01:36:01.224] Build status: STARTED
[01:36:01.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:50:0) after 4m26s
[01:40:27.247] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:50:0)
[01:40:27.273] Build status: STARTED
[01:40:27.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:51:0) after 2m35s
[01:43:02.294] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:51:0)
[01:43:02.315] Build status: STARTED
[01:43:02.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:52:0) after 4m14s
[01:47:17.588] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:52:0)
[01:47:17.750] Build status: STARTED
[01:47:17.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:53:0) after 2m42s
[01:49:59.777] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:53:0)
[01:49:59.800] Build status: STARTED
[01:49:59.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:54:0) after 7m46s
[01:57:46.142] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:54:0)
[01:57:46.160] Build status: STARTED
[01:57:46.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:55:0) after 8m55s
[02:06:41.183] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:55:0)
[02:06:41.203] Build status: STARTED
[02:06:41.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:56:0) after 4m26s
[02:11:07.322] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:56:0)
[02:11:07.338] Build status: STARTED
[02:11:07.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:57:0) after 4m2s
[02:15:09.496] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:57:0)
[02:15:09.528] Build status: STARTED
[02:15:09.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:58:0) after 6m13s
[02:21:22.888] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:58:0)
[02:21:22.909] Build status: STARTED
[02:21:22.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:59:0) after 1m38s
[02:23:00.926] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:59:0)
[02:23:00.942] Build status: STARTED
[02:23:00.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:60:0) after 2m47s
[02:25:48.581] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:60:0)
[02:25:48.599] Build status: STARTED
[02:25:48.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:61:0) after 5m35s
[02:31:23.751] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:61:0)
[02:31:23.768] Build status: STARTED
[02:31:23.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:62:0) after 9m18s
[02:40:41.807] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:62:0)
[02:40:41.838] Build status: STARTED
[02:40:41.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:63:0) after 9m12s
[02:49:53.985] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:63:0)
[02:49:54.015] Build status: STARTED
[02:49:54.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:64:0) after 3m5s
[02:52:59.033] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:64:0)
[02:52:59.052] Build status: STARTED
[02:52:59.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:65:0) after 1m48s
[02:54:47.273] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:65:0)
[02:54:47.302] Build status: STARTED
[02:54:47.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:66:0) after 4m36s
[02:59:23.650] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:66:0)
[02:59:23.670] Build status: STARTED
[02:59:23.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:67:0) after 5m48s
[03:05:11.697] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:67:0)
[03:05:11.733] Build status: STARTED
[03:05:11.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:68:0) after 7m28s
[03:12:39.789] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:68:0)
[03:12:39.851] Build status: STARTED
[03:12:39.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:69:0) after 7m2s
[03:19:41.885] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:69:0)
[03:19:41.901] Build status: STARTED
[03:19:41.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:70:0) after 4m28s
[03:24:10.277] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:70:0)
[03:24:10.305] Build status: STARTED
[03:24:10.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:71:0) after 6m15s
[03:30:25.328] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:71:0)
[03:30:25.355] Build status: STARTED
[03:30:25.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:72:0) after 7m51s
[03:38:16.375] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:72:0)
[03:38:16.405] Build status: STARTED
[03:38:16.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:73:0) after 1m39s
[03:39:55.493] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:73:0)
[03:39:55.529] Build status: STARTED
[03:39:55.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:74:0) after 6m11s
[03:46:06.547] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:74:0)
[03:46:06.573] Build status: STARTED
[03:46:06.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:75:0) after 5m7s
[03:51:13.594] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:75:0)
[03:51:13.615] Build status: STARTED
[03:51:13.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:76:0) after 3m23s
[03:54:36.781] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:76:0)
[03:54:36.799] Build status: STARTED
[03:54:36.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:77:0) after 6m49s
[04:01:25.985] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:77:0)
[04:01:26.005] Build status: STARTED
[04:01:26.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:78:0) after 2m7s
[04:03:33.028] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:78:0)
[04:03:33.048] Build status: STARTED
[04:03:33.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:79:0) after 6m41s
[04:10:14.067] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:79:0)
[04:10:14.085] Build status: STARTED
[04:10:14.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:80:0) after 2m51s
[04:13:05.204] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:80:0)
[04:13:05.221] Build status: STARTED
[04:13:05.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:81:0) after 4m14s
[04:17:19.239] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:81:0)
[04:17:19.267] Build status: STARTED
[04:17:19.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:82:0) after 8m4s
[04:25:24.320] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:82:0)
[04:25:24.347] Build status: STARTED
[04:25:24.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:83:0) after 2m17s
[04:27:41.398] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:83:0)
[04:27:41.418] Build status: STARTED
[04:27:41.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:84:0) after 9m49s
[04:37:30.520] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:84:0)
[04:37:30.539] Build status: STARTED
[04:37:30.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:85:0) after 3m37s
[04:41:07.666] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:85:0)
[04:41:07.685] Build status: STARTED
[04:41:07.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:86:0) after 4m0s
[04:45:07.710] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:86:0)
[04:45:07.737] Build status: STARTED
[04:45:07.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:87:0) after 5m52s
[04:50:59.821] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:87:0)
[04:50:59.848] Build status: STARTED
[04:50:59.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:88:0) after 6m1s
[04:57:01.015] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:88:0)
[04:57:01.043] Build status: STARTED
[04:57:01.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:89:0) after 6m54s
[05:03:55.114] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:89:0)
[05:03:55.154] Build status: STARTED
[05:03:55.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:90:0) after 3m10s
[05:07:05.188] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:90:0)
[05:07:05.228] Build status: STARTED
[05:07:05.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:91:0) after 4m14s
[05:11:19.252] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:91:0)
[05:11:19.269] Build status: STARTED
[05:11:19.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:92:0) after 9m37s
[05:20:57.427] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:92:0)
[05:20:57.446] Build status: STARTED
[05:20:57.446] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:93:0) after 3m19s
[05:24:16.469] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:93:0)
[05:24:16.503] Build status: STARTED
[05:24:16.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:94:0) after 9m25s
[05:33:41.524] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:94:0)
[05:33:41.550] Build status: STARTED
[05:33:41.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:95:0) after 6m53s
[05:40:34.573] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:95:0)
[05:40:34.602] Build status: STARTED
[05:40:34.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:96:0) after 6m17s
[05:46:52.317] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:96:0)
[05:46:52.357] Build status: STARTED
[05:46:52.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:97:0) after 1m2s
[05:47:54.376] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:97:0)
[05:47:54.411] Build status: STARTED
[05:47:54.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:98:0) after 5m16s
[05:53:10.467] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:98:0)
[05:53:10.488] Build status: STARTED
[05:53:10.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:99:0) after 2m18s
[05:55:28.510] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:99:0)
[05:55:28.540] Build status: STARTED
[05:55:28.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:100:0) after 4m41s
[06:00:09.567] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:100:0)
[06:00:09.596] Build status: STARTED
[06:00:09.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:101:0) after 4m12s
[06:04:21.831] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:101:0)
[06:04:21.852] Build status: STARTED
[06:04:21.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:102:0) after 1m11s
[06:05:33.322] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:102:0)
[06:05:33.341] Build status: STARTED
[06:05:33.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:103:0) after 2m19s
[06:07:52.378] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:103:0)
[06:07:52.398] Build status: STARTED
[06:07:52.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:104:0) after 8m38s
[06:16:30.677] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:104:0)
[06:16:30.709] Build status: STARTED
[06:16:30.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:105:0) after 3m40s
[06:20:10.955] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:105:0)
[06:20:10.988] Build status: STARTED
[06:20:10.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:106:0) after 6m19s
[06:26:30.123] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:106:0)
[06:26:30.143] Build status: STARTED
[06:26:30.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:107:0) after 2m33s
[06:29:03.246] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:107:0)
[06:29:03.267] Build status: STARTED
[06:29:03.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:108:0) after 3m51s
[06:32:54.286] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:108:0)
[06:32:54.315] Build status: STARTED
[06:32:54.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:109:0) after 7m39s
[06:40:33.588] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:109:0)
[06:40:33.608] Build status: STARTED
[06:40:33.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:110:0) after 8m40s
[06:49:13.824] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:110:0)
[06:49:13.855] Build status: STARTED
[06:49:13.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:111:0) after 2m6s
[06:51:20.564] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:111:0)
[06:51:20.589] Build status: STARTED
[06:51:20.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:112:0) after 2m20s
[06:53:40.991] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:112:0)
[06:53:41.009] Build status: STARTED
[06:53:41.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:113:0) after 1m15s
[06:54:56.017] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:113:0)
[06:54:56.036] Build status: STARTED
[06:54:56.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:114:0) after 8m40s
[07:03:36.058] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:114:0)
[07:03:36.078] Build status: STARTED
[07:03:36.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:115:0) after 3m49s
[07:07:25.108] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:115:0)
[07:07:25.132] Build status: STARTED
[07:07:25.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8992360349752252560:116:0) after 6m27s
[07:07:53.344] Received PubSub notification, asking Buildbucket for the build status
[07:07:53.365] Build:
{
"id": "8826930287751393969",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 15096,
"createdBy": "project:chromium",
"createTime": "2021-12-24T21:11:54.071098849Z",
"startTime": "2021-12-24T21:11:57.463477Z",
"endTime": "2021-12-25T07:07:53.012041896Z",
"updateTime": "2021-12-25T07:07:53.012041896Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8a2187bbdac0d89a741ebf79e7fd6120eb957629",
"ref": "refs/heads/main"
}
},
"canary": true
}
[07:07:53.365] Invocation finished in 9h56m0.585888766s with status FAILED