[14:23:26.097] New invocation is queued and will start shortly
[14:23:27.198] Starting the invocation (attempt 1)
[14:23:27.245] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/6134c4b647195e9ad0b3dd73d187768b2204d638"
[14:23:27.245] Popped gitiles commit info from properties and tags
[14:23:27.245] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:23:27.245] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:23:27.245] Buildbucket request:
{
"requestId": "8945185027387257664",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6134c4b647195e9ad0b3dd73d187768b2204d638",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8945185027387257664"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:23:27.648] Scheduled build:
{
"id": "8779754965455045649",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 19610,
"createdBy": "project:chromium",
"createTime": "2023-05-29T14:23:27.313529903Z",
"updateTime": "2023-05-29T14:23:27.313529903Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6134c4b647195e9ad0b3dd73d187768b2204d638",
"ref": "refs/heads/main"
}
}
}
[14:23:27.648] Task URL: https://cr-buildbucket.appspot.com/build/8779754965455045649
[14:23:27.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:2:0) after 7m30s
[14:23:35.922] Received PubSub notification, asking Buildbucket for the build status
[14:23:35.941] Build status: STARTED
[14:30:57.633] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:2:0)
[14:30:57.653] Build status: STARTED
[14:30:57.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:4:0) after 3m44s
[14:34:41.776] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:4:0)
[14:34:41.891] Build status: STARTED
[14:34:41.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:5:0) after 3m3s
[14:37:45.108] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:5:0)
[14:37:45.145] Build status: STARTED
[14:37:45.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:6:0) after 5m14s
[14:42:59.195] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:6:0)
[14:42:59.212] Build status: STARTED
[14:42:59.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:7:0) after 8m29s
[14:51:28.276] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:7:0)
[14:51:28.294] Build status: STARTED
[14:51:28.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:8:0) after 6m33s
[14:58:01.314] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:8:0)
[14:58:01.335] Build status: STARTED
[14:58:01.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:9:0) after 3m52s
[15:01:53.413] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:9:0)
[15:01:53.431] Build status: STARTED
[15:01:53.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:10:0) after 6m25s
[15:08:18.719] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:10:0)
[15:08:18.764] Build status: STARTED
[15:08:18.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:11:0) after 5m1s
[15:13:19.909] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:11:0)
[15:13:19.935] Build status: STARTED
[15:13:19.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:12:0) after 3m33s
[15:16:53.318] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:12:0)
[15:16:53.343] Build status: STARTED
[15:16:53.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:13:0) after 1m52s
[15:18:45.406] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:13:0)
[15:18:45.431] Build status: STARTED
[15:18:45.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:14:0) after 8m3s
[15:26:48.450] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:14:0)
[15:26:48.482] Build status: STARTED
[15:26:48.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:15:0) after 8m1s
[15:34:49.538] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:15:0)
[15:34:49.573] Build status: STARTED
[15:34:49.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:16:0) after 9m10s
[15:43:59.599] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:16:0)
[15:43:59.651] Build status: STARTED
[15:43:59.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:17:0) after 5m21s
[15:49:20.835] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:17:0)
[15:49:20.856] Build status: STARTED
[15:49:20.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:18:0) after 3m9s
[15:52:30.076] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:18:0)
[15:52:30.098] Build status: STARTED
[15:52:30.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:19:0) after 9m41s
[16:02:11.119] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:19:0)
[16:02:11.149] Build status: STARTED
[16:02:11.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:20:0) after 6m59s
[16:09:10.424] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:20:0)
[16:09:10.444] Build status: STARTED
[16:09:10.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:21:0) after 1m57s
[16:11:07.461] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:21:0)
[16:11:07.479] Build status: STARTED
[16:11:07.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:22:0) after 8m30s
[16:19:37.498] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:22:0)
[16:19:37.519] Build status: STARTED
[16:19:37.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:23:0) after 1m37s
[16:21:14.542] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:23:0)
[16:21:14.580] Build status: STARTED
[16:21:14.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:24:0) after 8m55s
[16:30:09.608] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:24:0)
[16:30:09.742] Build status: STARTED
[16:30:09.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:25:0) after 5m21s
[16:35:30.932] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:25:0)
[16:35:30.955] Build status: STARTED
[16:35:30.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:26:0) after 6m57s
[16:42:28.022] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:26:0)
[16:42:28.038] Build status: STARTED
[16:42:28.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:27:0) after 9m26s
[16:51:54.058] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:27:0)
[16:51:54.075] Build status: STARTED
[16:51:54.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:28:0) after 5m14s
[16:57:08.202] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:28:0)
[16:57:08.227] Build status: STARTED
[16:57:08.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:29:0) after 4m8s
[17:01:16.245] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:29:0)
[17:01:16.286] Build status: STARTED
[17:01:16.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:30:0) after 3m8s
[17:04:24.311] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:30:0)
[17:04:24.358] Build status: STARTED
[17:04:24.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:31:0) after 1m38s
[17:06:02.382] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:31:0)
[17:06:02.473] Build status: STARTED
[17:06:02.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:32:0) after 6m18s
[17:12:20.491] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:32:0)
[17:12:20.515] Build status: STARTED
[17:12:20.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:33:0) after 8m9s
[17:20:29.542] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:33:0)
[17:20:29.561] Build status: STARTED
[17:20:29.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:34:0) after 7m59s
[17:28:28.605] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:34:0)
[17:28:28.627] Build status: STARTED
[17:28:28.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:35:0) after 6m26s
[17:34:54.694] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:35:0)
[17:34:54.752] Build status: STARTED
[17:34:54.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:36:0) after 5m35s
[17:40:29.838] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:36:0)
[17:40:29.857] Build status: STARTED
[17:40:29.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:37:0) after 7m45s
[17:48:14.886] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:37:0)
[17:48:14.930] Build status: STARTED
[17:48:14.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:38:0) after 5m23s
[17:53:37.950] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:38:0)
[17:53:37.968] Build status: STARTED
[17:53:37.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:39:0) after 1m22s
[17:55:00.033] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:39:0)
[17:55:00.050] Build status: STARTED
[17:55:00.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:40:0) after 8m6s
[18:03:06.155] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:40:0)
[18:03:06.273] Build status: STARTED
[18:03:06.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:41:0) after 9m58s
[18:13:04.370] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:41:0)
[18:13:04.395] Build status: STARTED
[18:13:04.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:42:0) after 2m33s
[18:15:37.433] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:42:0)
[18:15:37.456] Build status: STARTED
[18:15:37.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:43:0) after 1m48s
[18:17:25.500] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:43:0)
[18:17:25.518] Build status: STARTED
[18:17:25.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:44:0) after 1m20s
[18:18:45.603] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:44:0)
[18:18:45.661] Build status: STARTED
[18:18:45.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:45:0) after 7m26s
[18:26:11.685] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:45:0)
[18:26:11.891] Build status: STARTED
[18:26:11.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:46:0) after 8m38s
[18:34:49.912] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:46:0)
[18:34:49.930] Build status: STARTED
[18:34:49.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:47:0) after 9m47s
[18:44:36.993] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:47:0)
[18:44:37.010] Build status: STARTED
[18:44:37.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:48:0) after 2m39s
[18:47:16.103] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:48:0)
[18:47:16.158] Build status: STARTED
[18:47:16.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:49:0) after 9m9s
[18:56:25.486] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:49:0)
[18:56:25.506] Build status: STARTED
[18:56:25.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:50:0) after 9m3s
[19:05:28.523] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:50:0)
[19:05:28.596] Build status: STARTED
[19:05:28.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:51:0) after 4m27s
[19:09:55.727] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:51:0)
[19:09:55.752] Build status: STARTED
[19:09:55.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:52:0) after 5m56s
[19:15:51.774] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:52:0)
[19:15:51.793] Build status: STARTED
[19:15:51.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:53:0) after 7m3s
[19:22:54.784] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:53:0)
[19:22:54.802] Build status: STARTED
[19:22:54.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:54:0) after 3m12s
[19:26:07.139] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:54:0)
[19:26:07.166] Build status: STARTED
[19:26:07.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:55:0) after 1m39s
[19:27:46.419] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:55:0)
[19:27:46.437] Build status: STARTED
[19:27:46.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:56:0) after 7m20s
[19:35:06.548] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:56:0)
[19:35:06.613] Build status: STARTED
[19:35:06.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:57:0) after 7m4s
[19:42:10.636] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:57:0)
[19:42:10.654] Build status: STARTED
[19:42:10.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:58:0) after 2m50s
[19:45:00.742] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:58:0)
[19:45:00.761] Build status: STARTED
[19:45:00.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:59:0) after 6m37s
[19:51:37.936] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:59:0)
[19:51:37.957] Build status: STARTED
[19:51:37.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:60:0) after 4m24s
[19:56:02.134] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:60:0)
[19:56:02.174] Build status: STARTED
[19:56:02.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:61:0) after 4m4s
[20:00:06.332] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:61:0)
[20:00:06.357] Build status: STARTED
[20:00:06.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:62:0) after 7m1s
[20:07:07.387] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:62:0)
[20:07:07.407] Build status: STARTED
[20:07:07.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:63:0) after 9m22s
[20:16:29.492] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:63:0)
[20:16:29.511] Build status: STARTED
[20:16:29.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:64:0) after 1m48s
[20:18:17.539] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:64:0)
[20:18:17.566] Build status: STARTED
[20:18:17.566] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:65:0) after 5m9s
[20:23:26.586] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:65:0)
[20:23:26.603] Build status: STARTED
[20:23:26.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:66:0) after 4m15s
[20:27:41.625] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:66:0)
[20:27:41.643] Build status: STARTED
[20:27:41.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:67:0) after 9m42s
[20:37:23.660] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:67:0)
[20:37:23.697] Build status: STARTED
[20:37:23.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:68:0) after 1m12s
[20:38:35.724] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:68:0)
[20:38:35.750] Build status: STARTED
[20:38:35.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:69:0) after 2m20s
[20:40:55.907] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:69:0)
[20:40:55.933] Build status: STARTED
[20:40:55.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:70:0) after 9m28s
[20:50:24.049] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:70:0)
[20:50:24.069] Build status: STARTED
[20:50:24.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:71:0) after 2m39s
[20:53:03.106] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:71:0)
[20:53:03.125] Build status: STARTED
[20:53:03.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:72:0) after 8m39s
[21:01:42.197] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:72:0)
[21:01:42.217] Build status: STARTED
[21:01:42.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:73:0) after 4m10s
[21:05:52.487] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:73:0)
[21:05:52.530] Build status: STARTED
[21:05:52.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:74:0) after 1m21s
[21:07:13.608] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:74:0)
[21:07:13.626] Build status: STARTED
[21:07:13.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:75:0) after 2m48s
[21:10:01.807] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:75:0)
[21:10:01.823] Build status: STARTED
[21:10:01.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:76:0) after 9m50s
[21:19:51.922] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:76:0)
[21:19:51.940] Build status: STARTED
[21:19:51.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:77:0) after 5m11s
[21:25:02.984] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:77:0)
[21:25:03.006] Build status: STARTED
[21:25:03.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:78:0) after 2m24s
[21:27:27.040] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:78:0)
[21:27:27.064] Build status: STARTED
[21:27:27.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:79:0) after 8m39s
[21:36:06.236] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:79:0)
[21:36:06.266] Build status: STARTED
[21:36:06.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:80:0) after 2m19s
[21:38:25.324] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:80:0)
[21:38:25.341] Build status: STARTED
[21:38:25.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:81:0) after 4m3s
[21:42:28.359] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:81:0)
[21:42:28.378] Build status: STARTED
[21:42:28.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:82:0) after 5m0s
[21:47:28.484] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:82:0)
[21:47:28.503] Build status: STARTED
[21:47:28.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:83:0) after 4m47s
[21:52:15.530] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:83:0)
[21:52:15.641] Build status: STARTED
[21:52:15.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:84:0) after 6m42s
[21:58:57.672] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:84:0)
[21:58:57.690] Build status: STARTED
[21:58:57.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:85:0) after 1m52s
[22:00:49.709] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:85:0)
[22:00:49.725] Build status: STARTED
[22:00:49.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:86:0) after 2m16s
[22:03:05.967] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:86:0)
[22:03:06.011] Build status: STARTED
[22:03:06.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:87:0) after 6m15s
[22:09:21.242] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:87:0)
[22:09:21.259] Build status: STARTED
[22:09:21.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:88:0) after 7m19s
[22:16:40.286] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:88:0)
[22:16:40.307] Build status: STARTED
[22:16:40.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:89:0) after 7m24s
[22:24:04.345] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:89:0)
[22:24:04.373] Build status: STARTED
[22:24:04.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:90:0) after 3m39s
[22:27:43.394] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:90:0)
[22:27:43.412] Build status: STARTED
[22:27:43.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:91:0) after 2m11s
[22:29:54.432] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:91:0)
[22:29:54.460] Build status: STARTED
[22:29:54.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:92:0) after 1m55s
[22:31:49.521] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:92:0)
[22:31:49.543] Build status: STARTED
[22:31:49.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:93:0) after 2m2s
[22:33:51.756] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:93:0)
[22:33:51.776] Build status: STARTED
[22:33:51.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:94:0) after 2m40s
[22:36:31.803] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:94:0)
[22:36:31.818] Build status: STARTED
[22:36:31.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:95:0) after 6m16s
[22:42:47.845] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:95:0)
[22:42:47.867] Build status: STARTED
[22:42:47.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:96:0) after 9m7s
[22:51:54.902] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:96:0)
[22:51:54.967] Build status: STARTED
[22:51:54.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:97:0) after 1m43s
[22:53:38.236] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:97:0)
[22:53:38.256] Build status: STARTED
[22:53:38.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:98:0) after 7m1s
[23:00:39.414] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:98:0)
[23:00:39.432] Build status: STARTED
[23:00:39.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:99:0) after 2m59s
[23:03:38.453] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:99:0)
[23:03:38.473] Build status: STARTED
[23:03:38.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:100:0) after 5m18s
[23:08:56.495] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:100:0)
[23:08:56.511] Build status: STARTED
[23:08:56.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:101:0) after 1m38s
[23:10:34.531] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:101:0)
[23:10:34.552] Build status: STARTED
[23:10:34.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:102:0) after 6m4s
[23:16:38.580] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:102:0)
[23:16:38.601] Build status: STARTED
[23:16:38.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:103:0) after 3m10s
[23:19:48.719] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:103:0)
[23:19:48.739] Build status: STARTED
[23:19:48.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:104:0) after 9m43s
[23:29:31.910] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:104:0)
[23:29:31.943] Build status: STARTED
[23:29:31.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:105:0) after 1m14s
[23:30:45.977] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:105:0)
[23:30:46.080] Build status: STARTED
[23:30:46.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:106:0) after 6m28s
[23:37:14.090] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:106:0)
[23:37:14.111] Build status: STARTED
[23:37:14.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:107:0) after 8m32s
[23:45:46.130] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:107:0)
[23:45:46.215] Build status: STARTED
[23:45:46.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:108:0) after 8m21s
[23:54:07.578] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:108:0)
[23:54:07.595] Build status: STARTED
[23:54:07.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:109:0) after 5m51s
[23:59:58.614] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:109:0)
[23:59:58.634] Build status: STARTED
[23:59:58.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:110:0) after 4m7s
[00:04:05.662] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:110:0)
[00:04:05.686] Build status: STARTED
[00:04:05.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:111:0) after 1m59s
[00:06:04.872] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:111:0)
[00:06:04.887] Build status: STARTED
[00:06:04.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:112:0) after 6m21s
[00:12:25.948] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:112:0)
[00:12:25.966] Build status: STARTED
[00:12:25.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:113:0) after 3m28s
[00:15:54.002] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:113:0)
[00:15:54.024] Build status: STARTED
[00:15:54.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:114:0) after 6m20s
[00:22:14.245] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:114:0)
[00:22:14.264] Build status: STARTED
[00:22:14.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:115:0) after 4m21s
[00:26:35.298] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:115:0)
[00:26:35.316] Build status: STARTED
[00:26:35.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:116:0) after 4m44s
[00:31:19.353] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:116:0)
[00:31:19.375] Build status: STARTED
[00:31:19.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:117:0) after 8m1s
[00:39:20.513] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:117:0)
[00:39:20.531] Build status: STARTED
[00:39:20.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:118:0) after 4m57s
[00:44:17.569] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:118:0)
[00:44:17.606] Build status: STARTED
[00:44:17.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:119:0) after 4m8s
[00:48:25.630] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:119:0)
[00:48:25.649] Build status: STARTED
[00:48:25.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8945185027387257664:120:0) after 8m0s
[00:49:33.817] Received PubSub notification, asking Buildbucket for the build status
[00:49:33.835] Build:
{
"id": "8779754965455045649",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 19610,
"createdBy": "project:chromium",
"createTime": "2023-05-29T14:23:27.313529903Z",
"startTime": "2023-05-29T14:23:35.215095Z",
"endTime": "2023-05-30T00:49:33.406200145Z",
"updateTime": "2023-05-30T00:49:33.406200145Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6134c4b647195e9ad0b3dd73d187768b2204d638",
"ref": "refs/heads/main"
}
}
}
[00:49:33.835] Invocation finished in 10h26m7.747800655s with status FAILED