[17:50:15.203] New invocation is queued and will start shortly
[17:50:16.557] Starting the invocation (attempt 1)
[17:50:16.598] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/fa25ed5adc676b33bb02b72b46bc9628e02c9991"
[17:50:16.598] Popped gitiles commit info from properties and tags
[17:50:16.598] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[17:50:16.598] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[17:50:16.598] Buildbucket request:
{
"requestId": "8931582470541615200",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fa25ed5adc676b33bb02b72b46bc9628e02c9991",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8931582470541615200"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[17:50:17.194] Scheduled build:
{
"id": "8766152408319173553",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 21020,
"createdBy": "project:chromium",
"createTime": "2023-10-26T17:50:16.691173284Z",
"updateTime": "2023-10-26T17:50:16.691173284Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fa25ed5adc676b33bb02b72b46bc9628e02c9991",
"ref": "refs/heads/main"
}
}
}
[17:50:17.194] Task URL: https://cr-buildbucket.appspot.com/build/8766152408319173553
[17:50:17.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:2:0) after 4m45s
[17:50:18.140] Received PubSub notification, asking Buildbucket for the build status
[17:50:18.181] Build status: SCHEDULED
[17:54:21.287] Received PubSub notification, asking Buildbucket for the build status
[17:54:21.305] Build status: STARTED
[17:55:02.336] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:2:0)
[17:55:02.353] Build status: STARTED
[17:55:02.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:5:0) after 9m55s
[18:04:57.402] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:5:0)
[18:04:57.424] Build status: STARTED
[18:04:57.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:6:0) after 9m44s
[18:14:41.674] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:6:0)
[18:14:41.704] Build status: STARTED
[18:14:41.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:7:0) after 6m57s
[18:21:38.779] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:7:0)
[18:21:38.801] Build status: STARTED
[18:21:38.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:8:0) after 8m18s
[18:29:56.872] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:8:0)
[18:29:56.901] Build status: STARTED
[18:29:56.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:9:0) after 3m33s
[18:33:30.041] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:9:0)
[18:33:30.058] Build status: STARTED
[18:33:30.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:10:0) after 4m1s
[18:37:31.084] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:10:0)
[18:37:31.106] Build status: STARTED
[18:37:31.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:11:0) after 7m37s
[18:45:08.154] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:11:0)
[18:45:08.183] Build status: STARTED
[18:45:08.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:12:0) after 1m54s
[18:47:02.168] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:12:0)
[18:47:02.188] Build status: STARTED
[18:47:02.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:13:0) after 6m4s
[18:53:06.288] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:13:0)
[18:53:06.313] Build status: STARTED
[18:53:06.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:14:0) after 3m6s
[18:56:12.369] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:14:0)
[18:56:12.398] Build status: STARTED
[18:56:12.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:15:0) after 7m11s
[19:03:23.434] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:15:0)
[19:03:23.457] Build status: STARTED
[19:03:23.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:16:0) after 3m31s
[19:06:54.573] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:16:0)
[19:06:54.613] Build status: STARTED
[19:06:54.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:17:0) after 1m21s
[19:08:15.622] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:17:0)
[19:08:15.645] Build status: STARTED
[19:08:15.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:18:0) after 7m40s
[19:15:55.728] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:18:0)
[19:15:55.749] Build status: STARTED
[19:15:55.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:19:0) after 6m58s
[19:22:53.772] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:19:0)
[19:22:53.796] Build status: STARTED
[19:22:53.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:20:0) after 3m15s
[19:26:08.827] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:20:0)
[19:26:08.865] Build status: STARTED
[19:26:08.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:21:0) after 7m28s
[19:33:37.119] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:21:0)
[19:33:37.274] Build status: STARTED
[19:33:37.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:22:0) after 2m28s
[19:36:05.502] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:22:0)
[19:36:05.522] Build status: STARTED
[19:36:05.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:23:0) after 4m38s
[19:40:43.815] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:23:0)
[19:40:43.835] Build status: STARTED
[19:40:43.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:24:0) after 3m52s
[19:44:36.088] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:24:0)
[19:44:36.110] Build status: STARTED
[19:44:36.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:25:0) after 5m3s
[19:49:39.137] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:25:0)
[19:49:39.155] Build status: STARTED
[19:49:39.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:26:0) after 7m6s
[19:56:45.177] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:26:0)
[19:56:45.212] Build status: STARTED
[19:56:45.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:27:0) after 6m55s
[20:03:40.437] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:27:0)
[20:03:40.468] Build status: STARTED
[20:03:40.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:28:0) after 6m45s
[20:10:25.531] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:28:0)
[20:10:25.593] Build status: STARTED
[20:10:25.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:29:0) after 1m43s
[20:12:08.623] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:29:0)
[20:12:08.661] Build status: STARTED
[20:12:08.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:30:0) after 5m50s
[20:17:58.793] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:30:0)
[20:17:58.831] Build status: STARTED
[20:17:58.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:31:0) after 9m50s
[20:27:48.853] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:31:0)
[20:27:48.905] Build status: STARTED
[20:27:48.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:32:0) after 9m27s
[20:37:15.946] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:32:0)
[20:37:15.964] Build status: STARTED
[20:37:15.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:33:0) after 8m37s
[20:45:52.999] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:33:0)
[20:45:53.023] Build status: STARTED
[20:45:53.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:34:0) after 3m31s
[20:49:24.051] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:34:0)
[20:49:24.157] Build status: STARTED
[20:49:24.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:35:0) after 1m9s
[20:50:33.188] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:35:0)
[20:50:33.210] Build status: STARTED
[20:50:33.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:36:0) after 6m57s
[20:57:30.317] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:36:0)
[20:57:30.334] Build status: STARTED
[20:57:30.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:37:0) after 1m39s
[20:59:09.364] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:37:0)
[20:59:09.391] Build status: STARTED
[20:59:09.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:38:0) after 5m50s
[21:04:59.454] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:38:0)
[21:04:59.479] Build status: STARTED
[21:04:59.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:39:0) after 4m36s
[21:09:35.603] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:39:0)
[21:09:35.627] Build status: STARTED
[21:09:35.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:40:0) after 5m57s
[21:15:32.758] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:40:0)
[21:15:32.785] Build status: STARTED
[21:15:32.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:41:0) after 3m5s
[21:18:37.817] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:41:0)
[21:18:37.841] Build status: STARTED
[21:18:37.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:42:0) after 7m0s
[21:25:37.972] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:42:0)
[21:25:37.991] Build status: STARTED
[21:25:37.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:43:0) after 5m22s
[21:31:00.090] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:43:0)
[21:31:00.135] Build status: STARTED
[21:31:00.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:44:0) after 2m38s
[21:33:38.484] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:44:0)
[21:33:38.506] Build status: STARTED
[21:33:38.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:45:0) after 5m17s
[21:38:55.535] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:45:0)
[21:38:55.555] Build status: STARTED
[21:38:55.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:46:0) after 5m54s
[21:44:49.621] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:46:0)
[21:44:49.647] Build status: STARTED
[21:44:49.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:47:0) after 7m40s
[21:52:29.719] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:47:0)
[21:52:29.739] Build status: STARTED
[21:52:29.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:48:0) after 5m48s
[21:58:17.787] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:48:0)
[21:58:17.805] Build status: STARTED
[21:58:17.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:49:0) after 1m39s
[21:59:57.140] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:49:0)
[21:59:57.156] Build status: STARTED
[21:59:57.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:50:0) after 8m33s
[22:08:30.183] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:50:0)
[22:08:30.202] Build status: STARTED
[22:08:30.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:51:0) after 1m38s
[22:10:08.301] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:51:0)
[22:10:08.321] Build status: STARTED
[22:10:08.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:52:0) after 1m21s
[22:11:29.306] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:52:0)
[22:11:29.321] Build status: STARTED
[22:11:29.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:53:0) after 4m14s
[22:15:43.365] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:53:0)
[22:15:43.397] Build status: STARTED
[22:15:43.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:54:0) after 3m1s
[22:18:44.439] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:54:0)
[22:18:44.465] Build status: STARTED
[22:18:44.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:55:0) after 9m45s
[22:28:29.488] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:55:0)
[22:28:29.510] Build status: STARTED
[22:28:29.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:56:0) after 8m54s
[22:37:23.535] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:56:0)
[22:37:23.554] Build status: STARTED
[22:37:23.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:57:0) after 6m46s
[22:44:09.644] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:57:0)
[22:44:09.661] Build status: STARTED
[22:44:09.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:58:0) after 7m53s
[22:52:02.889] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:58:0)
[22:52:02.909] Build status: STARTED
[22:52:02.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:59:0) after 5m23s
[22:57:26.128] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:59:0)
[22:57:26.155] Build status: STARTED
[22:57:26.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:60:0) after 2m53s
[23:00:19.137] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:60:0)
[23:00:19.154] Build status: STARTED
[23:00:19.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:61:0) after 3m53s
[23:04:12.406] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:61:0)
[23:04:12.433] Build status: STARTED
[23:04:12.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:62:0) after 6m33s
[23:10:45.456] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:62:0)
[23:10:45.475] Build status: STARTED
[23:10:45.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:63:0) after 4m26s
[23:15:11.943] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:63:0)
[23:15:11.959] Build status: STARTED
[23:15:11.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:64:0) after 3m5s
[23:18:17.054] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:64:0)
[23:18:17.082] Build status: STARTED
[23:18:17.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:65:0) after 8m40s
[23:26:57.154] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:65:0)
[23:26:57.174] Build status: STARTED
[23:26:57.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:66:0) after 4m1s
[23:30:58.258] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:66:0)
[23:30:58.313] Build status: STARTED
[23:30:58.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:67:0) after 3m16s
[23:34:14.565] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:67:0)
[23:34:14.584] Build status: STARTED
[23:34:14.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:68:0) after 1m45s
[23:35:59.889] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:68:0)
[23:35:59.914] Build status: STARTED
[23:35:59.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:69:0) after 1m22s
[23:37:21.936] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:69:0)
[23:37:21.959] Build status: STARTED
[23:37:21.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:70:0) after 8m9s
[23:45:31.274] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:70:0)
[23:45:31.291] Build status: STARTED
[23:45:31.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:71:0) after 9m43s
[23:55:14.548] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:71:0)
[23:55:14.568] Build status: STARTED
[23:55:14.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:72:0) after 1m5s
[23:56:19.770] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:72:0)
[23:56:19.793] Build status: STARTED
[23:56:19.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:73:0) after 4m55s
[00:01:14.924] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:73:0)
[00:01:14.942] Build status: STARTED
[00:01:14.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:74:0) after 3m7s
[00:04:22.132] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:74:0)
[00:04:22.154] Build status: STARTED
[00:04:22.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:75:0) after 8m44s
[00:13:06.286] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:75:0)
[00:13:06.308] Build status: STARTED
[00:13:06.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:76:0) after 7m58s
[00:21:04.497] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:76:0)
[00:21:04.515] Build status: STARTED
[00:21:04.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:77:0) after 4m12s
[00:25:16.540] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:77:0)
[00:25:16.562] Build status: STARTED
[00:25:16.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:78:0) after 8m36s
[00:33:52.690] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:78:0)
[00:33:52.707] Build status: STARTED
[00:33:52.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:79:0) after 3m40s
[00:37:32.834] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:79:0)
[00:37:32.882] Build status: STARTED
[00:37:32.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:80:0) after 5m42s
[00:43:14.917] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:80:0)
[00:43:14.934] Build status: STARTED
[00:43:14.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:81:0) after 8m18s
[00:51:33.292] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:81:0)
[00:51:33.309] Build status: STARTED
[00:51:33.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:82:0) after 5m22s
[00:56:55.422] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:82:0)
[00:56:55.439] Build status: STARTED
[00:56:55.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:83:0) after 5m45s
[01:02:40.517] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:83:0)
[01:02:40.536] Build status: STARTED
[01:02:40.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:84:0) after 5m57s
[01:08:37.561] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:84:0)
[01:08:37.582] Build status: STARTED
[01:08:37.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:85:0) after 7m20s
[01:15:57.679] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:85:0)
[01:15:57.699] Build status: STARTED
[01:15:57.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:86:0) after 3m46s
[01:19:43.755] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:86:0)
[01:19:43.780] Build status: STARTED
[01:19:43.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:87:0) after 6m21s
[01:26:05.028] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:87:0)
[01:26:05.052] Build status: STARTED
[01:26:05.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:88:0) after 1m18s
[01:27:23.242] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:88:0)
[01:27:23.266] Build status: STARTED
[01:27:23.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:89:0) after 6m36s
[01:33:59.288] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:89:0)
[01:33:59.306] Build status: STARTED
[01:33:59.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:90:0) after 7m18s
[01:41:17.358] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:90:0)
[01:41:17.396] Build status: STARTED
[01:41:17.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:91:0) after 4m31s
[01:45:48.432] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:91:0)
[01:45:48.451] Build status: STARTED
[01:45:48.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:92:0) after 6m1s
[01:51:49.499] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:92:0)
[01:51:49.586] Build status: STARTED
[01:51:49.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:93:0) after 1m11s
[01:53:00.612] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:93:0)
[01:53:00.663] Build status: STARTED
[01:53:00.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:94:0) after 1m20s
[01:54:20.694] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:94:0)
[01:54:20.798] Build status: STARTED
[01:54:20.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:95:0) after 3m32s
[01:57:52.840] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:95:0)
[01:57:52.858] Build status: STARTED
[01:57:52.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:96:0) after 8m14s
[02:06:06.991] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:96:0)
[02:06:07.012] Build status: STARTED
[02:06:07.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:97:0) after 3m3s
[02:09:10.043] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:97:0)
[02:09:10.062] Build status: STARTED
[02:09:10.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:98:0) after 4m33s
[02:13:43.180] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:98:0)
[02:13:43.201] Build status: STARTED
[02:13:43.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:99:0) after 6m8s
[02:19:51.225] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:99:0)
[02:19:51.243] Build status: STARTED
[02:19:51.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:100:0) after 3m12s
[02:23:03.281] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:100:0)
[02:23:03.315] Build status: STARTED
[02:23:03.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:101:0) after 2m10s
[02:25:13.342] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:101:0)
[02:25:13.379] Build status: STARTED
[02:25:13.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:102:0) after 4m1s
[02:29:14.516] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:102:0)
[02:29:14.605] Build status: STARTED
[02:29:14.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:103:0) after 4m37s
[02:33:51.806] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:103:0)
[02:33:51.822] Build status: STARTED
[02:33:51.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:104:0) after 7m34s
[02:41:25.912] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:104:0)
[02:41:25.933] Build status: STARTED
[02:41:25.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8931582470541615200:105:0) after 9m23s
[02:44:34.101] Received PubSub notification, asking Buildbucket for the build status
[02:44:34.120] Build:
{
"id": "8766152408319173553",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 21020,
"createdBy": "project:chromium",
"createTime": "2023-10-26T17:50:16.691173284Z",
"startTime": "2023-10-26T17:54:20.112406Z",
"endTime": "2023-10-27T02:44:33.827783862Z",
"updateTime": "2023-10-27T02:44:33.827783862Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fa25ed5adc676b33bb02b72b46bc9628e02c9991",
"ref": "refs/heads/main"
}
}
}
[02:44:34.120] Invocation finished in 8h54m18.931913934s with status FAILED