[14:40:06.442] New invocation is queued and will start shortly
[14:40:07.542] Starting the invocation (attempt 1)
[14:40:07.568] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/4bd375ef1222b594b54302c8e49d00d654ab0d4d"
[14:40:07.568] Popped gitiles commit info from properties and tags
[14:40:07.568] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:40:07.568] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:40:07.568] Buildbucket request:
{
"requestId": "8874518344651460576",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "CrWinAsan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4bd375ef1222b594b54302c8e49d00d654ab0d4d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8874518344651460576"
},
{
"key": "scheduler_job_id",
"value": "chromium/CrWinAsan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:40:08.138] Scheduled build:
{
"id": "8709088282748053585",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "CrWinAsan"
},
"number": 19117,
"createdBy": "project:chromium",
"createTime": "2025-07-17T14:40:07.636563375Z",
"updateTime": "2025-07-17T14:40:07.636563375Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4bd375ef1222b594b54302c8e49d00d654ab0d4d",
"ref": "refs/heads/main"
}
}
}
[14:40:08.138] Task URL: https://cr-buildbucket.appspot.com/build/8709088282748053585
[14:40:08.138] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:2:0) after 8m48s
[14:40:10.791] Received PubSub notification, asking Buildbucket for the build status
[14:40:10.834] Build status: SCHEDULED
[14:48:56.165] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:2:0)
[14:48:56.194] Build status: SCHEDULED
[14:48:56.194] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:4:0) after 5m35s
[14:53:12.575] Received PubSub notification, asking Buildbucket for the build status
[14:53:12.602] Build status: STARTED
[14:54:31.220] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:4:0)
[14:54:31.256] Build status: STARTED
[14:54:31.256] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:6:0) after 6m29s
[15:01:00.291] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:6:0)
[15:01:00.310] Build status: STARTED
[15:01:00.310] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:7:0) after 4m13s
[15:05:13.336] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:7:0)
[15:05:13.360] Build status: STARTED
[15:05:13.360] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:8:0) after 8m21s
[15:13:34.410] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:8:0)
[15:13:34.432] Build status: STARTED
[15:13:34.432] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:9:0) after 1m15s
[15:14:49.469] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:9:0)
[15:14:49.500] Build status: STARTED
[15:14:49.500] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:10:0) after 3m51s
[15:18:40.533] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:10:0)
[15:18:40.557] Build status: STARTED
[15:18:40.557] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:11:0) after 3m58s
[15:22:38.587] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:11:0)
[15:22:38.645] Build status: STARTED
[15:22:38.645] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:12:0) after 7m33s
[15:30:11.672] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:12:0)
[15:30:11.706] Build status: STARTED
[15:30:11.706] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:13:0) after 5m18s
[15:35:29.782] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:13:0)
[15:35:29.805] Build status: STARTED
[15:35:29.805] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:14:0) after 9m50s
[15:45:19.925] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:14:0)
[15:45:19.943] Build status: STARTED
[15:45:19.944] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:15:0) after 2m8s
[15:47:27.934] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:15:0)
[15:47:27.953] Build status: STARTED
[15:47:27.953] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:16:0) after 7m1s
[15:54:28.984] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:16:0)
[15:54:29.014] Build status: STARTED
[15:54:29.014] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:17:0) after 7m43s
[16:02:12.010] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:17:0)
[16:02:12.028] Build status: STARTED
[16:02:12.028] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:18:0) after 8m32s
[16:10:44.069] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:18:0)
[16:10:44.163] Build status: STARTED
[16:10:44.163] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:19:0) after 2m53s
[16:13:37.192] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:19:0)
[16:13:37.269] Build status: STARTED
[16:13:37.269] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:20:0) after 9m44s
[16:23:21.436] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:20:0)
[16:23:21.498] Build status: STARTED
[16:23:21.498] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:21:0) after 8m42s
[16:32:03.569] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:21:0)
[16:32:03.588] Build status: STARTED
[16:32:03.588] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:22:0) after 4m54s
[16:36:57.622] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:22:0)
[16:36:57.643] Build status: STARTED
[16:36:57.643] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:23:0) after 1m44s
[16:38:41.674] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:23:0)
[16:38:41.694] Build status: STARTED
[16:38:41.694] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:24:0) after 8m39s
[16:47:20.767] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:24:0)
[16:47:20.791] Build status: STARTED
[16:47:20.791] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:25:0) after 9m44s
[16:57:04.789] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:25:0)
[16:57:04.806] Build status: STARTED
[16:57:04.806] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:26:0) after 4m5s
[17:01:09.885] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:26:0)
[17:01:09.907] Build status: STARTED
[17:01:09.907] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:27:0) after 7m55s
[17:09:04.981] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:27:0)
[17:09:05.009] Build status: STARTED
[17:09:05.009] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:28:0) after 3m42s
[17:12:47.088] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:28:0)
[17:12:47.162] Build status: STARTED
[17:12:47.162] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:29:0) after 5m47s
[17:18:34.320] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:29:0)
[17:18:34.346] Build status: STARTED
[17:18:34.346] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:30:0) after 2m3s
[17:20:37.522] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:30:0)
[17:20:37.596] Build status: STARTED
[17:20:37.596] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:31:0) after 7m14s
[17:27:51.671] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:31:0)
[17:27:51.691] Build status: STARTED
[17:27:51.691] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:32:0) after 5m25s
[17:33:16.748] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:32:0)
[17:33:16.791] Build status: STARTED
[17:33:16.792] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:33:0) after 3m56s
[17:37:12.825] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:33:0)
[17:37:12.847] Build status: STARTED
[17:37:12.847] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:34:0) after 1m48s
[17:39:00.881] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:34:0)
[17:39:00.901] Build status: STARTED
[17:39:00.901] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:35:0) after 7m10s
[17:46:10.982] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:35:0)
[17:46:11.005] Build status: STARTED
[17:46:11.005] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:36:0) after 5m14s
[17:51:25.105] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:36:0)
[17:51:25.170] Build status: STARTED
[17:51:25.170] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:37:0) after 5m14s
[17:56:39.202] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:37:0)
[17:56:39.297] Build status: STARTED
[17:56:39.297] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:38:0) after 9m33s
[18:06:12.331] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:38:0)
[18:06:12.354] Build status: STARTED
[18:06:12.354] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:39:0) after 2m28s
[18:08:40.382] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:39:0)
[18:08:40.405] Build status: STARTED
[18:08:40.405] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:40:0) after 2m10s
[18:10:50.437] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:40:0)
[18:10:50.496] Build status: STARTED
[18:10:50.496] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:41:0) after 4m18s
[18:15:08.535] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:41:0)
[18:15:08.566] Build status: STARTED
[18:15:08.566] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:42:0) after 2m24s
[18:17:32.644] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:42:0)
[18:17:32.663] Build status: STARTED
[18:17:32.663] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:43:0) after 8m52s
[18:26:24.689] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:43:0)
[18:26:24.711] Build status: STARTED
[18:26:24.712] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:44:0) after 4m5s
[18:30:29.837] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:44:0)
[18:30:29.861] Build status: STARTED
[18:30:29.861] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:45:0) after 2m48s
[18:33:17.886] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:45:0)
[18:33:17.911] Build status: STARTED
[18:33:17.911] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:46:0) after 9m53s
[18:43:10.986] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:46:0)
[18:43:11.087] Build status: STARTED
[18:43:11.087] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:47:0) after 8m7s
[18:51:18.098] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:47:0)
[18:51:18.227] Build status: STARTED
[18:51:18.227] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:48:0) after 7m30s
[18:58:48.253] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:48:0)
[18:58:48.271] Build status: STARTED
[18:58:48.271] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:49:0) after 9m57s
[19:08:45.390] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:49:0)
[19:08:45.410] Build status: STARTED
[19:08:45.410] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:50:0) after 6m59s
[19:15:44.427] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:50:0)
[19:15:44.448] Build status: STARTED
[19:15:44.448] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:51:0) after 1m56s
[19:17:40.479] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:51:0)
[19:17:40.512] Build status: STARTED
[19:17:40.512] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:52:0) after 7m53s
[19:25:33.550] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:52:0)
[19:25:33.564] Build status: STARTED
[19:25:33.564] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:53:0) after 5m0s
[19:30:33.598] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:53:0)
[19:30:33.619] Build status: STARTED
[19:30:33.619] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:54:0) after 5m8s
[19:35:41.648] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:54:0)
[19:35:41.662] Build status: STARTED
[19:35:41.662] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:55:0) after 5m22s
[19:41:03.829] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:55:0)
[19:41:03.876] Build status: STARTED
[19:41:03.876] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:56:0) after 7m5s
[19:48:08.910] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:56:0)
[19:48:08.930] Build status: STARTED
[19:48:08.930] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:57:0) after 5m51s
[19:53:59.955] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:57:0)
[19:53:59.973] Build status: STARTED
[19:53:59.973] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:58:0) after 4m54s
[19:58:54.049] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:58:0)
[19:58:54.076] Build status: STARTED
[19:58:54.077] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:59:0) after 6m53s
[20:05:47.118] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:59:0)
[20:05:47.137] Build status: STARTED
[20:05:47.137] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:60:0) after 2m16s
[20:08:03.115] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:60:0)
[20:08:03.134] Build status: STARTED
[20:08:03.134] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:61:0) after 1m32s
[20:09:35.213] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:61:0)
[20:09:35.249] Build status: STARTED
[20:09:35.249] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:62:0) after 1m59s
[20:11:34.355] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:62:0)
[20:11:34.373] Build status: STARTED
[20:11:34.373] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:63:0) after 8m14s
[20:19:48.499] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:63:0)
[20:19:48.515] Build status: STARTED
[20:19:48.515] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:64:0) after 8m57s
[20:28:45.586] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:64:0)
[20:28:45.609] Build status: STARTED
[20:28:45.609] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:65:0) after 9m57s
[20:38:42.641] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:65:0)
[20:38:42.660] Build status: STARTED
[20:38:42.660] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:66:0) after 9m35s
[20:48:17.685] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:66:0)
[20:48:17.702] Build status: STARTED
[20:48:17.702] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:67:0) after 5m57s
[20:54:14.695] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:67:0)
[20:54:14.724] Build status: STARTED
[20:54:14.724] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:68:0) after 2m9s
[20:56:23.797] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:68:0)
[20:56:23.822] Build status: STARTED
[20:56:23.822] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8874518344651460576:69:0) after 8m54s
[20:58:49.220] Received PubSub notification, asking Buildbucket for the build status
[20:58:49.295] Build:
{
"id": "8709088282748053585",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "CrWinAsan"
},
"number": 19117,
"createdBy": "project:chromium",
"createTime": "2025-07-17T14:40:07.636563375Z",
"startTime": "2025-07-17T14:53:12.336281964Z",
"endTime": "2025-07-17T20:58:48.656740633Z",
"updateTime": "2025-07-17T20:58:48.656740633Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4bd375ef1222b594b54302c8e49d00d654ab0d4d",
"ref": "refs/heads/main"
}
}
}
[20:58:49.295] Invocation finished in 6h18m42.857360864s with status FAILED