[09:04:24.654] New invocation is queued and will start shortly
[09:04:25.954] Starting the invocation (attempt 1)
[09:04:25.984] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/605586817006b05d1689b2da7c5bd83a614417ea"
[09:04:25.984] Popped gitiles commit info from properties and tags
[09:04:25.984] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[09:04:25.984] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[09:04:25.985] Buildbucket request:
{
"requestId": "8875989016315230288",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "CrWinAsan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "605586817006b05d1689b2da7c5bd83a614417ea",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8875989016315230288"
},
{
"key": "scheduler_job_id",
"value": "chromium/CrWinAsan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[09:04:26.480] Scheduled build:
{
"id": "8710558954210725425",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "CrWinAsan"
},
"number": 19070,
"createdBy": "project:chromium",
"createTime": "2025-07-01T09:04:26.034307756Z",
"updateTime": "2025-07-01T09:04:26.034307756Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "605586817006b05d1689b2da7c5bd83a614417ea",
"ref": "refs/heads/main"
}
},
"canary": true
}
[09:04:26.480] Task URL: https://cr-buildbucket.appspot.com/build/8710558954210725425
[09:04:26.480] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:2:0) after 6m6s
[09:04:27.489] Received PubSub notification, asking Buildbucket for the build status
[09:04:27.520] Build status: SCHEDULED
[09:10:32.501] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:2:0)
[09:10:32.542] Build status: SCHEDULED
[09:10:32.542] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:4:0) after 8m51s
[09:19:23.571] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:4:0)
[09:19:23.818] Build status: SCHEDULED
[09:19:23.818] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:5:0) after 4m49s
[09:24:12.892] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:5:0)
[09:24:12.950] Build status: SCHEDULED
[09:24:12.950] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:6:0) after 7m30s
[09:31:42.980] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:6:0)
[09:31:43.049] Build status: SCHEDULED
[09:31:43.049] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:7:0) after 3m23s
[09:35:06.078] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:7:0)
[09:35:06.107] Build status: SCHEDULED
[09:35:06.107] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:8:0) after 9m36s
[09:44:42.183] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:8:0)
[09:44:42.208] Build status: SCHEDULED
[09:44:42.208] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:9:0) after 8m16s
[09:52:58.233] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:9:0)
[09:52:58.255] Build status: SCHEDULED
[09:52:58.255] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:10:0) after 4m22s
[09:57:20.308] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:10:0)
[09:57:20.334] Build status: SCHEDULED
[09:57:20.334] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:11:0) after 4m4s
[10:01:24.352] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:11:0)
[10:01:24.378] Build status: SCHEDULED
[10:01:24.378] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:12:0) after 6m10s
[10:01:52.247] Received PubSub notification, asking Buildbucket for the build status
[10:01:52.356] Build status: STARTED
[10:07:34.403] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:12:0)
[10:07:34.426] Build status: STARTED
[10:07:34.426] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:14:0) after 3m56s
[10:11:30.468] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:14:0)
[10:11:30.488] Build status: STARTED
[10:11:30.488] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:15:0) after 9m58s
[10:21:28.600] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:15:0)
[10:21:28.617] Build status: STARTED
[10:21:28.617] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:16:0) after 9m21s
[10:30:49.691] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:16:0)
[10:30:49.705] Build status: STARTED
[10:30:49.705] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:17:0) after 3m40s
[10:34:29.733] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:17:0)
[10:34:29.757] Build status: STARTED
[10:34:29.757] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:18:0) after 2m45s
[10:37:14.815] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:18:0)
[10:37:14.840] Build status: STARTED
[10:37:14.840] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:19:0) after 5m31s
[10:42:45.913] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:19:0)
[10:42:45.948] Build status: STARTED
[10:42:45.948] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:20:0) after 7m49s
[10:50:34.980] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:20:0)
[10:50:35.013] Build status: STARTED
[10:50:35.013] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:21:0) after 4m9s
[10:54:44.088] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:21:0)
[10:54:44.104] Build status: STARTED
[10:54:44.104] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:22:0) after 5m5s
[10:59:49.205] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:22:0)
[10:59:49.222] Build status: STARTED
[10:59:49.222] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:23:0) after 3m31s
[11:03:20.345] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:23:0)
[11:03:20.412] Build status: STARTED
[11:03:20.412] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:24:0) after 5m45s
[11:09:05.440] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:24:0)
[11:09:05.470] Build status: STARTED
[11:09:05.470] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:25:0) after 8m21s
[11:17:26.492] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:25:0)
[11:17:26.513] Build status: STARTED
[11:17:26.513] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:26:0) after 1m57s
[11:19:23.541] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:26:0)
[11:19:23.563] Build status: STARTED
[11:19:23.563] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:27:0) after 2m55s
[11:22:18.601] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:27:0)
[11:22:18.624] Build status: STARTED
[11:22:18.624] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:28:0) after 9m22s
[11:31:40.776] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:28:0)
[11:31:40.804] Build status: STARTED
[11:31:40.804] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:29:0) after 8m14s
[11:39:54.849] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:29:0)
[11:39:54.866] Build status: STARTED
[11:39:54.866] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:30:0) after 6m46s
[11:46:40.890] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:30:0)
[11:46:40.916] Build status: STARTED
[11:46:40.916] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:31:0) after 6m28s
[11:53:08.934] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:31:0)
[11:53:08.950] Build status: STARTED
[11:53:08.950] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:32:0) after 4m20s
[11:57:28.971] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:32:0)
[11:57:28.990] Build status: STARTED
[11:57:28.990] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:33:0) after 8m15s
[12:05:44.554] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:33:0)
[12:05:44.601] Build status: STARTED
[12:05:44.601] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:34:0) after 4m58s
[12:10:42.628] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:34:0)
[12:10:42.650] Build status: STARTED
[12:10:42.650] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:35:0) after 4m35s
[12:15:17.659] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:35:0)
[12:15:17.678] Build status: STARTED
[12:15:17.678] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:36:0) after 2m23s
[12:17:40.767] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:36:0)
[12:17:40.795] Build status: STARTED
[12:17:40.795] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:37:0) after 6m56s
[12:24:36.828] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:37:0)
[12:24:36.896] Build status: STARTED
[12:24:36.896] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:38:0) after 1m55s
[12:26:31.935] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:38:0)
[12:26:31.951] Build status: STARTED
[12:26:31.951] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:39:0) after 5m2s
[12:31:33.972] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:39:0)
[12:31:34.215] Build status: STARTED
[12:31:34.215] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:40:0) after 5m19s
[12:36:53.287] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:40:0)
[12:36:53.331] Build status: STARTED
[12:36:53.331] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:41:0) after 6m55s
[12:43:48.362] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:41:0)
[12:43:48.378] Build status: STARTED
[12:43:48.378] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:42:0) after 4m23s
[12:48:11.393] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:42:0)
[12:48:11.471] Build status: STARTED
[12:48:11.471] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:43:0) after 6m18s
[12:54:29.544] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:43:0)
[12:54:29.624] Build status: STARTED
[12:54:29.624] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:44:0) after 9m18s
[13:03:47.719] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:44:0)
[13:03:47.743] Build status: STARTED
[13:03:47.743] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:45:0) after 8m30s
[13:12:17.769] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:45:0)
[13:12:18.934] Build status: STARTED
[13:12:18.935] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:46:0) after 9m56s
[13:22:15.038] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:46:0)
[13:22:15.060] Build status: STARTED
[13:22:15.060] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:47:0) after 8m37s
[13:30:52.083] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:47:0)
[13:30:52.175] Build status: STARTED
[13:30:52.175] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:48:0) after 7m23s
[13:38:15.196] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:48:0)
[13:38:15.233] Build status: STARTED
[13:38:15.233] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:49:0) after 4m10s
[13:42:25.300] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:49:0)
[13:42:25.314] Build status: STARTED
[13:42:25.314] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:50:0) after 2m8s
[13:44:33.412] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:50:0)
[13:44:33.432] Build status: STARTED
[13:44:33.432] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:51:0) after 8m17s
[13:52:50.462] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:51:0)
[13:52:50.480] Build status: STARTED
[13:52:50.480] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:52:0) after 9m42s
[14:02:32.520] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:52:0)
[14:02:32.540] Build status: STARTED
[14:02:32.540] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:53:0) after 5m59s
[14:08:31.583] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:53:0)
[14:08:31.607] Build status: STARTED
[14:08:31.607] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:54:0) after 1m28s
[14:09:59.786] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:54:0)
[14:09:59.817] Build status: STARTED
[14:09:59.817] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:55:0) after 8m24s
[14:18:23.910] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:55:0)
[14:18:23.933] Build status: STARTED
[14:18:23.933] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:56:0) after 3m13s
[14:21:37.068] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:56:0)
[14:21:37.085] Build status: STARTED
[14:21:37.086] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:57:0) after 7m46s
[14:29:23.078] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:57:0)
[14:29:23.109] Build status: STARTED
[14:29:23.109] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:58:0) after 1m58s
[14:31:21.132] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:58:0)
[14:31:21.151] Build status: STARTED
[14:31:21.151] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:59:0) after 7m16s
[14:38:37.231] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:59:0)
[14:38:37.307] Build status: STARTED
[14:38:37.307] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:60:0) after 6m1s
[14:44:38.437] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:60:0)
[14:44:38.512] Build status: STARTED
[14:44:38.512] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:61:0) after 3m12s
[14:47:50.553] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:61:0)
[14:47:50.573] Build status: STARTED
[14:47:50.573] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:62:0) after 1m30s
[14:49:20.636] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:62:0)
[14:49:20.660] Build status: STARTED
[14:49:20.660] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:63:0) after 4m8s
[14:53:28.681] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:63:0)
[14:53:28.708] Build status: STARTED
[14:53:28.708] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:64:0) after 7m19s
[15:00:47.744] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:64:0)
[15:00:47.809] Build status: STARTED
[15:00:47.809] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:65:0) after 1m59s
[15:02:46.832] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:65:0)
[15:02:46.860] Build status: STARTED
[15:02:46.860] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:66:0) after 6m37s
[15:09:23.882] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:66:0)
[15:09:23.912] Build status: STARTED
[15:09:23.912] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:67:0) after 4m33s
[15:13:56.947] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:67:0)
[15:13:57.002] Build status: STARTED
[15:13:57.002] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:68:0) after 7m57s
[15:21:54.042] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:68:0)
[15:21:54.064] Build status: STARTED
[15:21:54.064] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:69:0) after 4m9s
[15:26:03.256] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:69:0)
[15:26:03.293] Build status: STARTED
[15:26:03.293] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8875989016315230288:70:0) after 7m3s
[15:28:50.752] Received PubSub notification, asking Buildbucket for the build status
[15:28:50.771] Build:
{
"id": "8710558954210725425",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "CrWinAsan"
},
"number": 19070,
"createdBy": "project:chromium",
"createTime": "2025-07-01T09:04:26.034307756Z",
"startTime": "2025-07-01T10:01:52.005503666Z",
"endTime": "2025-07-01T15:28:50.321751608Z",
"updateTime": "2025-07-01T15:28:50.321751608Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "605586817006b05d1689b2da7c5bd83a614417ea",
"ref": "refs/heads/main"
}
},
"canary": true
}
[15:28:50.771] Invocation finished in 6h24m26.126407187s with status FAILED