[05:18:28.630] New invocation is queued and will start shortly
[05:18:29.724] Starting the invocation (attempt 1)
[05:18:29.762] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a55aac040d6ff94e1b8759b1f632394764e76a88"
[05:18:29.762] Popped gitiles commit info from properties and tags
[05:18:29.762] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:18:29.762] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:18:29.763] Buildbucket request:
{
"requestId": "8981639293673775792",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a55aac040d6ff94e1b8759b1f632394764e76a88",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8981639293673775792"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[05:18:30.272] Scheduled build:
{
"id": "8816209231722175329",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 15974,
"createdBy": "project:chromium",
"createTime": "2022-04-22T05:18:29.850529763Z",
"updateTime": "2022-04-22T05:18:29.850529763Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a55aac040d6ff94e1b8759b1f632394764e76a88",
"ref": "refs/heads/main"
}
}
}
[05:18:30.272] Task URL: https://cr-buildbucket.appspot.com/build/8816209231722175329
[05:18:30.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:2:0) after 7m21s
[05:20:40.167] Received PubSub notification, asking Buildbucket for the build status
[05:20:40.186] Build status: STARTED
[05:25:51.481] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:2:0)
[05:25:51.540] Build status: STARTED
[05:25:51.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:4:0) after 3m19s
[05:29:10.563] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:4:0)
[05:29:10.583] Build status: STARTED
[05:29:10.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:5:0) after 3m36s
[05:32:46.643] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:5:0)
[05:32:46.665] Build status: STARTED
[05:32:46.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:6:0) after 9m59s
[05:42:45.690] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:6:0)
[05:42:45.714] Build status: STARTED
[05:42:45.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:7:0) after 2m35s
[05:45:20.771] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:7:0)
[05:45:20.791] Build status: STARTED
[05:45:20.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:8:0) after 9m40s
[05:55:00.979] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:8:0)
[05:55:00.997] Build status: STARTED
[05:55:00.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:9:0) after 6m40s
[06:01:41.349] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:9:0)
[06:01:41.583] Build status: STARTED
[06:01:41.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:10:0) after 2m52s
[06:04:33.600] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:10:0)
[06:04:33.620] Build status: STARTED
[06:04:33.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:11:0) after 9m53s
[06:14:26.692] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:11:0)
[06:14:26.712] Build status: STARTED
[06:14:26.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:12:0) after 9m33s
[06:23:59.732] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:12:0)
[06:23:59.761] Build status: STARTED
[06:23:59.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:13:0) after 6m34s
[06:30:33.881] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:13:0)
[06:30:33.929] Build status: STARTED
[06:30:33.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:14:0) after 8m11s
[06:38:44.950] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:14:0)
[06:38:44.969] Build status: STARTED
[06:38:44.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:15:0) after 4m8s
[06:42:53.166] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:15:0)
[06:42:53.189] Build status: STARTED
[06:42:53.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:16:0) after 1m34s
[06:44:27.383] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:16:0)
[06:44:27.405] Build status: STARTED
[06:44:27.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:17:0) after 1m58s
[06:46:25.540] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:17:0)
[06:46:25.565] Build status: STARTED
[06:46:25.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:18:0) after 8m36s
[06:55:01.731] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:18:0)
[06:55:01.755] Build status: STARTED
[06:55:01.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:19:0) after 1m8s
[06:56:09.885] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:19:0)
[06:56:09.905] Build status: STARTED
[06:56:09.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:20:0) after 4m20s
[07:00:29.927] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:20:0)
[07:00:29.967] Build status: STARTED
[07:00:29.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:21:0) after 2m46s
[07:03:16.010] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:21:0)
[07:03:16.033] Build status: STARTED
[07:03:16.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:22:0) after 6m43s
[07:09:59.245] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:22:0)
[07:09:59.280] Build status: STARTED
[07:09:59.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:23:0) after 7m54s
[07:17:53.299] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:23:0)
[07:17:53.319] Build status: STARTED
[07:17:53.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:24:0) after 9m13s
[07:27:06.340] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:24:0)
[07:27:06.365] Build status: STARTED
[07:27:06.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:25:0) after 4m5s
[07:31:11.480] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:25:0)
[07:31:11.502] Build status: STARTED
[07:31:11.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:26:0) after 6m16s
[07:37:27.522] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:26:0)
[07:37:27.545] Build status: STARTED
[07:37:27.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:27:0) after 5m50s
[07:43:17.611] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:27:0)
[07:43:17.670] Build status: STARTED
[07:43:17.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:28:0) after 1m21s
[07:44:38.693] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:28:0)
[07:44:38.718] Build status: STARTED
[07:44:38.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:29:0) after 2m5s
[07:46:43.842] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:29:0)
[07:46:43.867] Build status: STARTED
[07:46:43.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:30:0) after 9m11s
[07:55:55.008] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:30:0)
[07:55:55.029] Build status: STARTED
[07:55:55.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:31:0) after 5m43s
[08:01:38.192] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:31:0)
[08:01:38.256] Build status: STARTED
[08:01:38.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:32:0) after 5m11s
[08:06:49.277] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:32:0)
[08:06:49.299] Build status: STARTED
[08:06:49.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:33:0) after 9m27s
[08:16:16.479] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:33:0)
[08:16:16.501] Build status: STARTED
[08:16:16.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:34:0) after 7m41s
[08:23:57.561] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:34:0)
[08:23:57.581] Build status: STARTED
[08:23:57.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:35:0) after 9m13s
[08:33:10.616] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:35:0)
[08:33:10.644] Build status: STARTED
[08:33:10.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:36:0) after 5m16s
[08:38:26.846] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:36:0)
[08:38:26.941] Build status: STARTED
[08:38:26.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:37:0) after 8m24s
[08:46:50.962] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:37:0)
[08:46:51.007] Build status: STARTED
[08:46:51.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:38:0) after 3m25s
[08:50:16.128] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:38:0)
[08:50:16.167] Build status: STARTED
[08:50:16.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:39:0) after 4m35s
[08:54:51.154] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:39:0)
[08:54:51.176] Build status: STARTED
[08:54:51.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:40:0) after 7m22s
[09:02:13.913] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:40:0)
[09:02:13.937] Build status: STARTED
[09:02:13.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:41:0) after 7m3s
[09:09:16.960] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:41:0)
[09:09:16.984] Build status: STARTED
[09:09:16.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:42:0) after 2m58s
[09:12:15.227] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:42:0)
[09:12:15.265] Build status: STARTED
[09:12:15.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:43:0) after 8m21s
[09:20:36.471] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:43:0)
[09:20:36.491] Build status: STARTED
[09:20:36.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:44:0) after 4m45s
[09:25:21.708] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:44:0)
[09:25:21.729] Build status: STARTED
[09:25:21.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:45:0) after 9m15s
[09:34:36.757] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:45:0)
[09:34:36.778] Build status: STARTED
[09:34:36.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:46:0) after 3m9s
[09:37:45.930] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:46:0)
[09:37:45.954] Build status: STARTED
[09:37:45.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:47:0) after 4m58s
[09:42:43.988] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:47:0)
[09:42:44.010] Build status: STARTED
[09:42:44.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:48:0) after 2m32s
[09:45:16.050] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:48:0)
[09:45:16.085] Build status: STARTED
[09:45:16.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:49:0) after 7m43s
[09:52:59.098] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:49:0)
[09:52:59.124] Build status: STARTED
[09:52:59.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:50:0) after 8m6s
[10:01:05.464] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:50:0)
[10:01:05.493] Build status: STARTED
[10:01:05.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:51:0) after 4m49s
[10:05:54.674] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:51:0)
[10:05:54.729] Build status: STARTED
[10:05:54.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:52:0) after 3m23s
[10:09:17.763] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:52:0)
[10:09:17.793] Build status: STARTED
[10:09:17.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:53:0) after 9m32s
[10:18:49.912] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:53:0)
[10:18:49.932] Build status: STARTED
[10:18:49.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:54:0) after 3m40s
[10:22:29.991] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:54:0)
[10:22:30.025] Build status: STARTED
[10:22:30.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:55:0) after 3m54s
[10:26:24.409] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:55:0)
[10:26:24.432] Build status: STARTED
[10:26:24.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:56:0) after 6m42s
[10:33:06.879] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:56:0)
[10:33:06.909] Build status: STARTED
[10:33:06.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:57:0) after 1m20s
[10:34:27.032] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:57:0)
[10:34:27.107] Build status: STARTED
[10:34:27.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:58:0) after 9m11s
[10:43:38.366] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:58:0)
[10:43:38.403] Build status: STARTED
[10:43:38.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:59:0) after 7m4s
[10:50:42.434] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:59:0)
[10:50:42.459] Build status: STARTED
[10:50:42.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:60:0) after 3m19s
[10:54:01.804] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:60:0)
[10:54:01.861] Build status: STARTED
[10:54:01.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:61:0) after 1m58s
[10:56:00.053] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:61:0)
[10:56:00.073] Build status: STARTED
[10:56:00.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:62:0) after 4m41s
[11:00:41.094] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:62:0)
[11:00:41.115] Build status: STARTED
[11:00:41.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:63:0) after 3m59s
[11:04:40.180] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:63:0)
[11:04:40.203] Build status: STARTED
[11:04:40.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:64:0) after 1m15s
[11:05:55.233] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:64:0)
[11:05:55.260] Build status: STARTED
[11:05:55.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:65:0) after 7m4s
[11:12:59.291] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:65:0)
[11:12:59.315] Build status: STARTED
[11:12:59.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8981639293673775792:66:0) after 1m39s
[11:13:59.358] Received PubSub notification, asking Buildbucket for the build status
[11:13:59.434] Build:
{
"id": "8816209231722175329",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 15974,
"createdBy": "project:chromium",
"createTime": "2022-04-22T05:18:29.850529763Z",
"startTime": "2022-04-22T05:20:39.609290Z",
"endTime": "2022-04-22T11:13:59.078309077Z",
"updateTime": "2022-04-22T11:13:59.078309077Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a55aac040d6ff94e1b8759b1f632394764e76a88",
"ref": "refs/heads/main"
}
}
}
[11:13:59.434] Invocation finished in 5h55m30.828103614s with status FAILED