[19:19:58.805] New invocation is queued and will start shortly
[19:20:05.764] Starting the invocation (attempt 1)
[19:20:05.817] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f119911b8eecc51607ae1d665ddeb3e3d1bf8ae5"
[19:20:05.817] Popped gitiles commit info from properties and tags
[19:20:05.817] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:20:05.817] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:20:05.817] Buildbucket request:
{
"requestId": "8972345460305937552",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f119911b8eecc51607ae1d665ddeb3e3d1bf8ae5",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8972345460305937552"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:20:06.341] Scheduled build:
{
"id": "8806915392200086529",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 17191,
"createdBy": "project:chromium",
"createTime": "2022-08-02T19:20:05.903730628Z",
"updateTime": "2022-08-02T19:20:05.903730628Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f119911b8eecc51607ae1d665ddeb3e3d1bf8ae5",
"ref": "refs/heads/main"
}
}
}
[19:20:06.341] Task URL: https://cr-buildbucket.appspot.com/build/8806915392200086529
[19:20:06.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:2:0) after 7m9s
[19:23:35.924] Received PubSub notification, asking Buildbucket for the build status
[19:23:36.023] Build status: STARTED
[19:27:15.806] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:2:0)
[19:27:15.826] Build status: STARTED
[19:27:15.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:4:0) after 7m1s
[19:34:16.846] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:4:0)
[19:34:16.864] Build status: STARTED
[19:34:16.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:5:0) after 6m20s
[19:40:36.921] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:5:0)
[19:40:36.972] Build status: STARTED
[19:40:36.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:6:0) after 2m36s
[19:43:13.212] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:6:0)
[19:43:13.233] Build status: STARTED
[19:43:13.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:7:0) after 5m54s
[19:49:07.251] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:7:0)
[19:49:07.272] Build status: STARTED
[19:49:07.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:8:0) after 3m59s
[19:53:06.342] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:8:0)
[19:53:06.377] Build status: STARTED
[19:53:06.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:9:0) after 5m42s
[19:58:48.573] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:9:0)
[19:58:48.608] Build status: STARTED
[19:58:48.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:10:0) after 8m18s
[20:07:07.094] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:10:0)
[20:07:07.180] Build status: STARTED
[20:07:07.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:11:0) after 2m29s
[20:09:36.202] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:11:0)
[20:09:36.252] Build status: STARTED
[20:09:36.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:12:0) after 2m3s
[20:11:39.323] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:12:0)
[20:11:39.346] Build status: STARTED
[20:11:39.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:13:0) after 2m33s
[20:14:12.410] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:13:0)
[20:14:12.451] Build status: STARTED
[20:14:12.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:14:0) after 9m37s
[20:23:49.641] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:14:0)
[20:23:49.663] Build status: STARTED
[20:23:49.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:15:0) after 9m35s
[20:33:24.940] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:15:0)
[20:33:24.974] Build status: STARTED
[20:33:24.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:16:0) after 3m21s
[20:36:45.992] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:16:0)
[20:36:46.029] Build status: STARTED
[20:36:46.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:17:0) after 4m20s
[20:41:06.045] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:17:0)
[20:41:06.079] Build status: STARTED
[20:41:06.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:18:0) after 6m32s
[20:47:38.113] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:18:0)
[20:47:38.169] Build status: STARTED
[20:47:38.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:19:0) after 5m15s
[20:52:53.191] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:19:0)
[20:52:53.217] Build status: STARTED
[20:52:53.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:20:0) after 7m10s
[21:00:03.485] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:20:0)
[21:00:03.510] Build status: STARTED
[21:00:03.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:21:0) after 4m11s
[21:04:14.760] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:21:0)
[21:04:14.786] Build status: STARTED
[21:04:14.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:22:0) after 1m33s
[21:05:48.086] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:22:0)
[21:05:48.114] Build status: STARTED
[21:05:48.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:23:0) after 1m32s
[21:07:20.135] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:23:0)
[21:07:20.161] Build status: STARTED
[21:07:20.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:24:0) after 4m57s
[21:12:17.549] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:24:0)
[21:12:17.589] Build status: STARTED
[21:12:17.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:25:0) after 3m21s
[21:15:38.609] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:25:0)
[21:15:38.900] Build status: STARTED
[21:15:38.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:26:0) after 6m51s
[21:22:30.000] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:26:0)
[21:22:30.024] Build status: STARTED
[21:22:30.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:27:0) after 8m41s
[21:31:11.073] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:27:0)
[21:31:11.132] Build status: STARTED
[21:31:11.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:28:0) after 5m49s
[21:37:00.252] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:28:0)
[21:37:00.274] Build status: STARTED
[21:37:00.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:29:0) after 9m36s
[21:46:36.337] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:29:0)
[21:46:36.358] Build status: STARTED
[21:46:36.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:30:0) after 7m49s
[21:54:25.428] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:30:0)
[21:54:25.449] Build status: STARTED
[21:54:25.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:31:0) after 8m37s
[22:03:02.470] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:31:0)
[22:03:02.502] Build status: STARTED
[22:03:02.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:32:0) after 5m57s
[22:08:59.868] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:32:0)
[22:08:59.900] Build status: STARTED
[22:08:59.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:33:0) after 6m23s
[22:15:23.026] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:33:0)
[22:15:23.048] Build status: STARTED
[22:15:23.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:34:0) after 3m43s
[22:19:06.255] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:34:0)
[22:19:06.276] Build status: STARTED
[22:19:06.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:35:0) after 2m7s
[22:21:13.297] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:35:0)
[22:21:13.333] Build status: STARTED
[22:21:13.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:36:0) after 1m13s
[22:22:26.416] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:36:0)
[22:22:26.456] Build status: STARTED
[22:22:26.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:37:0) after 6m24s
[22:28:50.590] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:37:0)
[22:28:50.614] Build status: STARTED
[22:28:50.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:38:0) after 1m47s
[22:30:37.634] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:38:0)
[22:30:37.657] Build status: STARTED
[22:30:37.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:39:0) after 4m53s
[22:35:30.925] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:39:0)
[22:35:30.953] Build status: STARTED
[22:35:30.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:40:0) after 5m5s
[22:40:35.994] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:40:0)
[22:40:36.032] Build status: STARTED
[22:40:36.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:41:0) after 3m16s
[22:43:52.386] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:41:0)
[22:43:52.465] Build status: STARTED
[22:43:52.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:42:0) after 2m32s
[22:46:24.649] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:42:0)
[22:46:24.677] Build status: STARTED
[22:46:24.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:43:0) after 3m16s
[22:49:40.797] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:43:0)
[22:49:40.831] Build status: STARTED
[22:49:40.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:44:0) after 4m44s
[22:54:24.902] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:44:0)
[22:54:24.984] Build status: STARTED
[22:54:24.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:45:0) after 8m54s
[23:03:19.289] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:45:0)
[23:03:19.326] Build status: STARTED
[23:03:19.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:46:0) after 8m49s
[23:12:08.614] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:46:0)
[23:12:08.649] Build status: STARTED
[23:12:08.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:47:0) after 8m33s
[23:20:42.144] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:47:0)
[23:20:42.185] Build status: STARTED
[23:20:42.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:48:0) after 4m54s
[23:25:36.206] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:48:0)
[23:25:36.237] Build status: STARTED
[23:25:36.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:49:0) after 3m21s
[23:28:57.264] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:49:0)
[23:28:57.333] Build status: STARTED
[23:28:57.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:50:0) after 2m20s
[23:31:17.358] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:50:0)
[23:31:17.384] Build status: STARTED
[23:31:17.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:51:0) after 7m41s
[23:38:58.539] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:51:0)
[23:38:58.575] Build status: STARTED
[23:38:58.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:52:0) after 9m22s
[23:48:20.631] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:52:0)
[23:48:20.652] Build status: STARTED
[23:48:20.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:53:0) after 3m38s
[23:51:58.709] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:53:0)
[23:51:58.730] Build status: STARTED
[23:51:58.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:54:0) after 9m35s
[00:01:33.754] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:54:0)
[00:01:33.777] Build status: STARTED
[00:01:33.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:55:0) after 6m29s
[00:08:02.801] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:55:0)
[00:08:02.830] Build status: STARTED
[00:08:02.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:56:0) after 9m20s
[00:17:23.158] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:56:0)
[00:17:23.187] Build status: STARTED
[00:17:23.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:57:0) after 9m50s
[00:27:13.208] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:57:0)
[00:27:13.235] Build status: STARTED
[00:27:13.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:58:0) after 3m46s
[00:30:59.259] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:58:0)
[00:30:59.298] Build status: STARTED
[00:30:59.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:59:0) after 7m16s
[00:38:15.419] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:59:0)
[00:38:15.450] Build status: STARTED
[00:38:15.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:60:0) after 5m20s
[00:43:35.468] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:60:0)
[00:43:35.498] Build status: STARTED
[00:43:35.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:61:0) after 7m9s
[00:50:44.533] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:61:0)
[00:50:44.564] Build status: STARTED
[00:50:44.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:62:0) after 9m45s
[01:00:29.603] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:62:0)
[01:00:29.642] Build status: STARTED
[01:00:29.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:63:0) after 8m28s
[01:08:57.789] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:63:0)
[01:08:57.828] Build status: STARTED
[01:08:57.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8972345460305937552:64:0) after 7m40s
[01:11:55.294] Received PubSub notification, asking Buildbucket for the build status
[01:11:55.317] Build:
{
"id": "8806915392200086529",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxASan"
},
"number": 17191,
"createdBy": "project:chromium",
"createTime": "2022-08-02T19:20:05.903730628Z",
"startTime": "2022-08-02T19:23:35.021778Z",
"endTime": "2022-08-03T01:11:51.320544926Z",
"updateTime": "2022-08-03T01:11:51.320544926Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f119911b8eecc51607ae1d665ddeb3e3d1bf8ae5",
"ref": "refs/heads/main"
}
}
}
[01:11:55.317] Invocation finished in 5h51m56.526633028s with status FAILED