Yes we have "Show only available options for each input" enabled, disabling this options really improves page loading times.
I will speak to my client, if this would be an option.
Edit: A good tradeoff would be to enable/disable this on a per-filter basis. I.e. we have 10+ taxonomies, but only would need about 2 or 3 to be already prefiltered
With the "Show only available options for each input" live queries are done to ensure that only the options that will produce a result will be available. This can have a speed impact as you can imagine you will need to pull all the items and check the post database in order to return only those options.
Hopefully your client will agree to have this option disabled. There will be some tradeoffs as the "Show only available options for each input" is far more complex than just leaving it disabled.