Quantile estimators based on k order statistics, Part 6: Continuous trimmed Harrell-Davis quantile estimator

by Andrey Akinshin · 2021-09-07
Update: this blog post is a part of research that aimed to build a statistically efficient and robust quantile estimator. A paper with final results is available in Communications in Statistics - Simulation and Computation (DOI: 10.1080/03610918.2022.2050396). A preprint is available on arXiv: arXiv:2111.11776 [stat.ME]. Some information in this blog post can be obsolete: please, use the official paper as the primary reference.

In my previous post, I tried the idea of using the trimmed modification of the Harrell-Davis quantile estimator based on the highest density interval of the given width. The width was defined so that it covers exactly k order statistics (the width equals $(k-1)/n$). I was pretty satisfied with the result and decided to continue evolving this approach. While “k order statistics” is a good mental model that described the trimmed interval, it doesn’t actually require an integer k. In fact, we can use any real number as the trimming percentage.

In this post, we are going to perform numerical simulations that check the statistical efficiency of the trimmed Harrell-Davis quantile estimator with different trimming percentages.

All posts from this series:

The approach

The primary idea is the same that we used in the previous post. The only difference is that now we set the width of the highest density interval as an estimator parameter.

Numerical simulations

We are going to take the same simulation setup that was declared in this post. Briefly speaking, we evaluate the classic MSE-based relative statistical efficiency of different quantile estimators on samples from different light-tailed and heavy-tailed distributions using the classic Hyndman-Fan Type 7 quantile estimator as the baseline.

The considered estimator based on T% trimming percentage is denoted as “THD-T%”.

Conclusion

It seems that ability to choose an arbitrary trimming percentage is a good step toward an optimal and flexible quantile estimator because it allows setting the breakdown point. Thus, we could easily control the trade-off between statistical efficiency and robustness.