Publication announcement: 'Trimmed Harrell-Davis quantile estimator based on the highest density interval of the given width'
Since the beginning of previous year, I have been working on building a quantile estimator that provides an optimal trade-off between statistical efficiency and robustness. At the end of the year, I published the corresponding preprint where I presented a description of such an estimator: arXiv:2111.11776 [stat.ME]. The paper source code is available on GitHub: AndreyAkinshin/paper-thdqe.
Finally, the paper was published in Communications in Statistics - Simulation and Computation. You can cite it as follows:
- Andrey Akinshin (2022) Trimmed Harrell-Davis quantile estimator based on the highest density interval of the given width, Communications in Statistics - Simulation and Computation, DOI: 10.1080/03610918.2022.2050396
Here is the corresponding BibTeX reference:
@article{akinshin2022thdqe,
author = {Andrey Akinshin},
title = {Trimmed Harrell-Davis quantile estimator based on the highest density interval of the given width},
journal = {Communications in Statistics - Simulation and Computation},
pages = {1-11},
year = {2022},
publisher = {Taylor & Francis},
doi = {10.1080/03610918.2022.2050396},
URL = {https://www.tandfonline.com/doi/abs/10.1080/03610918.2022.2050396},
eprint = {https://www.tandfonline.com/doi/pdf/10.1080/03610918.2022.2050396},
abstract = {Traditional quantile estimators that are based on one or two order statistics are a common way to estimate distribution quantiles based on the given samples. These estimators are robust, but their statistical efficiency is not always good enough. A more efficient alternative is the Harrell-Davis quantile estimator which uses a weighted sum of all order statistics. Whereas this approach provides more accurate estimations for the light-tailed distributions, it’s not robust. To be able to customize the tradeoff between statistical efficiency and robustness, we could consider a trimmed modification of the Harrell-Davis quantile estimator. In this approach, we discard order statistics with low weights according to the highest density interval of the beta distribution.}
}
Relevant blog posts
Here is the full list of relevant blog posts:
- Winsorized modification of the Harrell-Davis quantile estimator (2021-03-02)
- Efficiency of the Harrell-Davis quantile estimator (2021-03-23)
- Trimmed modification of the Harrell-Davis quantile estimator (2021-03-30)
- Efficiency of the winsorized and trimmed Harrell-Davis quantile estimators (2021-04-06)
- Improving the efficiency of the Harrell-Davis quantile estimator for special cases using custom winsorizing and trimming strategies (2021-05-25)
- Optimal threshold of the trimmed Harrell-Davis quantile estimator (2021-07-20)
- Avoiding over-trimming with the trimmed Harrell-Davis quantile estimator (2021-07-27)
- Quantile estimators based on k order statistics, Part 1: Motivation (2021-08-03)
- Quantile estimators based on k order statistics, Part 2: Extending Hyndman-Fan equations (2021-08-10)
- Quantile estimators based on k order statistics, Part 3: Playing with the Beta function (2021-08-17)
- Quantile estimators based on k order statistics, Part 4: Adopting trimmed Harrell-Davis quantile estimator (2021-08-24)
- Quantile estimators based on k order statistics, Part 5: Improving trimmed Harrell-Davis quantile estimator (2021-08-31)
- Quantile estimators based on k order statistics, Part 6: Continuous trimmed Harrell-Davis quantile estimator (2021-09-07)
- Quantile estimators based on k order statistics, Part 7: Optimal threshold for the trimmed Harrell-Davis quantile estimator (2021-09-14)
- Quantile estimators based on k order statistics, Part 8: Winsorized Harrell-Davis quantile estimator (2021-09-21)
- Beta distribution highest density interval of the given width (2021-09-28)
- Optimal window of the trimmed Harrell-Davis quantile estimator, Part 1: Problems with the rectangular window (2021-10-05)
- Optimal window of the trimmed Harrell-Davis quantile estimator, Part 2: Trying Planck-taper window (2021-10-12)
- Trimmed Harrell-Davis quantile estimator based on the highest density interval of the given width (2021-10-19)
- Preprint announcement: 'Trimmed Harrell-Davis quantile estimator based on the highest density interval of the given width' (2021-11-30)
- Publication announcement: 'Trimmed Harrell-Davis quantile estimator based on the highest density interval of the given width' (2022-03-22)