HackerPapers

arXiv:2008.11619math.ST

On the power of Chatterjee rank correlation

Hongjian Shi, Mathias Drton, Fang Han

Abstract

Chatterjee (2021) introduced a simple new rank correlation coefficient that has attracted much recent attention. The coefficient has the unusual appeal that it not only estimates a population quantity first proposed by Dette et al. (2013) that is zero if and only if the underlying pair of random variables is independent, but also is asymptotically normal under independence. This paper compares Chatterjee's new correlation coefficient to three established rank correlations that also facilitate consistent tests of independence, namely, Hoeffding's $D$, Blum-Kiefer-Rosenblatt's $R$, and Bergsma-Dassios-Yanagimoto's $τ^*$. We contrast their computational efficiency in light of recent advances, and investigate their power against local rotation and mixture alternatives. Our main results show that Chatterjee's coefficient is unfortunately rate sub-optimal compared to $D$, $R$, and $τ^*$. The situation is more subtle for a related earlier estimator of Dette et al. (2013). These results favor $D$, $R$, and $τ^*$ over Chatterjee's new correlation coefficient for the purpose of testing independence.

arXiv comments
to appear in Biometrika
Journal reference
DOI
Subjects
math.STStatistics Theory

On Hacker News

Linked by 2 identifiable commenters in 2 comments across 1 thread, from Dec 2021 to Dec 2021.

Comments linking this paper, per year.

Discussed in comments1 thread

    • There is also another paper comparing the power of Chatterjee coefficient with other traditional ones. https://arxiv.org/abs/2008.11619

      neeleshsView on HNParent context

    • Freely available version of the review paper, for those who want it: https://arxiv.org/abs/2008.11619

      spekcularView on HNParent context

Submitted to Hacker News

Connected through shared HN threads, not inferred similarity or a recommendation.