… We describe a permutation procedure used extensively in classification problems in … behavior
of the test. An interesting observation is that concentration of the permutation procedure is …

… Before we proceed, it is worth mentioning that permutation tests have been used … of permutation
tests and the work presented in this paper in Section 3.1. We believe permutation testing …

… call it as Test 1 in the next section where the permutation tests are presented. This simple
traditional test has already been … we obtain useful statistics about the classification result. No …

… observed classification error. In the next section, we provide the necessary background on
hypothesis testing and permutation tests. In Section 3, we extend the permutation procedure …

… test of covariate balance. Our … test that formalizes the question of whether the covariates
can predict treatment status. The test makes use of classification methods and permutation …

… permutation tests for binary classification problems and evaluate different strategies for
accelerating permutation tests… approximation of permutation tests for binary classification first on a …

… This paper develops a nonparametric test that formalizes the … The test makes use of
classification methods and permutation inference, and we name it the Classification Permutation Test …

… To further illustrate the issues of permutation testing for fairness, we will discuss tests of fairness
based … an algorithm for testing fairness for a general classification or regression problem. …

… created for each iteration of the permutation test as similar as possible to the true-labeled
dataset: the examples are relabeled first, then the classification is performed exactly as on the …

… are used for classification. To estimate p-values we used Fisher’s permutation test. A simple
… Finally, we performed extensive experimentation to evaluate the proposed permutation-…