Appropriateness of performance indices for imbalanced data classification: An analysis

•Applicability of popular indices on imbalanced classification problem is analyzed.•Two fundamental constraints are proposed to evaluate the appropriateness of an index.•Remedial modifications are suggested in case of violation of constraint.•A third proposed condition validates the quality of information returned by an index.•Theoretical findings are empirically validated through extensive experiments.