This paper introduces AutoChi, a novel statistical software for automated hypothesis testing and statistical analysis using non-parametric chi-square and pairwise post-hoc z-tests. The first novelty of AutoChi is exhaustive and automated hypothesis testing and reporting, comparing all groups and pairwise comparisons. Although several software packages and libraries are available for statistical analysis, including R packages, Python libraries, and ready-to-use software packages with graphical user interfaces (GUI), only a small percentage of these software library tools implement end-to-end automated statistical analysis through a user-friendly graphical user interface. Furthermore, no software tool was found to carry out end-to-end automated statistical analysis for testing differences in proportions, followed by post-hoc statistical tests and visual analysis. AutoChi addresses both gaps for chi-square testing, namely the gap with respect to a fully integrated automated workflow and the gap with respect to post-hoc statistical and visual analysis. The novelty of AutoChi is the application of graph analytics through dominance graphs and arc diagrams to visualize the results of all the conducted tests. Overall, AutoChi can accelerate data analysis and hypothesis testing through automation and enable rapid generation of insights through post-hoc visual analysis that are currently not conveniently possible in existing statistical software.