In order to better reflect the characteristics of brittle failure of rockburst in deep tunnel, an elasto-brittle-plastic constitutive model based on combined failure criterion for brittle rock was employed in the numerical simulation of rockburst. A rockburst prediction system based on various criteria and methods was established to predict the rockburst during the excavation of the auxiliary tunnel of Jinping-II hydropower station. The analysis showed that rockburst was more possible to happen at the shoulder and bottom corner points of the tunnel, which was consistent with the in-situ actual observations.