Abstract: There was a serious decline in performance of Chinese gymnastics team in Rio, which was the worst showing for them since returning to the Games in 1984. Through using the methods of literature review, video observation and expert interview, this paper makes research on the causes for failure of Chinese gymnastics team at Rio and the countermeasures against preparing for the Tokyo Olympic Games. The result shows that the failure is due to the reasons in four aspects, of which the first is that no overall consideration was given to both difficulty value and execution quality, the second is that fostering all-arounders was not enough in Beijing and London Olympic cycles, the third is that exercise composition was not able to meet the world trend better because of the lack of understanding of the rule, and the fourth is that to win gold medals of team, all-around and apparatus was in passive situation owing to increased weak spots. In the face of the 2020 Tokyo Olympic Games, Chinese gymnastics team should endure hardships and catch up as they can, promote actively the recreational gymnastics program such that a progressive type of the echelon for reserve personnel will be formed, study rule intensively so as to grasp the dialectical relationship between exercise difficulty and execution quality, spare no effort to improve the level of weakness and strive to build top level all-arounders, improve the level of scientific training constantly to prolong the best competitive state of athletes, carry forward international exchanges positively and implement the strategy of “bringing-in” and “going global” in depth.