Objective To summarize the best evidence of rehabilitative exercise for patients with chronic nonspecific low back pain, and to provide a basis for clinical selection of appropriate rehabilitative exercise programs. Methods A computerized search was performed on Best Practice (BMJ), UpToDate, PubMed, Cochrane Library, Web of Science, Embase, Joanna Briggs Institute Evidence-Based Health Care Database, SinoMed, China National Knowledge Infrastructure (CNKI), Wanfang Data, VIP Database, Medlive, the National Institute for Health and Care Excellence (NICE), New Zealand Guidelines Group (NZGG), Guidelines International Network (GIN) for evidence on exercise in patients with chronic nonspecific low back pain. The types of literature searched included clinical decision-making, guidelines, evidence summaries, systematic reviews, and expert consensus, and the time frame for the search was from January 2013 to May 2024. Two researchers trained in evidence-based knowledge evaluated the quality of the included literature, and then extracted and summarized the evidence from those literature that met the quality requirements. Results A total of 15 publications (2 guidelines, 1 expert consensus statement, 2 clinical decisions reports, 1 randomized controlled trial and 9 systematic reviews) were included. A total of 27 pieces of evidence were summarized and 6 aspects integrated, namely, benefits and safety of exercise, development of exercise program, implementation of exercise program, type of exercise, duration of exercise, and exercise monitoring. Conclusion Rehabilitative exercise therapy can effectively relieve pain, exercise muscles, enhance spinal stability, and improve the quality of life in patients with chronic nonspecific low back pain. Medical staff should select the evidence according to the actual situation and develop a safe, scientific and individualized exercise plan for patients to promote their recovery.