While not all polyps turn into cancer, certain types, particularly adenomatous and large serrated polyps, have a higher potential to become colorectal cancer. Regular screening and removal of polyps are crucial in preventing the progression to cancer.