The exact cause of colorectal cancer is not known. However, most colorectal cancers begin as a polyp—a growth on the inner lining of the colon or rectum. Some polyps can change into cancer over time (usually many years), but not all polyps become cancer. The chance of a polyp turning into cancer depends on the type of polyp it is.