While occasional chills are not always a cause for concern, persistent or severe chills, especially when accompanied by other symptoms like fever, weight loss, or night sweats, should prompt an immediate visit to a healthcare provider. These could be signs of an underlying infection or a complication related to cancer.