In this paper, we review and classify the disadvantages and risks associated with the use of visual representations of information. We complement a review of literature with expert interviews and focus group results on the practical negative experiences with the use of visual representations of information. Based on these two sources, we distinguish between social, cognitive, and emotional risks of visualization that can be viewed from two perspectives: from the point of view of the user and from the point of view of the designer of a graphic representation. We discuss implications of the identified disadvantages and ways of overcoming or avoiding them. The paper concludes by providing an outlook on overlooked or emergent risks of visualization.