Multiple sclerosis (MS) is an inflammatory and degenerative disease of the central nervous system (CNS) that causes white matter and cortical lesions over many years. The CNS is selectively affected by the disease with a great variety of symptoms between patients. In this study, we describe the impact on various aspects of cognition over an 8-year follow-up period in 31 consecutive MS patients subgrouped as relapsing remitting (RR) MS, secondary progressive (SP) MS, and primary progressive (PP) MS. Results showed a differential pattern of cognitive decline already at baseline in speed of information processing. During the follow-up, a pronounced decline occurred in speed of information processing, finger-motor speed, copying geometrical designs, episodic memory, and visuospatial short-term memory. A striking difference was observed between a marked decline in visual reaction time, whereas no significant change was seen in auditory reaction time. In contrast, there was no time-related decline in verbal abilities. However, an initial marked cognitive impairment predicted further cognitive decline over the 8-year follow-up. Information-processing tests were found to be an especially strong predictor of long-term cognitive decline. In addition, high EDSS score at followup was associated with decline in information processes. Results also showed that SP-MS patients deteriorated significantly more than the other two groups, particularly in visual compared to auditory information processing. To conclude, cognitive decline appeared particularly in SP-MS patients and in visual information processing.