Prostate cancer (CaP) is the second most diagnosed cancer in men all over the world. In the last decades, new imaging techniques based on magnetic resonance imaging (MRI) have been developed improving diagnosis. In practice, diagnosis is affected by multiple factors such as observer variability and visibility and complexity of the lesions. In this regard, computer-aided detection and diagnosis (CAD) systems are being designed to help radiologists in their clinical practice. We propose a CAD system taking advantage of all MRI modalities (i.e., T2-W-MRI, DCE-MRI, diffusion weighted (DW)-MRI, MRSI). The aim of this CAD system was to provide a probabilistic map of cancer location in the prostate. We extensively tested our proposed CAD using different fusion approaches to combine the features provided by each modality. The source code and the dataset have been released. © 2017 IEEE.