Changes in the amount and distribution of rainfall highly impact agricultural production in predominantly rainfed farming systems in Africa. Reliable rainfall forecasts on a daily timescale are vital for in-season decision-making. This study evaluated the relative prediction abilities of the European Centre for Medium-Range Weather Forecasts Season 5.1 (ECMWFSv5.1) and the Climate Forecast System version 2 (CFSv2) gridded rainfall models across Africa and three sub-regions from 2012–2022. The results indicate that the performance of both models declines with increasing lead times and improves with aggregated or coarser temporal resolutions. ECMWFv5.1 consistently represented observed daily rainfall better than CFSv2 at all lead times, particularly in West Africa. On dekadal timescales, ECMWFv5.1 outperformed CFSv2 across all sub-regions. CFSv2 tended to overestimate low- and high-intensity rainfall events, whereas ECMWFv5.1 slightly underestimated low-intensity rainfall but accurately captured high-intensity events. While ECMWFv5.1 showed superior skill overall, model reliability was generally limited to West Africa; in contrast, both models performed poorly in East Africa. The high probability of detection (POD) indicates that the models are generally effective at identifying rainy days. However, their overall accuracy in forecasting rainfall across Africa varies depending on lead time, region, rainfall intensity, and elevation. While we did not apply bias-correction methods in this study, we recommend that such techniques be used in future work to improve the reliability of forecasts for operational and sectoral applications. This study therefore highlights both the strengths and the limitations of CFSv2 and ECMWFv5.1 for climate impact assessments, particularly in West Africa and low-elevation regions.