A sensitive and simple method for detecting Cu2+ in the water source was proposed by using surface-enhanced Raman scattering spectroscopy (SERS) based on the Ag@SiO2/Au core-shell composite. The Ag@SiO2 SERS tag was synthesized by a simple approach, in which Ag nanoparticles were first embedded with Raman reporter PATP and next coated with a SiO2 shell. The Ag@SiO2 nanoparticles had strong stability even in a high-concentration salty solution, and there were no changes to their properties and appearance within one month. The Ag@SiO2/Au composite was fabricated through a controllable self-assemble process. L-cysteine was decorated on the surface of a functionalized Ag@SiO2/Au composite, as the amino and carboxyl groups of it can form coordinate covalent bond with Cu2+, which shows that the Ag@SiO2/Au composite labelled with L-cysteine has excellent performance for the detection of Cu2+ in aqueous media. In this study, the SERS detection of Cu2+ was carried out using Ag@SiO2 nanoparticles, and the limit of detection (LOD) as low as 0.1 mg/L was achieved.