Rs 17,392 in cash has been recovered from the possession of the accused, a resident of the Dara Samote area in Poonch district, they said.
A team of Rajouri police on night patrol noticed some suspicious activity near the religious place, the police said.
The police team found a man hiding there, who later tried to run away. But the police team nabbed him, they said.
During investigation, the accused told police that he broke open the donation box and took the cash from it, police said.
A case has been registered against the man, they said.