According to a French news site, a staff member from the Saint-Sulpice church alerted the authorities about the suspect.
The news about the famous Paris cathedral shocked the world on the 15th of April 2019.
Trans-activists want to rename the Cathedral "Our Lady of the Survivors of Child Crime."
The 28-year-old suspect was found with a loaded gun and had already been known for other offences.
French Catholics have been subjected to persecution since the eighteenth century.
All the statues weigh at least fifty kilos and some of them are almost one meter high.
The bust is located at the entrance of the church, which is the oldest and largest Polish Catholic parish in the city.
In France, all churches built before 1905 are public property for the use of diocesan associations.