The Minister of National Education, Pap Ndiaye, points to the problem of wearing Muslim abai by girls and qamis by boys.
In January, two other religious buildings were broken into and desecrated in the Seine-Saint-Denis department.
Two members of the French parliament have warned about the "growing seriousness" of anti-religious attacks.
China's ambassador to France, Lu Shaye, previously stated that Nancy Pelosi's visit to Taiwan was an unnecessary provocation.
The parish priest said that it was not the first case of vandalism to the church, but it was the most striking one so far.
Anto-christian vandalism represents a genuine plague across France.
The act looks like nothing more than an immature way to show rebellion by some teenagers.