Since December last year, there have been at least five incidents of vandalism against churches in Delhi. In one attack, arsonists destroyed the entire inside of St. Sebastian Church in the east of the city. After other incidents, people began protesting against Christian persecution in the capital.
Police arrested at least dozens of the protestors when they began marching towards the Indian Home Minister Rajnath Singh's house, which police say they were not allowed to do.
In a separate incident outside New Delhi, Christians were beaten up people thought to be Hindu nationalists because they were singing Christmas carols.
Critics say Modi's Hindu nationalist party has not done enough to protect Christians in India.
Today, Narendra Modi attended an event celebrating the beatification of two Indians last year by Pope Francis.
He told the Christians there: "My government will not allow any religious group, belonging to the majority or the minority, to incite hatred against others, overtly or covertly."
"We cannot accept violence against any religion on any pretext and I strongly condemn such violence. My government will act strongly in this regard."