Dr Anthony McRoy's been speaking after David Cameron unveiled the £20m education project, aimed at what he says are 200,000 Muslim women - more than one in five - who speak little or no English.
The Prime Minister said the scheme will help them to integrate within their communities, and reduce extremism.
He also said that any migrant women who refused to learn English could lose their right to stay in Britain.
Some people have criticised the scheme because it equates having a lack of English with being a terrorist.
Mr McRoy said while the scheme would not reduce extremism whatsoever, it would help integration as the Prime Minister said.
He told Premier's News Hour: "If you don't speak the language of the country you're in, whatever country you're in... You're going to have a very limited impact on the country. It's going to be very difficult for you to set up a business, or to get ahead in a company.
"The onus should really be on the individual who comes to this country... to learn English. Equally, if a British person goes to Spain or France the onus should be on him to learn the language.
"What the Prime Minister actually said is that often if you've got mothers who don't speak English they can't actually spot the signs of the person becoming radicalised. I don't think that's actually valid.
"Even if you've got a mother who's perfect in English, she won't necessarily pick up the signs. They're very careful to prevent their parents knowing about these things.
"I think it will have a completely zero effect on radicalisation. I think that's a completely different question."
Listen to Premier's Aaron James speaking to Dr Anthony McRoy on the News Hour.