Speaking in the Commons, Conservative MP Mike Freer asked whether the Government had assessed what implications the appointment of Revd Libby Lane as Bishop of Stockport would have.
Equalities Minister Nick Boles responded with praise. He said "I thank my hon. Friend for his question and I congratulate Libby Lane on becoming the new Bishop of Stockport and the first female bishop in the Church of England.
"I am delighted to see the Church of England moving into the 21st century, at least in this respect."
Mr Freer, the MP for Finchley and Golders Green, followed by asking if he agreed that Libby Lane was a great role model for the Church and for girls in this country.
Mr Boles said: "I do agree with my hon. Friend. Role models such as Libby Lane are very important, which is why the Government are supporting schemes such as "Your Life" and "Inspiring Women", which is led by the formidably impressive lawyer, Miriam Gonzales. I believe that her husband has a job, too, but I think we can all agree that she is the role model in that family."
The comments come as the Parliament looks at ways to get women bishops into the House of Lords as quickly as possible.
The Lords Spiritual (Women) Bill suggests that legislation should be changed to allow women to be fast tracked into the House until the balance of gender was equal.
If passed, the first woman to become a diocesan bishop would be next to enter the house upon the next retirement of a current sitting bishop.
Revd Libby Lane won't be eligible as she's only a suffragan.
She'll be consecrated on Monday 26 January at York Minster.