In a statement, the Bishop of Birmingham, Rt Revd David Urquhart, who speaks on behalf of the bishops in the House of Lords, welcomed some of the measures but raised concern of some of the issues that were missed.
"The Chancellor's Budget has gone some way to deal with the immediate problems facing our economy, housing and NHS," he said. "But it could have gone much further to help the many at the sharp end struggling to get by.
"Across the country churches support and are in touch with those who experience poverty or financial difficulty as a result of low pay, illness, or debt.
"The Budget statement provided an opportunity to make a difference to the lives of the most disadvantaged at a time when the cost of living is rising.
"The country faces substantial financial challenges and the growth forecast downgrades are worrying. But whilst the Chancellor has limited room for manoeuvre, there is more that could have been done to alleviate the situation of those who are struggling to manage."
Meanwhile, Christian charity CARE raised concern that families haven't been prioritised in the budget.
CARE's Chief Executive, Nola Leach said: "Once again the Government has failed to take account of the tax burden that one earner families face in our current tax system. New research shows it is the highest amongst OECD countries, and this budget has done nothing to reduce it.
"Today was a missed opportunity for change, instead of prioritising struggling families in the budget the Government has raised the personal allowance, disregarding the importance of family in society.
"CARE urges the Government to put struggling families at the heart of its tax reforms by introducing a fully transferable marriage allowance. This would go a long way toward improving support for families across the UK."