The former al-Qaeda leader was killed by US Navy Seals in 2011 after being tracked down to a house in Abbottabad, 35 miles north of the Pakistani capital, Islamabad.
In new documents the US government said its commandos had found eleven religious texts at the house including a document called "Profiles of the bishops in the Church of England".
Amongst several Muslim texts was also two books about Christianity, "Was Jesus Crucified for Our Atonement?" and "Muhammed in the Bible".
Officials did not give any further details on the books and it is unclear if the jihadist was planning to attack Christians or had a genuine interest in Christianity.
The Bishop of Buckingham, Rt Revd Alan Wilson, told Premier the details were 'disturbing'.
On the News Hour he said: "Obviously a horrible, dangerous man in every conceivable way, so it is rather disturbing to find that colleagues may have had their names on a list in his house.
"But there are all sorts of wacky things on the list that's been released and I think we'll have to follow the story as it unfolds."
He added that it was "extremely improbable" that the book was a "hit list" for future terror attacks.
"I think it's far more likely that he was just curious about religious figures being in an establishment and being legislatures," he said.
Bin Laden was thought to have been the mastermind for the September 11th attacks on America which left more than 3,000 people dead.
US Deputy Director of Public Affairs Jeffrey Anchukaitis said: "The Intelligence Community will be reviewing hundreds more documents in the near future for possible declassification and release.
"All documents whose publication will not hurt ongoing operations against al-Qaeda or their affiliates will be released."
Other documents released also show the terrorist urged followers to concentrate on attacking Americans.
An application form to become a terrorist was also found with questions ranging from education and hobbies to "Do you wish to execute a suicide operation?".
In a video to a wife, he said: "Know that you do fill my heart with love, beautiful memories, and your long suffering of tense situations in order to appease me and be kind to me."
Premier contacted the Church of England but it declined to comment.
Bishop of Buckingham, Rt Revd Alan Wilson, speaking to Premier's Antony Bushfield on the News Hour: