Helpers from Noah's Ark playgroup have met at Burgess Hill Library for the past 8 years, to sing songs based on bible stories.
The group have now been asked to take their session's elsewhere.
Library officials made the decision to exclude the volunteers from 'baby rhyme time' at the venue, after families communicated they were unhappy with the Christian references in their songs.
A spokesman from The King's Church Mid-Sussex, which runs the Noah's Ark group told the Daily Mail: 'We are sad that our involvement in Baby Rhyme Time is coming to an end after eight years. It has been a well-loved, free group for people in the local area.
'However, we respect the decision of West Sussex Library services and we will continue to do all that we can to serve them and our local community.'
A spokesman for West Sussex County Council has stated that Rhyme Time sessions are open to everyone including families of any faith or no faith.
Stay up to date with the latest news stories from a Christian perspective. Sign up to our daily newsletter and receive more stories like this straight to your inbox every morning.