Rev Dr Jules Gomes has been the subject of a disciplinary tribunal which found his behaviour prompted the warden, and two other workers to resign at St Augstine's Church in Douglas.
The Church of England tribunal concluded Rev Gomes: "...is prone to losing his temper and displaying anger and as a result those who have been the subject of such anger have been seriously upset and damaged."
Members of the tribunal were told how Rev Gomes "became very angry for about three - five minutes" during a disagreement in 2014 about St Augustine's relationship with another church, prompting Timothy Henwood to leave the post.
They also heard how Rev Gomes left a volunteer cleaner feeling "demeaned and belittled" when he walked into the church and began shouting at her as she cleaned the floor in April 2015 - she later quit the position and moved to another church.
The tribunal said it accepted the cleaners tale of events, as well as the account of another churchwarden Alan Grace who resigned after dealings with Rev Gomes.
Mr Grace claimed Rev Gomes kicked a chair and told him to shut up after Mr Grace arrived three minutes late to a meeting in May 2015.
Considering a number of other claims, the tribunal concluded: "Firstly, in exercising a need on his part to assert his authority and with an over-inflated view of his own self-importance, the Respondent has dealt with people with little or no compassion or pastoral concern.
"Secondly, the Respondent has lost his temper and displayed anger, even to those who continued to support him.
"Thirdly, in his behaviour he has caused serious harm to people and has caused them to leave their offices or his church.
Fourthly, he does not seem to understand the need to express remorse or amend his ways.
"Fifthly, he has made untrue statements against Revd Erica Scott, the Archdeacon and the Bishop.
"We have no doubt that such behaviour on the part of the Respondent has damaged the reputation of the Church."
The Diocese of Sodor and Man told Premier a decision on any penalty will most likely come next month.
Rev Gomes is described on his church website as "an inspirational preacher who uses his theological training to bring new insights to our understanding of the Bible."