Although personally called by Sri Caitanya Mahaprabhu and Nityananda Prabhu to take prasadam with Them, still, out of great humility, Haridasa Thakura submitted, “I shall take the prasadam outside of the house.” Although Haridasa Thakura was an exalted Vaisnava accepted by Advaita Acarya, Nityananda Prabhu and Sri Caitanya Mahaprabhu, nonetheless, in order not to disturb social tranquillity, he humbly kept himself in the position of a Muslim, outside the jurisdiction of the Hindu community. Therefore he proposed to take prasadam outside the house. Although he was in an exalted position and equal to other great Vaisnavas, he considered himself a papistha, a most sinful man, and adhama, the lowest among men. Although a Vaisnava may be very advanced spiritually,  he keeps himself externally humble and submissive.

From Srila Prabhupada’s purport to CC Madhya 3.63