We should not fall down. Because if we have got enthusiasm and patience, we shall not fall down. But suppose we fall down. Sastra says, tasya abhadra abhud amusya kim. There is nothing inauspicity because whatever you have done sincerely, that is recorded in the book. In Krsna's book. Krsna has got accountant. He keeps nice account of the activities of His devotees. That's a fact. Just like the nondevotees' accounts are kept by Yamaraja for punishment. Similarly, devotees' accounts are kept by Krsna, personally.
>>> Ref. VedaBase => The Nectar of Devotion — Vrndavana, October 20, 1972