I am glad to see that you are living an ideal grhastha life. That is very good. The more you will become Krishna conscious the more you will forget sex life. Sex life is the original root cause of material bondage. When one takes to Krishna consciousness gradually sex at last becomes abominable, then he is fit to enter back to home back to Godhead.

From Srila Prabhupada's letter to Batu Gopala  —  Vrindaban 7 September, 1974