Yan maithunadi-grhamedhi-sukham hi tuccham. This happiness of the grhamedhi, family attachment… Family you can utilize, grhastha. If you are inconvenienced to accept sannyasa or brahmacari life, remain in household life, but the purpose is the same, to develop Krsna consciousness. If one is in the family life and is trying to advance in Krsna consciousness, he is called grhastha, and his family life is called grhastha-asrama. Just like sannyasa-asrama. Asrama means where there is activities, spiritual. That is called asrama. So if you remain as grhastha or family man, there is no harm. But utilize for advancement of Krsna consciousness. Then you are grhastha. And if you do not know that, if you simply remain a family man for satisfying your senses and begetting children up to the point of death, that is called grhamedhi. These two words. Apasyatam atma-tattvam grhesu grhamedhinam. So one should not be grhamedhi. One may become grhastha. That is the difference. 

From Srila Prabhupada's lecture on Srimad-Bhagavatam 6.1.24; Chicago, July 8, 1975