Krsna is living everywhere — that is the vision of the higher devotees. Actually He’s living, but still, because we are in the lower condition, we should know that here is Krsna in the temple. Krsna is everywhere, but for us, because we have no such vision to see Krsna anywhere and everywhere, therefore we should come here in the temple and see Krsna, “Here is Krsna. Krsna has kindly appeared here in a manner in which I can see Him. That is Krsna’s mercy.” That is temple.
From Srila Prabhupada’s lecture on Srimad-Bhagavatam 1.8.37 — 29 April, 1973