Krishna is in our heart even if we don't remember that. We don't have to "keep" Him there—He's there of His own will. He will follow us around, birth after birth, waiting for us to remember Him and turn to Him for help.