It happened at that time, when Eli was laid down in his place (now his eyes had begun to grow dim, so that he could not see),
It is important to note that Eli and Samuel were sleeping quite near each other, because Samuel was apparently accustomed to being called by Eli during the night time.  This absolutely forbids the false notion that Samuel was in the Holy of Holies.