The "Eye of the Needle" was indeed a narrow gateway into Jerusalem. Since camels were heavily loaded with goods and riders, they would need to be un-loaded in order to pass through. Therefore, the analogy is that a rich man would have to similarly unload his material possessions in order to enter heaven.