In order to get Randy's Throwing Knife, you must first complete the quest "A blade for all." This quest is started by talking to Randy in his shop on the second floor of the Flophouse in Freeside. He will ask you to retrieve a throwing knife from a dead Fiend named Blade.
Once you haveBlade's Knife, return to Randy and he will reward you with his own personal throwing knife.