Sure, try it. Keep in mind, though, that trees grow much bigger than other potted plants, and your pot may not be able to provide it with the space it needs as it grows!