Reorganized the structure by saperated client, server and public.

Signed-off-by: Jiahe Jou <joujiahe@gmail.com>