If you are using a business account, then yes, you can remove that person but still keep the files that he shared with you. However, if you are using a personal account, you will no longer have access to files that the person has shared with you. The wise choice here would be to create a copy of the data before removing that person.