Interference is the most common cause of issues in Xbox Remote Play. Interference is of two types, Active interference, and Passive Interference. Active interference is caused due to electromagnetic signals. Passive interference occurs when certain objects block the WiFi signal path. Try to remove these interferences. Additionally, connect both your Xbox console and smartphone to a 5 GHz WiFi band.