Avoid append mTouchCaretElement