How do I get rid of it?
Does rebooting the phone work?
Safe Mode is a used if you are having issues with the device and you want to see if apps you downloaded are part of the issue. Safe Mode does not allow downloaded apps to run.
Normally just a power cycle will shut off Safe Mode