Can I put a 4g SIM card in my iPhone 4s
... And the SIM card on the 4S is not used for Verizon. If you take it out, the phone will work just fine with Verizon since it is not needed. It only comes into play when you are travelling.
No. iPhone 4s is not LTE.