How do I switch from speaker phone?

kevman00

I love my new Moto X.  But when I put on my speakerphone during a call...if my screen goes dark, I can't get back to take it off speaker. 

I updated to 5.0 and that did not address it.  And I have the right hand button set to end calls.  It was never an issue with my thunderbolt or S3.  Suggestions? 

Tidbits

Do you have a screen protector on? At times of poorly made it will cause problems with the sensor for the screen lighting