I was just looking up this topic.. ON the one you are looking for under Settings > Sounds & Display > Haptic Feed Back.
So far I have turned off
Vibrate While Typing Text
Haptic Feed Back (this affects the 4 buttons at the bottom)
It still vibrates on email notifications and when typing numbers to dial a phone number.