This is common with a lot of phones. They vibrate when turned on and off. You can check your phone settings. Sometimes there's an available option to disable the vibration.