I have a question for the Nexus 4/Google Voice users out there.

I just noticed the downside to not being able to forward calls to my regular cell phone number to GV. On my Galaxy Nexus, if I wanted to dismiss an incoming call I could swipe the slider to the left and it would go straight to voicemail. On my Nexus 4, if I do this the call is instead sent to my TMobile voicemail, which I absolutely do not want.

So is there any way to fix this? Or is this just something I'll have to live with?