I don't think it needs a factory reset, in theory there might be a menu screen on the car which lets you delete the connection. It wouldn't be the same menu as the bluetooth one; if I recall correctly, in my car there's a separate section, different from bluetooth, under the "settings" menu labeled "Smartphone" or "Smartphone Connection" or something like that. Maybe you have a similar menu where you can delete the connection.