How about implementing fast forward / rewind via the knob when you hold it down. E.g. hold knob down, spin forward, track position moves forward equiavlently. Have that as a large-scale movement and the normal fast forward / rewind as a micro adjustment.

This is similar behaviour to other devices I've seen...

Save the whales. Feed the hungry. Free the mallocs.