Yeah, like Rob said, the hard part is getting fiddly with the springs.

Is it easier to fully remove the disk drives and display board assembly before attempting to remove/reattach the handle? As long as you don't plug the connector in off-by-one when reinstalling it.

One thing to know is that the handle screws tend to loosen up over time if you don't loctite them...