Most likely the rest of the "RAM usage" is in the page cache, keeping inactive stuff around in case it is needed again in the near future.

You really do want your RAM usage to be near 100%, as otherwise the hardware is being wasted.