Unfortunately I find that Spotlight is buggy and sometimes won't even find a file when it's sitting right in the open folder - and searching by filename.

Doing this with iTunes has the added benefit of being able to easily see all the other track data in a cohesive interface to better select what will actually be deleted and what might need to be kept.