When referring to anything where the full name is 'diskette' (ie. floppy diskette), you can only spell diskette with a k, so the 'disk' variant is correct.
While a hard disk isn't a diskette, it is normal to use the k spelling to maintain consistency.
It was common to use the c spelling for uncased platters (compact discs, etc) and disk for cased platters (floppies, hard disks) but Sony coming out with Mini Disc to keep the association with compact disc put an end to that.
While disc and disk mean the same thing as far as a dictionary is concerned, Sony invented the 3.5" floppy and called it a disk, so you should call it a disk. They invented the CD and called it a disc, so ditto. Following this logic, you should call hard disks 'Winchesters'.