In fact, there are no such things as "French fries", only "french fries". They would have originally been "frenched fries", where "to french" means "to cut into long strips".

Heck, in French, they're called "pommes frites", which means "fried apple". Yes, I know the derivation of that, but it's no less absurd on the surface.