I had a similar connection for years and I used, as you'd expect, two ethernet cables linking the router upstairs with the rest of the network components downstairs. One to the modem and the other to a switch. The switch is what provided all the other cabling throughout the house. The route was kept on the upstairs floor for better reception and itself acted as a switch for any connections that needed to be made in that room.