Yes, you can connect the modem to the router without a computer being connected by Ethernet cable to the router.
Other choice is Linksys Wireless Range Extender »
homestore.cisco.com/en-u ··· wcat.htm or powerline extender »
www.netgear.com/home/pro ··· 001.aspx