I've just started allowing ssh internet access on my pc, and a couple of things I did first were limiting the ip addresses allowed and changing the port number.
If you use port 22 someone will probably try to hack you, and if you have a username and password that are the same (e.g. "test", "test") they may well succeed.
Just connect using putty or whatever tool you like and specify your non-standard port.