On windows, try something like:
ping -n 100 www.google.com
This will ping your google 100 times. At the end of the test is the ping statistics that show packet loss and round trip times. The round trip times should approximately correspond to ping times listed on game servers. You can replace www.google.com with any website you want. You can also use an ip address, probably of the game server if that is what you are interested in.
You can use traceroute on windows like this:
It will show you every hop (router, gateway, whatever) along the path between you and your destination (in this case google). By default, it pings each hop 3 times. Just remember, if you ping routers often times ping responses are delayed because they are given lower priority than routing real traffic. That's why when I see people on dslreports complain about terrible latency because a traceroute shows a high ping reply I get annoyed. In fact, if you see a high response time on one router, yet a hop that actually occurs past the router has a lower response time, I can virtually guarantee what you are seeing is a de-prioritization of icmp packets. Some routers or web servers don't even reply to icmp packets.