Yeah I figured that would be the case. It doesn't surprise me that the wan/lan ports can't keep up after looking at the throughput review on smallnetbuilder.com
However I'm surprised that it would suddenly just start dropping connection to the internet randomly when not even pushing high speeds.
In any event after wasting many hours I caved and ordered an ASUS RT-N66U which should be able to keep up just fine based on reviews. I would have gotten the ASUS RT-AC66U but decided against it since it has no working version of tomato, costs $35 more, and I don't see myself owning any 802.11ac devices in the next couple years. Maybe if a Nexus phone is released with it but I don't see that kind of throughput making any difference on a phone in the near future.