I built a router/server with a P4 3.0 ghz with 1gb ram. This handles routing, PPPOE, NAT, firewall, etc. We currently have 44 active PPPOE sessions on this server and the total memory is 884.5, and free is 850.3. That's averaging less than 1mb / user including all of the other resources being used.
