 NSM998 join:2009-02-12 Philadelphia, PA | Comcast Announces Constant Guard Program As a follow-up to our BBR posting on July 9th about bots at: http://www.broadbandreports.com/forum/r22682954-What-to-do-about-bots, we have continued to work on innovative solutions to this problem. Since then we have updated our earlier IETF draft, a new version of which is available at http://tools.ietf.org/html/draft-oreirdan-mody-bot-remediation.
Today we announced the Constant Guard security program. This program is a comprehensive approach to protecting customers from increasingly sophisticated online security threats. A feature of the Constant Guard security program, called Service Notice begins a technical trial today in Denver. The purpose of Service Notice is to let customers know whether their computer is infected with a bot (virus). Bots are the leading cause of spam, are responsible for identity theft, information theft, and distributed denial of service (DDOS) attacks.
We believe the Service Notice benefits both Comcast customers as well as the Internet community. The Service Notice helps inform customers that there is a high probability that something may be wrong with their computer and that they could be susceptible to any of the malicious activity listed above. Once customers receive the Service Notice, they will have an option to take steps to fix the problem or close the Service Notice without further action. By taking the steps to fix the problem, customers can clean their computers which in turn may help reduce the risk of information and/or identify theft. Fixing the problem also helps the Internet community because it means less spam and fewer DDoS related service outages.
How will the Service Notice work? Customers may receive a Service Notice informing them that one or more computers in their house may be infected with a bot. The Service Notice appears as a message layered in front of the page content as shown here:
»security.comcast.net/img/content···tice.jpg
The customer will be presented with two click-through options: (1) visit the Anti-Virus Center or (2) close the Service Notice. The Anti-Virus Center instructs the customer to perform Operating System updates, download Anti-Virus updates and/or to download the McAfee anti-virus software (provided at no additional cost to Comcast customers). If the customer needs expert technical assistance, the customer will find a link to the McAfee Virus Removal Service. This service is provided by McAfee for an additional fee.
The customer can close the Service Notice without any further action. Comcast may notify the customer again in the future if their security is at risk.
How did Comcast determine that I may have a virus-bot on a computer in my home? We identify infected computers in several ways. First, we get data from reputable Internet research groups that specialize in bot identification. The data we get includes a list of Internet Protocol (IP) addresses that are infected and those that belong to bot command and control channels. Second, we look for malicious behavior exhibited by bots such as spam, distributed denial of service attacks and repeated connections requests to known command and control channels. We then aggregate this data to confirm whether one or more of your computers has been infected.
Is Deep Packet Inspection Involved? No. Deep Packet Inspection is not involved in any way.
Does this technique of detecting bots allow Comcast to see my online activities? No, this technique does not detect bots based on the online activities, protocols or applications a customer uses. Comcast provides its customers with full access to all the content, services, and applications that the Internet has to offer.
How does the Service Notice work? Following is a technical description of how the Service Notice works. The notification platform utilizes a standards based approach developed by the Internet Community known as Internet Content Adaption Protocol (RFC3507). When a bot is detected and a customer needs be notified, HTTP traffic (Port TCP 80 only) from the customers computer is routed via a web proxy. The traffic is routed from the customers computer to the final destination, a "web server", without modifying the request. When the traffic from the Web server arrives at the proxy the Service Notice is added to HTML content without modifying the original page and then the combined content is routed back to the customers computer. The Service Notice will appear as a message layered in front of the page when viewed in the Web browser. We have published an IETF draft describing how the system works, which is available at: http://www.ietf.org/id/draft-livingood-web-notification-00.txt.
Does the proxy cache any information? The web proxy does not enable caching of the Web content and Comcast neither look at nor store web traffic information.
Where to find technical updates related to the Service Notice? All technical updates regarding Service Notice will be available on Comcasts Network Management page: http://networkmanagement.comcast.net
Sincerely, Nirmal Comcast Cable Communications National Engineering and Technical Operations |
|
 jlivingoodPremium,VIP join:2007-10-28 Philadelphia, PA kudos:1 | CNet picked this up at »news.cnet.com/8301-27080_3-10370···ogArea.0 -- JL Comcast |
|
|
|
 | reply to NSM998 Very nice.
Thank you, JL ! |
|
 Drizew join:2004-09-17 Los Lunas, NM | reply to NSM998 In a Dr. Evil voice... Very interesting Mr. Powers.
I am interested in seeing how well this works and if there are any ill effects that arise from it. I am sure that removing some bots from the lines will certainly improve performance for everyone. |
|
 Host: Road Runner PC gaming GAMES PC gaming Tech
| reply to NSM998 Writing something up about this now, thanks!
Any insight on why Comcast isn't employing a walled garden solution like Cox or Cogeco that essentially locks consumers in a room until they call support and clean their PC?
»Talking Botnets
Not saying one's better than the other, just curious if Comcast considered this as an option? |
|
 jlivingoodPremium,VIP join:2007-10-28 Philadelphia, PA kudos:1 | said by Karl Bode:Any insight on why Comcast isn't employing a walled garden solution like Cox or Cogeco that essentially locks consumers in a room until they call support and clean their PC? Indeed we did consider this! 
See »tools.ietf.org/html/draft-oreird···ation-03 in Section 6 on notification methods.
The one on walled gardens is here:
6.1 Walled Garden Notification Placing a user in a walled garden is another approach that ISPs may take to notify users. A walled garden refers to an environment that controls the information and services that a subscriber is allowed to utilize and what network access permissions are granted. This is an effective technique because it could be able to block all communication between the bot and the command and control channel, which may impair the ability of a bot to disrupt or block attempts to notify the user.
While in many cases the user is almost guaranteed to view the notification message and take any appropriate remediation actions, this approach poses can pose other challenges. For example, it is not always the case that a user is actively using a computer that uses a web browser or which has a web browser actively running on it. In one example, a user could be playing a game online, via the use of a dedicated, Internet-connected game console. In another example, the user may not be using a computer with a web browser when they are placed in the walled garden and may instead be in the course of a telephone conversation, or may be expecting to receive a call, using a Voice Over IP (VoIP) device of some type. As a result, the ISP may feel the need to maintain a potentially lengthy white list of domains which are not subject to the typical restrictions of a walled garden, which could well prove to be an onerous task, from an operational perspective.
The ISP has several options to determine when to let the user out of the walled garden. One approach may be to let the user determine when to exit. This option is suggested when the purpose of the walled garden is to notify users and provide information on remediation only, particularly since notification is not a guarantee of successful remediation. It could also be the case that, for whatever reason, the user makes the judgment that they cannot then take the time to remediate their computer and that other online activities which they would like to resume are more important. Exit from the walled garden may also involve a process to verify that it is indeed the user who is requesting exit from the walled garden and not the bot.
Once the user acknowledges the notification, then the user decides to either remediate and then exit the walled garden, or exit the walled garden without addressing the issue. Another approach may be to enforce a stricter policy and require the user to clean the computer prior to permitting the user to exit the walled garden, though this may not be technically feasible depending upon the type of bot, obfuscation techniques employed by a bot, and/or a range of other factors. Thus, the ISP may also need to support tools to scan the infected computer and determine whether it is still infected or rely on user judgment that the bot has been disabled or removed. One challenge with this approach is that if the user has multiple computers sharing a single IP address, such as via a common home gateway device which performs Network Address Translation (NAT). In such a case, the ISP may need to determine from user feedback, or other means, that all affected computers have been remediated, which may or may not be technically feasible.
Finally, when a walled garden is used, a list of well-known addresses for both operating system vendors and security vendors should be created and maintained in a white list which permits access to these sites. This can be important for allowing access from the walled garden by end users in search of operating system and application patches.
-- JL Comcast |
|
 ropeguruPremium join:2001-01-25 Grafton, WV | reply to NSM998 So out of curiosity, how do you keep track of this between the time your research firms provide you with the IP and you entering it into the system to capture the customers attention.
What happens if in the lag time the ip is allocated to someone else who's machine isn't infected. The only way I see to mitigate this is timestamps from the research company and you correlating this with stored info about what customer had that IP during that time period.
If this is the case, how long are you keeping these records so you can hand them over to the feds anytime they want them?? |
|
 jlivingoodPremium,VIP join:2007-10-28 Philadelphia, PA kudos:1 | said by ropeguru:So out of curiosity, how do you keep track of this between the time your research firms provide you with the IP and you entering it into the system to capture the customers attention. What happens if in the lag time the ip is allocated to someone else who's machine isn't infected. The only way I see to mitigate this is timestamps from the research company and you correlating this with stored info about what customer had that IP during that time period. Our DHCP servers record when an IP lease changes, so we can track when we think someone was botted and whether their IP subsequently changed. Obviously we're trying to (1) avoid false-positives and (2) not have bots that constantly change IPs to evade detection.
said by ropeguru:If this is the case, how long are you keeping these records so you can hand them over to the feds anytime they want them?? I do not know off the top of my head, but I think there is some standard for ISP storage of this data (and it's not too long I don't think). -- JL Comcast |
|
 funchordsHelloPremium,MVM join:2001-03-11 Yarmouth Port, MA kudos:5 | reply to NSM998 Sounds good, Nirmal & Jason. I'm doubtful but a Denver trial sounds like a way to find out for sure. I think the problem will be with user behavior, but maybe I'm jaded by my friend who turns off his AV everytime he tries to install software or play games because he believes it gets in the way.
My recommendation will be to make a panel out of people who were in a state to get the notice and learn: 1. Did they notice it and how long did it take? 2. Did they respond to it and when, how? 3. Did any applications fail to work?
It's important that you don't rely on Customer Support complaints. My expectation is that these folks won't call.
We have to compare these answers against the reality that these bots are not only harming the network but scamming folks. (I do know you guys intercept that junk from compromised hosts and assume you still will.)
This is a technicality in your FAQ above: How is DPI not involved in getting the proxy inserted in the flow? How are you getting HTTP traffic to pass through a proxy without DPI? (I did read Jason's 6A but I don't understand how DiffServ does anything with TCP port 80, that doesn't sound like DiffServ, that sounds like packet inspection, perhaps what some call Shallow Packet Inspection, but then you need DPI to do some forgery and redirection, right?.) If it turns out that it is technically DPI that makes this work, I think it's probably something okay since the alternative is a 100% walled-garden block and this clearly is a network management activity. -- Robb Topolski -= funchords.com =- District of Columbia -- KJ7RL Test your Broadband connection today! -- »measurementlab.net/ |
|
 hep catdo da dirdy bird join:2001-02-17 Decatur, GA | reply to NSM998 What if a person never ventures to the Comcast home page? -- Bowling: It's cleaner than baseball. |
|
 NSM998 join:2009-02-12 Philadelphia, PA | reply to funchords said by funchords:Sounds good, Nirmal & Jason. I'm doubtful but a Denver trial sounds like a way to find out for sure. I think the problem will be with user behavior, but maybe I'm jaded by my friend who turns off his AV everytime he tries to install software or play games because he believes it gets in the way. My recommendation will be to make a panel out of people who were in a state to get the notice and learn: 1. Did they notice it and how long did it take? 2. Did they respond to it and when, how? 3. Did any applications fail to work? It's important that you don't rely on Customer Support complaints. My expectation is that these folks won't call. We have to compare these answers against the reality that these bots are not only harming the network but scamming folks. (I do know you guys intercept that junk from compromised hosts and assume you still will.) This is a technicality in your FAQ above: How is DPI not involved in getting the proxy inserted in the flow? How are you getting HTTP traffic to pass through a proxy without DPI? (I did read Jason's 6A but I don't understand how DiffServ does anything with TCP port 80, that doesn't sound like DiffServ, that sounds like packet inspection, perhaps what some call Shallow Packet Inspection, but then you need DPI to do some forgery and redirection, right?.) If it turns out that it is technically DPI that makes this work, I think it's probably something okay since the alternative is a 100% walled-garden block and this clearly is a network management activity. We definitely did do a focus group study to understand user behavior and the feedback was positive. The system worked as expected when we tested it with the group as well as during our internal beta testing. The technical trial will provide further insight into how users behave and react to the notice. If we do get customer calls we are ready to help them as needed via our Customer Security Assurance team. So it will be a learning process.
On the DPI question....we use DSCP 9 to route the packets to the proxy that is it.....we use Squid which is not really a DPI application...its used strictly as a proxy (open source) and to support ICAP (RFC 3507). We explain the entire process in another I-D at »tools.ietf.org/html/draft-living···ation-00 |
|
 funchordsHelloPremium,MVM join:2001-03-11 Yarmouth Port, MA kudos:5 | Thanks for the focus group info. (Just curious, can you share what percent of Denver you think will see this notice at some point during a day?)
said by NSM998:On the DPI question....we use DSCP 9 to route the packets I'm not sure we agree on what this means. At your convenience, can you please show me in an RFC where it talks about this handling? Again, I don't object that it is happening for this narrow security purpose, but I think DPI has to happen at some point to make it work.
said by NSM998:to the proxy that is it.....we use Squid which is not really a DPI application...its used strictly as a proxy (open source) and to support ICAP (RFC 3507). Yes, this part is understood. Plus, I read that draft.
Thanks! -- Robb Topolski -= funchords.com =- District of Columbia -- KJ7RL Test your Broadband connection today! -- »measurementlab.net/ |
|
 jlivingoodPremium,VIP join:2007-10-28 Philadelphia, PA kudos:1 | said by funchords:I'm not sure we agree on what this means. At your convenience, can you please show me in an RFC where it talks about this handling? Again, I don't object that it is happening for this narrow security purpose, but I think DPI has to happen at some point to make it work. Re DSCP (aka DiffServ), as you know DOCSIS and other IP networks can fairly easily use DSCP. In essence what we're doing is using DSCP to, for the brief period when we try to send the notification, route TCP/80 traffic to the squid proxy. Once the notification is sent, the DSCP is torn down. -- JL Comcast |
|
 | reply to hep cat said by hep cat:What if a person never ventures to the Comcast home page? That is an important question.
They should send emails to each associated Comcast email account also.
It's good they are trying to do something about the zombie problem. |
|
 AVDRespice, Adspice, ProspicePremium join:2003-02-06 Onion, NJ | said by StillLearn:said by hep cat:What if a person never ventures to the Comcast home page? That is an important question. They should send emails to each associated Comcast email account also. It's good they are trying to do something about the zombie problem. I think it is any web page, otherwise they wouldn't have to reroute traffic to a proxy. -- standard disclaimers apply. |
|
 NSM998 join:2009-02-12 Philadelphia, PA | said by AVD:said by StillLearn:said by hep cat:What if a person never ventures to the Comcast home page? That is an important question. They should send emails to each associated Comcast email account also. It's good they are trying to do something about the zombie problem. I think it is any web page, otherwise they wouldn't have to reroute traffic to a proxy. Correct, any web site (including Comcast.net homepage) and we do email customers when they are notified via Service Notice. |
|
 Khaos-K-OS-Premium join:2007-03-12 West Palm Beach, FL | reply to NSM998 I think this is a step in the right direction. I always pondered as to when CC would let these people know that their PC's are bots and causing lots of network traffic be it spam and whatnot. I just hope all the CAE's will be ready to handle this when it's nationwide and not make unnecessary truck rolls. I could see it now, "sub complains of service banner".
What happens after the PC is cleaned or replaced. What happens then to the banner?? Let's say they are behind a router but they replaced the PC but since they are on a router the IP doesn't change. When or how will that IP be cleared? Who will verify the info? What happens if the infected PC's IP changes to another IP that is clean, how will it be tracked. I can see people just changing the IP to get a new un-bannered IP and still be infected and the circle continues! Unless CC will also be tracking by MAC addresses but that can be spoofed also... -- Ultimate Malware Protection!!
Free Windows Cleaning!! |
|
 | reply to NSM998 Sounds real good, and I hope it works as described, but Comcast doesn't have a great record when it comes to telling the truth about it's network practices, or supporting it's customers. Gotta wonder what the investors get out of this. |
|
 JohnInSJPremium join:2003-09-22 San Jose, CA Reviews:
·PHONE POWER
·Comcast
| reply to NSM998 Nice job, long overdue (not a comcast dig, an ISP dig ) and hopefully it will help the folks who otherwise aren't savvy enough to keep themselves safe. -- My place : »www.schettino.us |
|
 AVDRespice, Adspice, ProspicePremium join:2003-02-06 Onion, NJ | you figure the malware will get smart enough to block the warning message. -- standard disclaimers apply. |
|