The unencrypted nature of SIP scares me. You pass all your authentication in the clear. Moreover, I wouldn't be suprised to learn of voice recognition programs which start looking for conversations with key phrases, and/or filtering programs that look for calls to banking centers, etc.