One problem I've had with VPS is sending email from them. Often the IP addresses get flagged as sources of spam from previous owners - and abusers - of the IPs. If they are so flagged, you will have a heckuva time persuading various list-keeping groups and email providers that your innocent one-a-day emails are not the start of a spam flood of Titanic proportions. Sigh. You are guilty unless you turn yourself inside out to prove yourself innocent.