They did indeed - they were definitely not on my list of possibles when I started looking around!
I'm happy with VPNUK, so I've stuck with them, but if anyone's looking for a cheapie, I'm told by a friend along the road that Private Internet Access are pretty reasonable. He says...
(1) They can occasionally be a little bit slow a busy times, but not to the extent that it's annoying.
(2) You can't send mail by default - he had to contact support and get them to whitelist the outgoing servers that he uses. Having done that, fine, no problems, so not a major stumbling block.
(3) He had trouble with uploading to his own website. Whether they would have also sorted that on request he doesn't know, because he found his own solution before he got around to asking them. Instead of using his old FTP programme, he tried using the "Fire FTP" Firefox add-on, with SFTP as the protocol instead of plain FTP, and that did the trick.
Not a tremendous selection of servers, just USA, Canada, UK, Switzerland, Netherlands and Romania, but he stuck his neck out and went for their bargain yearly price, 39.95 burger vouchers, which came to about £25.50, and says that for little more than £2 a month he's well satisfied.