We clean our toys with hot water and an organic antibacterial soap, then spray and wipe down again with this:
http://www.goodvibes.com/display_product.jhtml?id=17FL02
The main ingredients are alcohol and witch hazel. You could just buy 91% isopropyl alcohol and witch hazel for less than $2 each, and mix a 1:1 solution in a spray bottle and use that. (Incidentally, that's also a good solution to spray on makeup and makeup brushes to keep your cosmetics sterilized.) Then dry with a paper towel so you don't have to deal with the towel fluff issue.