I've always found the derivation of "ampersand" as "and per se and" to be far too glib to be true, but apparently it's right.
OED sez: "Corruption of ‘and per se{em}and’, the old way of spelling and naming the character &; i.e. ‘& by itself = and;’ --
-- found in various forms in almost all the dialect Glossaries."