Ampersand is still around, though not considered a letter.
But what about Ethel, Thorn, Long S and others?
This Mental Floss article is about twelve characters which fell out of English spelling.
Interesting background for language wonks and perhaps a useful illustration about things which lose relevance falling out of usage and being forgotten.
mgpcpastor's blog 