I, too, often find that the album that I heard first is still my favorite of that band. So, because the debut is often the first thing you hear from a band, I think that is part of the explanation.
Besides that, I also think that there a lot of artists who just don’t have that much to say. So after their first album, they don’t have anything left to say. Bummer.