There's always exceptions to any rule. 3rd albums by Bon Jovi, Primal Scream, Verve, Spiritualised are all considered to be better that previous output.
Here's my controversial opinion though: First Verve album is far and away their best. Urban Hymns, Bittersweet Symphony aside, is a load of cack.