Read up to Goblet of Fire. I think the books are all right, but I've seen all the movies so my motivation to read the books has waned a bit. However, I will eventually finish the series of the books - for the sake of it - because friends have told me the books are even better than the films anyway.
So I'm a fan, but not a fanatic.