My GF and I are sober and we went last year and will be going again this year. We had a blast. It’s actually nice to wake up without a hangover, go for a little walk around the place, get some coffee in the morning, all those kinds of thing.
I can’t say it detracted from the experience at all. The friends we went with all brought their little kids, so they weren’t going wild or anything. It was a fun vibe all round.