No, it'll be fine. I've used mine for several years. I've never felt cold at EotR compared to other festivals although it is on high ground and if you get a clear night it can get a bit nippy.
But as someone who once went to Lindisfarne festival on the same weekend, where the wind came in direct off the North Sea, then maybe I'm not best placed to comment.