Carter Road without the full crowd: any timing trick?

Carter Road is easy to recommend, but the mood changes a lot depending on when you go. If the goal is a sea breeze, a snack, and enough space to actually talk, what time window works best before it gets packed?