Go a bit earlier to Vyšehrad

If you arrive before the obvious peak window, the place lands much better. Take your time, then keep walking toward Karlín if it makes sense. That timing gives you a calmer, more local version of Prague.