Seconding Old Town. Haven't been for a few years, but when I was down SD way more regularly it was a frequent stop. During the summer they frequently host(ed?) pretty decent living history style events.
I'm always a fan of Mission Beach. But I love coasters, so yeah