But it has the most history. It is the only castle featured in a photo with Walt. It has (as others mentioned) a legacy. The others came along when the Disney company could afford to build them bigger and maybe even grander. But the reason they could do so was because this one came first and paved the way.
That's my 2 cents (before taxes)