If you want a Hong Kong vacation, I'd suggest to stay off property and maybe stay for a week. You can buy a 2-Day pass and you can use that twice during that week, so that's a pretty good deal I think. That way you can maybe start of with HKDL on your first day, enjoy HK and before you leave, hit the park again.
If you plan to stay on property, stay exactly 3 days/2 nights. That way you can enjoy the park at your leisure and give you time to enjoy what the hotels have to offer. People here have recommended Chef Mickey at the HKDL Hollywood Hotel, and they were right, it was pretty good!