RSVP -- am I asking too much?

Ok, I am blown away. It is not socially acceptable to just 'drop by' AND if an invitation is sent out, it is common courtesy to RSVP. Who raised these people you call your in-laws? If they do not want to come, then that's fine. It's your household. Run it as you see fit.