Everything is open to everyone. There are no "insiders" and "outsiders". If people from Ireland, for example, don't want to partake in ski-jumping and luge, that is their problem. Why should the countries, that do compete in these sports be blamed, that others don't.
Also, there are 25 out of 35 sports at the SOG, that could be played anytime in the year. By this logic there shouldn't be any "summer" or "winter" OG. You should just call it the February Olympic Games and the July Olympic Games, or Part 1 and Part 2, if they are not going to be distinguished.
It will never cease to a amaze me, how much it bothers people from particular regions, that Winter Olympics exist. If they were called the Winter Sports Games, probably no one will bath an eye, but because it has the word "Olympics", it tears their soul, that there are OG for sports they don't watch, care, like or participate in, even though it's their own fault.
But the sad truth is that in 20 years (or sooner, because glimpses are starting to appear) they would transfer 10 indoor sports, because the Winter Games need to be more "marketable and inclusive" and not because the never ending pure greed for money.