I think the key thing is that we have maintained the London level of success now for four consecutive Games. This is something that no other host country has done. Compare this with Australia who dipped after Sydney and are only now on an upward trajectory again as they prepare for Brisbane in 2032.
Some sports had poor Games by their standards but that doesn't mean they can't achieve a quick turnaround as rowing did in Paris. Sailing had a major change in boat classes and many retirements after Tokyo, while the conditions at Marseilles probably didn't favour us. Boxing meanwhile had a relatively weak cycle in terms of talent which we were probably due. That every bout involving a GB boxer was a split decision that almost invariably went against us didn't help either. If the latter is still part of the programme for LA both sports have the capacity to turn things around.
The additions of baseball/softball, cricket, lacrosse, squash and flag football(?) offer more medal opportunities in most cases, although I know some remain devastated at the loss of breaking from the programme. We could potentially have a much bigger team in LA if the RFU resumes support for the sevens teams and the women's football team doesn't blow qualification again. Cases can be made for gaining qualification in all the new team sports.