My friends often pick up dishes, food, and drinks we are through with while the rest of us continue to chat. Yes, it frequntly means the party is running down but not always. If one of us does this while the rest of us move to another location or even if everyone continues to stay seated and talk, this does not mean the party is running down. However if it's been some time since the start of the party it could mean the party is running down and will be over in an hour or so. If the host leaves and doesn't return the party is over.
I suggest it's really no big deal if your husband does this. His friends know him and experience will tell them what your husband means when he does this. No need to be embarrassed. If it seems awkward you can make a friendly comment to clarify what's expected. An example: "hubbie likes to clean up before he sits down."
I suggest that sitting and talking is not the only reason to invite people over. Perhaps he just feels good having them there. Perhaps entertaining is necessary for his job. Perhaps he wants to learn how to entertain.
You don't mention how the guests feel about this. Did they seem ok with this? Was your husband comfortable? Since they are his friends I would let him do whatever he wants to do with his friends. I urge the two of you to come to an agreement about parties. Find a compromise.
I suggest that what your husband does or does not do is not a reflection on you. I'm guessing you're embarrassed/uncomfortable because you're not comfortable in a social situation in your home. In time you will become more confident. A good way to look at this that works for many people is to fake it until you make it.
I also suggest that fighting with your husbad is one reason you are not comfortable. Learn first why you are not able to eempathize with your husband while you both find a way that works for both of you. If you and your husband could be open with each other in love you can find a way that will work. Sounds like you are trying to change what he does because you're sure he's wrong. I suggest that you are critical of him because you lack confidence the both of you can have a ssuccessful party. There is no right way to have a party. When you show an interest in your guests, provide some food and beverages. Act as if you're having a good time and they will too. When you're stressed about yiur husband you will dampen the happiness more than your husbands actions will.
I suggest that if you relax you may learn to like parties.