Yes it is not permissible. Make arrangement of food for ladies in their
room only so they do not have to come out in front of non mehram.

I wanted a clarification if you don’t mind Our house is very small and has only one exit. So, in family gatherings,both sexes sit in separate rooms, but males sit in the dining room, so when females come to take food, they can see each other. Also,the only exit is in the dining room. Is this setup still haram although the house is small?