When creating or editing the Groups within a Segment it is very important to consider the ordering of the Segment Groups. 

If a person, account, opportunity, or activity qualifies for multiple Groups they will belong to the first Group that they qualified for. 

Drag and Drop to reorder the Groups within a Segment.