As it turned out, the type of swaps that would be happening would be age swaps.
Anyone who swapped would retain their memories of everything as it was before the swaps began, but reality would change to accommodate the changes in age. For example, if Jon swapped with his mother, then Jon would become the father of his family. He would remember himself as a teenager, but anyone who hadn't swapped would think that he was supposed to be the father of the family.