The problem I found, especially with my father-in-law's side of the family, is when someone is known by their middle name. There was one on my mother's side which I figured out rather quickly, but on my FiL's side, every male did that. I gave up.
BTW, JJ, I had to stop with my mother's side when it got back to 'Longshanks'.