He watched from afar as his wife married another man but did not count on what would happen next