Judah Philip Benjamin's parents were Sephardic Jews who had moved from London to St. Croix when it was occupied by Britain during the Napoleonic Wars.