The first record of a Scudder living in Cow Harbor was that of Thomas Scudder, who was born in Kent, England in 1624. He first emigrated to Salem, Massachusetts, but later settled on the North Fork in Southhold, Long Island. He then moved west on the island and helped found the Town of Huntington. There he married Mary Ludlam and they had seven children.
One of their sons, Timothy Scudder, born in 1668, owned extensive lands in Crab Meadow and when he died in 1740, he bequeathed them to his son Timothy Scudder II.
Timothy Scudder II married Mary Whitehead and they had eight children, including Henry Scudder, born in 1743 and Joel Scudder, born in 1746. Both sons would distinguish themselves in battle during the struggle for freedom from British rule.