Volume III of The Victoria County History for Bedfordshire, published in 1912, gives the history of manors in Roxton as far as they were known at the time. Carlyles or Roxton Wood End is first mentioned in 1472 when Walter Stotfold and Joan, his wife, conveyed it to Richard Carlyle. By 1501 William Mordaunt held it.

The Mordaunt family coat of arms

The Mordaunt family held the manor, along with several others in Roxton, including Roxton Manor itself, until 1624 when the various manors were transferred to French apothecary Gideon de Lanie, de Laune or Delawne. He was a surgeon to Anne of Denmark, queen of James I (1603-1624) and Master of the Apothecaries' Society in 1637. He also held Netherbury Manor in Great Barford and died in 1659 when he was succeeded by his son William. The last mention of the Delawne family as holding the manor is in 1715.

By 1737 the various Mordaunt manors were in the hands of William Metcalfe and his family held the manor for over a hundred years, though Carylyes or Roxton Wood End is last mentioned separately in surviving documents in 1813 after which it was probably subsumed by Roxton Manor.