At the end of military service, Lawrence Washington took up residence in Mount Vernon in 1742. After the death of his father, Augustine and marriage into the Fairfax family, Lawrence undertook the first of several expansions to the original house. George Washington took over the estate and house after the death of his half-brother and nephew in 1754 and began to improve the house, rebuilding the house on top of the original foundations and twice doubling its original size. When Anne Fairfax Washington Lee died in 1761, George Washington inherited the whole Mount Vernon estate.