The Mansion was part of Fair Haven Heights. Originally, the Heights was generally fields and woods. In the 18th and 19th centuries, this area saw the construction of many homes in the Victorian Gothic style. Spacious homes were built by successful businessmen high above the river on East Grand Avenue, Clifton Street, Sherland Avenue, Lenox Street and Quinnipiac Avenue.

James F. Babcock, a lawyer and publisher of the New Haven Palladium newspaper, built a large Victorian Gothic home on 30 acres (120,000 m2) of land between East Grand Avenue and Clifton Street. The present day address is 89 Sherland Avenue. A few years later the house, two barns and a carriage house were sold. The Babcock home was altered and two more homes were built. Arched woodwork decorates the eaves and high gables. On the southern part of what was the Babcock estate at 154 East Grand Avenue can be found the Victorian Gothic home of the Moody family. Lucius Moody was a successful insurance agent. His wife, Dr. Mary Blair Moody, was the first woman physician in the area. Sharp gables, porches and bays, and decorative woodwork complete this example of wooden Victorian Gothic. Two Victorian Gothic cottages remain at 106 and 112 Sherland Avenue.

In 2014, a women recovery house was founded and operated in the mansion. 2017 the mansion and the recovery house was sold to Rick DelValle, the founder of Recovery Mansion LLC. He took over the mansion, re-founded & run a men’s recovery house in the mansion till current. In June 2024, Recovery Mansion has been renewed, restored & upgraded into a high-end men’s recovery house, accepting clients from nationwide.