In 1865 a three roomed cottage was erected towards the rear of the land. By 1869 the house had doubled in size to six rooms. The addition of a large room at the front brought the house almost to the street and gave it a new asymmetrical appearance. A second storey was added to the rear of the building in 2002. George Milton owned the house until 1922 although he never lived there.

George Milton owned other investment properties in East Melbourne and from 1900 lived at 105 George Street, East Melbourne. Towards the end of his life he moved to Sydney and died there, at the home of his daughter, in 1925.