The house is situated on 15 hectares of land.  It is part of a complete estate comprising 4.5 hectares of established gardens and ponds, paddocks, cottages, stables and other buildings.

The Estate gardens are regarded as one of the finest private gardens from the Victorian era in the country.  

They are thought to have been laid out by Mr William Thomas, landscape gardener, in accordance with plans drawn up by the architect of Government House, William Porden Kay.

The garden has been maintained much as it was developed in the 1850s and 1860s and includes fowl yards, an orchard, and kitchen and picking gardens.  The produce from the garden is used in the Government House kitchen.  

Full-time and part-time gardeners are responsible for all aspects of the garden’s maintenance.

The large landscaped Quarry Pond near the main building, and the smaller Japanese Pond  inside the main entrance gates were originally the sites of two sandstone quarries, stone from which was used in  construction of the House.

Some of the trees on the grounds, including the oak avenues, pre-date Government House having been planted in the 1840s.  

As the garden ages new trees are planted in anticipation of some of the older trees dying.

Over the years trees have been planted by visiting royalty, heads of state and other distinguished visitors, these trees are marked with brass plaques.

Cattle can often be seen grazing in the paddocks in front of the House.  They are the property of the Tasman District School.