The Old Government Buildings claims various records like once being the largest wooden building in the southern hemisphere, and the largest anywhere that's still standing (they tend to be a bit susceptible to fires.) It's lovely outside, but for me the real delight is the glorious double staircase inside.
In its day this building housed all the public service, including the actual Cabinet Room. Nowadays it houses the Law Faculty of Victoria University of Wellington, and the Cabinet Room includes a sign indicating it's not for students' 'casual' use.