Docklands heads up the more recent part of town. Bring an apple and feed the possums up involving trees.
Another new hostel, "Wake Up" in Pitt St is claimed to because the best large hostel available anywhere. Plan overnight train trips so your train ticket doubles up as accommodation.