Construction workers are refusing to tear down a brutalist architecture landmark in Australia