For years, no one visited downtown LA until an architectural jewel helped bring it back to life