Game of Thrones’ fantasy cartographer also hates it when the TV show strays from the book