The subtle signals presidents send by whom they invite to their final fancy White House dinner