The UK’s first black royal has already walked away