The Duke of Sussex has been accused of "harassment and bullying at scale" by the chair of a charity he founded.