Delphi is based on Unicorn, a machine learning model that is pre-trained to perform “common sense” reasoning. It works by choosing the most reasonable end to a string of text.
To benchmark, the model’s performance of the average person’s moral scruples researchers employs Mechanical Turk workers who view the AI’s decision on a topic and decide if they agree. Each AI decision goes to three different workers who then decide if the AI is correct. Majority rules.
Delphi AI needs to learn morality
According to the developers of the project, AI is quickly becoming more powerful and spreading throughout our culture. So scientists are trying to fast-track teaching machine learning systems morality and ethics.
Researchers are feeding Delphi posts from Reddit, the social news aggregation website. And from opinions obtained on the Mechanical Turks, a large crowdsourcing platform for remote workers. Delphi also has the advantage of training on the Commonsense Norm Bank, which uses 1.7 million examples of people’s ethical judgments pulled from a variety of datasets.
