• 0 Posts
  • 3 Comments
Joined 1 year ago
cake
Cake day: June 10th, 2023

help-circle

  • I heard a comment this morning about AI that I’ll paraphrase: AI doesn’t give human responses. It gives what is has been told are human responses.

    The team asked GPT-3.5, which produces eerily humanlike text, to judge the ethics of 464 scenarios, previously appraised by human subjects, on a scale from –4 (unethical) to 4 (ethical)—scenarios such as selling your house to fund a program for the needy or having an affair with your best friend’s spouse. The system’s answers, it turned out, were nearly identical to human responses, with a correlation coefficient of 0.95.

    So, there will be selection bias inherent in the chat bot based off what text you have trained it on. The responses to your questions will be different if you’ve trained it on media from say a religious forum vs 4Chan. You can very easily make your study data say exactly what you want it to say depending on which chat bot you use. This can’t possibly go wrong. /S