AI Chat used by mental health tech company in experiment on real users

  • 📰 NBCNews
  • ⏱ Reading Time:
  • 30 sec. here
  • 2 min. at publisher
  • 📊 Quality Score:
  • News: 15%
  • Publisher: 86%

Business News News

Business Business Latest News,Business Business Headlines

An online emotional support chat service ran an experiment in which an AI wrote responses to users. The experiment could be a preview of the ethical disputes to come as AI technology works its way into more consumer products and health services.

on Jan. 6, he was inundated with criticism. Academics, journalists and fellow technologists accused him of acting unethically and tricking people into becoming test subjects without their knowledge or consent when they were in the vulnerable spot of needing mental health support. His Twitter thread got more than 8 million views.

No option was provided to opt out of the experiment aside from not reading the response at all, Morris said. “If you got a message, you could choose to skip it and not read it,” he said. “This is an organization that is trying to provide much-needed support in a mental health crisis where we don’t have sufficient resources to meet the needs, and yet when we manipulate people who are vulnerable, it’s not going to go over so well,” she said. People in mental pain could be made to feel worse, especially if the AI produces biased or careless text that goes unreviewed, she said.

 

Thank you for your comment. Your comment will be published after being reviewed.
Please try again later.

Great. Just great. What is the world coming to.

they didn't see M3GAN😱😱😱

The ethical dilemmas are countless

Only consumers have the power to prevent corporations from reducing the value of human interaction to a mere algorithm. Never treat AI or bots as a valid human replacement.

I am with you JudgeJeanine & BTW they don't teach children how to read a clock &I know that is a spec of sand among 20 million tons of sand but it's true and that's where it's starts Europarl_EN UniofOxford let us have him y'all take JohnKerry algore DNC that's a fair trade

Jesus, time to give up AI. It's not worth it.

What is different about 'AI technology' and non AI technology? I understood AI is data in computers. So all technology is AI. Non AI technology does not exist.

AI does not work it’s way anywhere. Humans make choices whether or not to implement it. Is humans don’t move forward with it, there is no issue.

Garbage In Garbage Out. These stories ignore the fact that there is no intelligence in AI.. These are human engineered algorithms that that reflect the biases and errors from the people who coded them. Left unchecked, it's proved that they will self-amplify our feelings.

A variation of the 'penny fortune teller' episode on 'The Twilight Zone.'

We have summarized this news so that you can read it quickly. If you are interested in the news, you can read the full text here. Read more:

 /  🏆 10. in BUSİNESS

Business Business Latest News, Business Business Headlines