New York City's AI Chatbot Giving Wrong Advice

SOURCE finance.yahoo.com
New York City's AI chatbot, MyCity, has been giving business owners wrong advice that could lead to breaking the law, prompting Mayor Eric Adams to defend the technology and acknowledge the need for fixes.

Key Points

  • Mayor Eric Adams defends the MyCity chatbot but acknowledges the need for fixes
  • The chatbot has been giving incorrect advice to business owners, such as suggesting employers can take a cut of workers' tips or ignoring city regulations
  • Despite being a pilot program, the chatbot remains online and still gives wrong answers
  • Microsoft's Azure AI service, on which the chatbot relies, is working with the city to fix the issues

Cons

  • Chatbot has been giving wrong advice to business owners
  • Some advice could lead to breaking the law or serious legal consequences
  • Chatbot's reliance on generative AI platforms may lead to inaccurate responses