“Industry leaders should engage with state lawmakers on AI bills, given many legislators have limited experience with the technology or in healthcare more broadly, experts said during a HIMSS summit.”
Why this is important: With the use of AI spreading throughout our economy, there has been a significant increase in proposed legislation to regulate it. The rise in this proposed legislation is at the state level. Over 1,000 AI-related bills have been introduced in state legislatures throughout the country. That is an increase of 300-500 AI bills from 2024. There is a need for these state-level laws regulating healthcare-related AI technology due to the federal government’s lack of oversight and desire to deregulate the development of AI.
Many of these bills prohibit or require monitoring of the use of AI by insurers to handle claims. Large insurers like UnitedHealthcare, Humana, and CVS have already been subject to governmental scrutiny and have even been sued for using predictive algorithms to deny claims. In one class action, UnitedHealthcare was sued because its claims-handling AI had a high error rate when evaluating claims, it overruled the patients’ physicians’ recommendations, and UnitedHealthcare refused to have the decisions reviewed by a human reviewer. Humana was sued because its claims-handling AI allegedly denied rehabilitation care for elderly patients despite recommendations made by the patients’ physicians. Cigna was also subject to a class action because its claims-handling AI denied claims without a human review. These lawsuits also included claims of disparate impact, lack of human oversight, and that the AI algorithms included biased data. State legislators are seeking to ensure that if AI is used to handle insurance claims, the process is neutral, fair, and has human oversight.
State legislators are also concerned about the impact the use of AI has on mental health. Increasingly, people are turning to mental health chatbots for mental health issues. There is a concern that AI is not capable of delivering effective mental health care. More alarming are the cases of teenagers who have died by suicide after being consumed by their relationship with AI. State legislators are seeking to understand these issues and ensure proper safeguards are in place to protect people when they are at their most vulnerable.
As with all new technologies, the technology often is far out ahead of regulation. State legislators are now playing catch-up and trying to not only understand AI, but also reel it in before their constituents are harmed by it. Time will tell whether these efforts will be successful. --- Alexander L. Turne
Featured Attorneys Question & Answer