California Legislation Aims to Safeguard Workers from AI Influence

New California law restricts AI's role in employee terminations, ensuring human oversight and worker protection.

Artificial Intelligence (AI) is increasingly involved in workplace dynamics, particularly in hiring and employee assessment. A recent survey by MyPerfectResume revealed that a significant 73% of HR professionals apply AI in their hiring processes, while 52% utilize it for restructuring or planning roles.

The use of AI extends beyond recruitment, with hiring managers leveraging it for deeper insights into candidate behavior. In fact, 51% of those surveyed reported using AI to identify "risky" candidates. Interestingly, just 26% stated they do not incorporate AI when making layoff decisions.

Regulating AI Usage

To address these emerging challenges, California has introduced Senate Bill 947, also humorously dubbed the "No Robo Bosses Act." This legislation aims to protect employees from the risks associated with automated decision-making in disciplinary and termination actions. Under this law, employers are prohibited from fully delegating such significant decisions to AI systems, which are referred to in the bill as Automated Decision Systems (ADS).

The legislation mandates that employers review any AI-generated outcomes regarding employee discipline or dismissal. Additionally, they are required to provide affected employees with a clear explanation of the reasons behind these decisions. This includes revealing the data that influenced the decision-making process, encompassing performance evaluations, personnel files, and peer assessments.

"If an employer cannot validate the ADS results or finds them to be inaccurate, they are barred from using those outcomes for disciplinary action," the bill asserts.

Key Provisions of the Law

The new law is set to come into effect on July 1, 2027, allowing employees who feel their termination was unjustly influenced by the automated systems to file complaints with the California Labor Commissioner. While the legislation does not outright ban the use of AI in these contexts, it does call for transparency regarding whether layoffs or other employment changes are instigated by AI analyses.

Although there is limited federal guidance on AI practices within hiring and employee management, various states are beginning to fill the gaps with their own legislation. While states like Colorado and Connecticut focus on requiring disclosures about AI usage, California and New York are pushing for stricter regulations. Illinois also made headlines this summer by implementing a historic law requiring independent audits of advanced AI systems.

Future Implications and Concerns

Lily Li, a legal expert in AI and the founder of Metaverse Law, believes that California's new regulations could serve as a foundation for similar laws across the United States. However, she does caution that companies might exploit unknown loopholes within the required human oversight protocols.

"There’s a risk that employers will engage in superficial reviews rather than meaningful evaluations to avoid incurring additional operational costs," Li observes, adding that the new measures do provide a framework for employees to request clear explanations of their terminations.

This new legislation, while a step in the right direction, raises concerns that ultimately, the burden of challenging improper AI-driven dismissals might fall on employees who need to contest their firings in court. Without broader federal regulations, protections against unregulated AI-driven employment decisions will likely remain inconsistent across the nation.