AI only knows what humans program it to know, by training AI programs with certain datasets. Often inherent in these datasets are human biases, many of which we may not realize are there. For example, consider a resume scanning AI program that is fed data about successful employees who happen to be young. This may result in the program concluding that in a particular job, young people are better candidates. While this may be unintentional on the part of the employer, the AI screening tool may weed out those with experience dating back decades, thereby discriminating against applicants based on their age, in violation of the Age Discrimination in Employment Act (“ADEA”).
Using AI screening software can lead to unintentional, unlawful discrimination, even if the employer does not intend it to. In May 2022, the Equal Employment Opportunities Commission (“EEOC”) and the Department of Justice both published guidance to help employers using AI screening programs avoid discriminating against those with disabilities, in violation of the Americans with Disabilities Act. The material discusses how those with disabilities may be unintentionally discriminated against when AI fails to consider that their resume may look different due to their disability. The EEOC gives the example of applicants being screened out by AI trained to ignore those with resume gaps. While screening out those with gaps in their resume may be a seemingly innocent piece of criteria, when that resume gap is the result of a disability, this could constitute disability discrimination. Many employers utilize AI to try and remove bias from the hiring process, but unlawful discrimination can occur even with the best of intentions.
In December 2021, the New York City Council enacted Local Law 144 (“the AI Law.”) Pursuant to the AI Law, the New York City Department of Consumer and Worker Protection proposed rules that would require employers to give notice to applicants when using an “Automated Employment Decision Tool,” require an annual bias audit, and require employers to publish the results. On April 15, 2023, after a delay due to the high volume of public comments on the proposed rules, the New York City AI Law will take effect, and hopefully the results of these annual bias audits will help programmers remove more bias from the hiring process.
Despite their flaws, AI programs can be an effective tool in resume screening. If employers and programmers continue to identify problems with AI screening, and work to correct and avoid bias, these programs have great potential.
While the New York City AI Law is not yet enforceable, if you believe you may have been a victim of discrimination in the workplace, you should speak to an experienced New York employment law attorney. To learn more or to schedule a consultation to discuss your situation, contact Borrelli & Associates, P.L.L.C. for a free consultation.
January 2024 Firm represented a female staff member against her former employer for egregious hostile…
New Action filed in the United States District Court Eastern District of New York On…
With the legalization of recreational marijuana use in New York, many residents are curious about…
Pregnancy is an exciting and challenging time. Unfortunately, it can also be a period where…
Since the pandemic, remote work has become a defining feature of the modern workforce. Employers…
Firm represented a female staff member against her former employer for egregious hostile work environment,…