How AI Résumé Screening Works in a Recruiter's Day
Applicant tracking systems parse, match and grade résumés, chatbots schedule interviews and send offers, and New York City's bias-audit law measures the outcomes. Here is how each step works, which recruiter tasks AI does, and what the rules require.
Checked against NYC Local Law 144 of 2021 and DCWP's final rule (adopted April 2023), the EU AI Act as amended by the 2026 simplification regulation, Colorado SB26-189 as enacted, and O*NET 31.0
Role scorecard
Human Resources Specialists SOC 13-1071.00
- Core tasks AI does in production3 of 8
- Most mature evidenceIn production
- CostNot disclosed
- BenefitOffer rate 9.73% vs 8.70% with AI-led interviews (field experiment; see below)
As of · Tasks: O*NET 31.01
| Core task (O*NET) | What AI or robots do | Extent | Evidence grade | Example case | Source |
|---|---|---|---|---|---|
| Interpret and explain human resources policies, procedures, laws, standards, or regulations | A virtual agent answers employees' policy questions ("What is the sickness policy?") from about 7,000 policy pages; human advisors take complex cases | Does it | In production | AskHR at IBM (IBM's own HR; IBM also sells the underlying watsonx Orchestrate) | 2 |
| Hire employees and process hiring-related paperwork | A chat assistant sends job offers to candidates once a manager has selected them | Assists | In production | "Ava Cado" (Paradox) at Chipotle, rolled out to 3,500+ restaurants from October 2024 | 3 |
| Review employment applications and job orders to match applicants with job requirements | Grades every application A to D by how well its stated credentials match the requisition; recruiters keep the decision | Assists | In production | HiredScore (Workday) at Pfizer, audited on applications from August 2022 to February 2025 | 4, 5 |
| Inform job applicants of details such as duties and responsibilities, compensation, benefits, schedules, working conditions, or promotion opportunities | A chat assistant answers candidates' questions about the employer, in English, Spanish, French or German | Does it | In production | "Ava Cado" (Paradox) at Chipotle, since October 2024 | 3 |
| Select qualified job applicants or refer them to managers, making hiring recommendations when appropriate | An assessment sorts applicants into top, middle and bottom tiers; the employer evaluates candidates at the top/middle-versus-bottom threshold | Assists | In production | HireVue at Pfizer, per its September 2023 notice; its May 2026 notice names only HiredScore | 6, 7 |
| Contact job applicants to inform them of the status of their applications | A chat assistant collects basic details and books interviews with hiring managers | Does it | In production | "Ava Cado" (Paradox) at Chipotle, since October 2024 | 3 |
| Interview job applicants to obtain information on work history, training, education, or job skills | An AI voice agent runs the first-round interview by phone; human recruiters review it and decide | Assists | Pilot | Randomized field experiment with about 70,000 applicants at PSG Global Solutions (Teleperformance), Philippines, data collection completed June 2025 | 8 |
| Perform searches for qualified job candidates, using sources such as computer databases, networking, Internet recruiting resources, media advertisements, job fairs, recruiting firms, or employee referrals | An AI agent searches member profiles from a recruiter's intake notes and drafts outreach | Not yet | Vendor claim | LinkedIn Hiring Assistant, global in English from September 2025; customer names and quotes appear only in LinkedIn's own release | 9 |
Extent and grade follow our evidence grades: "Does it" needs a production case where AI performs the task on its own; "Assists" means AI helps a person do it; "Not yet" means only prototypes, vendor claims or nothing. Eight of O*NET's 19 core tasks for the role are shown: the recruiting and policy tasks with a case we could source. Tasks such as handling harassment complaints, orientations and exit interviews are left out because no graded case was found.
Costs and benefits
| List price of the tools on this page | Not disclosed: no public price for Paradox, HiredScore, HireVue or LinkedIn Hiring Assistant was found on the pages cited here |
|---|---|
| HR operating cost | 40% reduction in the HR team's operational costs over four years, which IBM says AskHR "helped contribute to" (company-stated)2 |
| Time to hire | Expected cut of "as much as 75%" for in-restaurant roles (Chipotle, October 2024)3; application to start date fell from 12 days to four (vendor-published Workday customer story)10 |
| Hiring outcomes | Offer rate 9.73% with AI-led interviews vs 8.70% with human interviewers; still employed after one month 5.89% vs 4.98% (independent field experiment run through the University of Chicago, funded by academic and foundation grants and the Google Cloud Research Program)8 |
| Recruiter time | Early adopters "saving 4+ hours per role, reviewing 62% fewer profiles" (vendor-stated, LinkedIn)9 |
| Penalty for skipping NYC's rules | $500 to $1,500 per day for violations of Local Law 144 (New York State Comptroller)11 |
Seen at work
How it works
1. Parsing and matching: the applicant tracking system's first pass
Most screening starts inside an applicant tracking system (ATS), the database that receives applications for an employer's job postings. The software first parses each résumé, turning free text into fields such as job titles, dates, education and skills, and then compares those fields with the requirements in the posting. Court filings in Mobley v. Workday, Inc. describe one such feature in Workday's own words: Candidate Skills Match "extract[s] skills in the employer's job posting" and the applicant's materials to "determine the extent to which the applicant's skills match the role," and reports the result to the employer as "strong," "good," "fair," "low," "pending" or "unable to score."12
Pfizer's published description of HiredScore, a Workday product it uses, follows the same pattern: each application gets a grade from A (strongest match to the requisition) to D, scored independently of the other applicants in the pool. Pfizer states that the grade "does not supplant human judgment" and that recruiters and hiring managers "always have complete discretion" over whom they select.4 In the scorecard above that is why matching counts as "Assists": the software sorts, a person decides.
2. Scoring, tiers and the language-model layer
A second family of tools scores the candidate rather than the résumé. Pfizer's 2023 notice listed HireVue alongside HiredScore; the HireVue assessment in the audit Pfizer posted sorts applicants into top, middle and bottom tiers, and the report states that Pfizer evaluates candidates using the top/middle-versus-bottom threshold.67 Newer features write text instead of a number. CareerPlug, an ATS for small businesses and franchises, offers a "position-specific qualification summary" that, when a client clicks it, opens with one of three verdicts ("Meets key requirements," "Meets some key requirements," "Missing key requirements") followed by a narrative summary of the applicant against the job.13
Whether large language models (LLMs) sort fairly is still mostly tested in labs. A University of Washington study presented at the 2024 AAAI/ACM Conference on AI, Ethics, and Society ran over 500 public résumés against 500 job descriptions through three text-embedding models and found White-associated names significantly favored in 85.1% of tests.14 That is a prototype-grade result: simulated screening, not an employer's live system. An August 2026 erratum says the paper's gender-only results were inverted by a coding bug; its race and intersectional results were unaffected and were replicated by a second team.14
3. Conversational assistants: questions, scheduling and offers
The tasks AI most clearly does on its own are the conversational ones. When Chipotle rolled out Paradox's system across more than 3,500 restaurants in October 2024, it said its assistant, named "Ava Cado," would chat with candidates, answer their questions about Chipotle, collect basic information, schedule interviews for hiring managers and send offers "to candidates who are selected by managers."3 The split is explicit: the software handles the messages, a manager makes the choice.
The same pattern runs on the employee side of HR. IBM says its AskHR agent answers routine questions such as "What is the sickness policy?" while human advisors take complex cases; language models classify each prompt, route it to an HR domain and either trigger a task or write an answer. IBM reports a 94% containment rate for common questions and more than 11.5 million employee interactions in 2024 (company-stated; IBM also sells the platform).2
4. AI-led interviews
Interviewing is where the evidence is newest. In a pre-registered natural field experiment with PSG Global Solutions, a recruitment outsourcing subsidiary of Teleperformance hiring for customer-service jobs in the Philippines, about 70,000 applicants were randomly assigned to a human interviewer or an AI voice agent, which disclosed that it was artificial at the start of each call. Human recruiters then evaluated every interview and made the hiring decisions.8
Applicants interviewed by the AI agent received offers in 9.73% of cases against 8.70% for human interviewers, which the researchers report as a 12% higher likelihood; they were also 18% more likely to start the job and to still be employed a month later. Transcript analysis found the AI interviews more structured and consistent, which the authors associate with more hiring-relevant information being collected. The paper discloses that the partner firm supplied data but had no role in the analysis, and that one author took an unpaid role at the firm after data collection ended in June 2025.8 Because it was a trial in real hiring rather than a standing deployment, it is graded "Pilot."
5. Sourcing agents: searching before anyone applies
Before applications arrive, AI agents now search for candidates. LinkedIn says its Hiring Assistant, launched to charter customers in October 2024, became available globally in English by the end of September 2025, and that early adopters were "saving 4+ hours per role, reviewing 62% fewer profiles" (vendor-stated).9 The customer names and quotes in that release appear in LinkedIn's own material, so this page grades the case as a vendor claim until an employer confirms it in its own words.
Sourcing also falls outside New York City's audit law. DCWP's guidance says the requirements do not apply when an employer uses a tool to scan a résumé bank, conduct outreach or invite applications; they apply only to assessing people who have applied for a specific position.15
6. What a New York City bias audit measures
Local Law 144 of 2021 bars employers and employment agencies from using an automated employment decision tool (AEDT) for jobs in the city unless the tool has had a bias audit within the past year, a summary of the results is public, and candidates got notice; DCWP began enforcing it on July 5, 2023.16 An AEDT is a tool that uses machine learning, statistical modeling, data analytics or AI and "substantially assists or replaces discretionary decision-making." The audit must be done by an independent auditor, and notice must reach candidates 10 business days before use.15
The core number is the impact ratio. DCWP's rule defines it as the selection rate for a category divided by the selection rate of the most selected category (or, for tools that score, the share scoring above the median divided by the highest such share).17 CareerPlug's vendor-commissioned audit of its summary feature, prepared by Resolution Economics using the law's framework "solely for methodological purposes," shows the arithmetic: 1,105 of 1,470 female applications got a "meets" verdict (75.2%) and 888 of 1,224 male applications did (72.5%), so the male impact ratio is (888 ÷ 1,224) ÷ (1,105 ÷ 1,470) ≈ 0.965, reported as 0.97. For Asian applicants, 107 of 199 (53.8%) against 912 of 1,178 White applicants (77.4%) gives about 0.69, which the audit attributes to a single position at a single client.13 Categories under 2% of the data may be left out, and the same audit excluded 19,613 applications with unknown sex.1513
The law sets no pass mark. DCWP says it "does not require any specific actions based on the results of a bias audit."15 The rule describes its calculation as consistent with the federal Uniform Guidelines on Employee Selection Procedures,17 but the often-quoted 0.8 threshold, a rule of thumb from employment-discrimination cases,18 is not written into Local Law 144. Some posted summaries invoke it anyway: Pfizer's describes impact ratios of at least 80% as consistent with the law's "bias-free" requirements.4 How much the audits reveal is debated. A FAccT 2024 study in which 155 student investigators checked 391 employers found 18 posted audit reports and 13 transparency notices, and argued that because employers decide for themselves whether a tool is in scope, an absent audit cannot be read as non-compliance.18 In December 2025 the New York State Comptroller found DCWP's enforcement ineffective: DCWP received two complaints from July 2023 to June 2025, nine of 12 test calls to 311 never reached it, and where DCWP's review of the same 22 employers found one issue, the auditors found at least 17 instances of potential non-compliance.11 This page explains the law; for what it requires of a specific employer, see DCWP's AEDT page.
7. Illinois, Colorado, the EU and existing discrimination law
Other rules regulate the same tools in different ways:
| Illinois (HB 3773, amending the Human Rights Act) | In force January 1, 2026: employers may not use AI in recruitment, hiring and other decisions in a way that has the effect of discriminating on protected grounds, may not use ZIP codes as a proxy, and must notify employees when AI is used (Epstein Becker Green summary).19 The state's proposed notice rules, published May 15, 2026, were withdrawn on June 2, 2026; the statute still applies (Burke, Warren, MacKay & Serritella summary).20 Illinois's 2019 Artificial Intelligence Video Interview Act separately requires notice, an explanation and consent before AI analyzes video interviews.19 |
|---|---|
| Colorado (SB26-189) | Signed May 14, 2026, repealing and re-enacting the 2024 AI act. Covers automated decision-making technology used in "consequential decisions," including employment: notice at the point of interaction, a plain-language explanation within 30 days of an adverse outcome, and a right to request human review. Developers' documentation duties start January 1, 2027; the attorney general enforces it.21 |
| European Union (AI Act, Annex III point 4) | AI systems "intended to be used for the recruitment or selection of natural persons," including to "analyse and filter job applications, and to evaluate candidates," are high-risk.22 Employers using them must assign human oversight and inform workers' representatives and affected workers before use.23 Under the 2026 simplification regulation, the obligations for stand-alone high-risk systems apply from December 2, 2027, instead of August 2, 2026.24 |
General anti-discrimination law applies regardless. In Mobley v. Workday, Inc. (N.D. Cal., No. 23-cv-00770), the court on May 16, 2025 granted preliminary certification of a nationwide collective of applicants aged 40 and over on an age-discrimination claim, finding they were similarly situated because of an alleged "unified policy: the use of Workday's AI recommendation system to score, sort, rank, or screen applicants." The order is not a ruling on the merits, and Workday can ask the court to decertify the collective after discovery.12
Sources
- O*NET OnLine (O*NET 31.0), 13-1071.00 Human Resources Specialists, retrieved 2026-10-13.
- IBM, Transforming HR support with agentic AI (case study), retrieved 2026-10-13.
- Chipotle Mexican Grill, Chipotle Introduces New AI Hiring Platform to Support Its Accelerated Growth, October 22, 2024.
- Pfizer, Pfizer Bias Audit Summary of the Hired Score Grade System (PDF), May 29, 2026.
- Pfizer, New York City – Automated Employment Decisions Tools (Local Law 144) (notice, PDF), May 29, 2026.
- Pfizer, NYC Automated Employment Decision Tools (Local Law 144) Notice (PDF), September 18, 2023.
- DCI Consulting Group (posted by Pfizer), New York City Local Law 144 "Bias Audit" for HireVue (PDF), July 5, 2023.
- University of Chicago Booth School of Business researchers, Voice AI in Firms: A Natural Field Experiment on Automated Job Interviews, arXiv:2607.28222v2, September 11, 2026.
- LinkedIn, Hiring Assistant, LinkedIn's first AI agent for recruiters, to launch globally in English, September 3, 2025.
- Workday, Chipotle leverages conversational AI to scale hiring (customer story), retrieved 2026-10-13.
- Office of the New York State Comptroller, Department of Consumer and Worker Protection: Enforcement of Local Law 144 – Automated Employment Decision Tools, Report 2024-N-6 (PDF), December 2, 2025.
- U.S. District Court for the Northern District of California, Mobley v. Workday, Inc., No. 23-cv-00770-RFL, Order Granting Preliminary Collective Certification (Dkt. 128) (PDF via Civil Rights Litigation Clearinghouse), May 16, 2025.
- Resolution Economics LLC (prepared for CareerPlug), Bias Audit of Position-Specific Qualification Summary Feature in CareerPlug's Hiring and Retention Software Using the Framework of New York City's Local Law 144 (PDF), April 9, 2026.
- University of Washington Information School, Gender, Race, and Intersectional Bias in Resume Screening via Language Model Retrieval, Proceedings of AIES 2024, arXiv:2407.20371v3 (with August 29, 2026 erratum).
- NYC Department of Consumer and Worker Protection, Automated Employment Decision Tools: Frequently Asked Questions (PDF), June 29, 2023.
- NYC Department of Consumer and Worker Protection, Automated Employment Decision Tools (AEDT), retrieved 2026-10-13.
- NYC Department of Consumer and Worker Protection, Notice of Adoption of Final Rule: Automated Employment Decision Tools (PDF), April 2023.
- ACM FAccT 2024, Null Compliance: NYC Local Law 144 and the Challenges of Algorithm Accountability, arXiv:2406.01399, June 3, 2024.
- Epstein Becker Green, Workforce Bulletin, Illinois Prohibits Discriminatory Artificial Intelligence in Employment Decisions, August 14, 2024 (secondary source; the Illinois General Assembly site was unreachable).
- Burke, Warren, MacKay & Serritella, Illinois Department of Human Rights Withdraws Proposed AI in Employment Rules, June 16, 2026 (secondary source).
- Colorado General Assembly, SB26-189 Automated Decision-Making Technology (bill summary as enacted and history), retrieved 2026-10-13.
- EU Artificial Intelligence Act (Regulation (EU) 2024/1689), Annex III: High-Risk AI Systems Referred to in Article 6(2), via artificialintelligenceact.eu, retrieved 2026-10-13.
- EU Artificial Intelligence Act (Regulation (EU) 2024/1689), Article 26: Obligations of Deployers of High-Risk AI Systems, via artificialintelligenceact.eu, retrieved 2026-10-13.
- Council of the EU, Artificial Intelligence: Council gives final green light to simplify and streamline rules (press release as republished by the EU Delegation to Chile), June 30, 2026.