S T A T E O F N E W Y O R K
________________________________________________________________________
5641--A
2023-2024 Regular Sessions
I N S E N A T E
March 10, 2023
___________
Introduced by Sen. COMRIE -- read twice and ordered printed, and when
printed to be committed to the Committee on Labor -- recommitted to
the Committee on Labor in accordance with Senate Rule 6, sec. 8 --
committee discharged, bill amended, ordered reprinted as amended and
recommitted to said committee
AN ACT to amend the labor law, in relation to automated employment deci-
sion tools
THE PEOPLE OF THE STATE OF NEW YORK, REPRESENTED IN SENATE AND ASSEM-
BLY, DO ENACT AS FOLLOWS:
Section 1. The labor law is amended by adding a new article 20-D to
read as follows:
ARTICLE 20-D
AUTOMATED EMPLOYMENT DECISION TOOLS
SECTION 750. DEFINITIONS.
751. ANTI-DISCRIMINATION.
752. REQUIREMENTS FOR A DEPLOYER OF AN AUTOMATED EMPLOYMENT
DECISION TOOL.
753. REQUIREMENTS FOR A DEVELOPER OF AN AUTOMATED EMPLOYMENT
DECISION TOOL.
754. AI GOVERNANCE.
755. TRANSPARENCY.
756. ENFORCEMENT.
757. COMPLIANCE.
§ 750. DEFINITIONS. FOR THE PURPOSES OF THIS ARTICLE, THE FOLLOWING
TERMS SHALL HAVE THE FOLLOWING MEANINGS:
1. "ARTIFICIAL INTELLIGENCE" SHALL MEAN A MACHINE-BASED SYSTEM THAT
CAN, FOR A GIVEN SET OF HUMAN-DEFINED OBJECTIVES, MAKE PREDICTIONS,
RECOMMENDATIONS, OR DECISIONS INFLUENCING REAL OR VIRTUAL ENVIRONMENTS.
AN ARTIFICIAL INTELLIGENCE SYSTEM USES MACHINE AND HUMAN-BASED INPUTS
TO:
(A) PERCEIVE REAL AND VIRTUAL ENVIRONMENTS;
EXPLANATION--Matter in ITALICS (underscored) is new; matter in brackets
[ ] is old law to be omitted.
LBD02768-02-3
S. 5641--A 2
(B) ABSTRACT SUCH PERCEPTIONS INTO MODELS THROUGH ANALYSIS IN AN AUTO-
MATED MANNER; AND
(C) USE MODEL INFERENCE TO FORMULATE OPTIONS FOR INFORMATION OR
ACTION.
2. "AUTOMATED EMPLOYMENT DECISION TOOL" SHALL MEAN A SYSTEM OR SERVICE
THAT USES ARTIFICIAL INTELLIGENCE AND HAS BEEN SPECIFICALLY DEVELOPED
AND MARKETED TO, OR SPECIFICALLY MODIFIED TO BE, THE CONTROLLING FACTOR
IN MAKING A CONSEQUENTIAL EMPLOYMENT DECISION.
3. "CONSEQUENTIAL EMPLOYMENT DECISION" SHALL MEAN A DETERMINATION MADE
BY A DEPLOYER TO HIRE, PROMOTE, OR TERMINATE THE EMPLOYMENT OF AN INDI-
VIDUAL.
4. "CONTROLLING FACTOR" SHALL MEAN A FACTOR THAT IS WEIGHTED MORE THAN
ALL OTHER FACTORS COMBINED.
5. "DEPLOYER" SHALL MEAN ANY PERSON, PARTNERSHIP, OR CORPORATION THAT
USES AN AUTOMATED EMPLOYMENT DECISION TOOL FOR A CONSEQUENTIAL EMPLOY-
MENT DECISION.
6. "DEVELOPER" SHALL MEAN ANY PERSON, PARTNERSHIP, OR CORPORATION THAT
KNOWINGLY DESIGNS, CODES, OR PRODUCES AN AUTOMATED EMPLOYMENT DECISION
TOOL, OR SUBSTANTIALLY MODIFIES AN ARTIFICIAL INTELLIGENCE SYSTEM OR
SERVICE FOR THE INTENDED PURPOSE OF BEING THE CONTROLLING FACTOR IN A
CONSEQUENTIAL EMPLOYMENT DECISION, WHETHER FOR ITS OWN USE OR FOR USE BY
A THIRD PARTY.
7. "IMPACT ASSESSMENT" SHALL MEAN A DOCUMENTED RISK-BASED EVALUATION
OF AN AUTOMATED EMPLOYMENT DECISION TOOL, IN ACCORDANCE WITH THE MINIMUM
REQUIREMENTS IN SUBDIVISION TWO OF SECTION SEVEN HUNDRED FIFTY-TWO OF
THIS ARTICLE AND SUBDIVISION THREE OF SECTION SEVEN HUNDRED FIFTY-THREE
OF THIS ARTICLE, RESPECTIVELY.
§ 751. ANTI-DISCRIMINATION. 1. A DEPLOYER SHALL NOT USE AN AUTOMATED
EMPLOYMENT DECISION TOOL IN A MANNER THAT VIOLATES ARTICLE FIFTEEN OF
THE EXECUTIVE LAW.
2. NOTHING IN THIS SECTION SHALL LIMIT A DEPLOYER FROM PROCESSING DATA
FOR THE PURPOSE OF PREVENTING OR ADDRESSING UNLAWFUL DISCRIMINATION OR
COMPLYING WITH THIS ARTICLE OR OTHERWISE EVALUATING THE EFFECTIVENESS OF
AN AUTOMATED EMPLOYMENT DECISION TOOL.
§ 752. REQUIREMENTS FOR A DEPLOYER OF AN AUTOMATED EMPLOYMENT DECISION
TOOL. 1. WITHIN ONE YEAR OF THE EFFECTIVE DATE OF THIS SECTION, AND
ANNUALLY THEREAFTER, A DEPLOYER SHALL PERFORM AN IMPACT ASSESSMENT FOR
ANY AUTOMATED EMPLOYMENT DECISION TOOL THAT SUCH DEPLOYER USES.
2. THE IMPACT ASSESSMENT REQUIRED PURSUANT TO SUBDIVISION ONE OF THIS
SECTION SHALL INCLUDE, BUT NOT BE LIMITED TO:
(A) A STATEMENT OF THE PURPOSE OF THE AUTOMATED EMPLOYMENT DECISION
TOOL AND ITS BENEFITS, USES, AND DEPLOYMENT CONTEXTS;
(B) A DESCRIPTION OF THE AUTOMATED EMPLOYMENT DECISION TOOL'S OUTPUT
AND HOW SUCH OUTPUT IS THE CONTROLLING FACTOR IN A CONSEQUENTIAL EMPLOY-
MENT DECISION;
(C) A SUMMARY OF THE TYPE OF DATA COLLECTED FROM AN INDIVIDUAL AND
PROCESSED BY THE AUTOMATED EMPLOYMENT DECISION TOOL WHEN SUCH TOOL IS
THE CONTROLLING FACTOR IN A CONSEQUENTIAL EMPLOYMENT DECISION;
(D) A STATEMENT OF THE EXTENT TO WHICH THE DEPLOYER'S USE OF THE AUTO-
MATED EMPLOYMENT DECISION TOOL IS CONSISTENT WITH OR VARIES FROM THE
DEVELOPER'S STATEMENT OF INTENDED USE PROVIDED TO SUCH DEPLOYER PURSUANT
TO SUBDIVISION ONE OF SECTION SEVEN HUNDRED FIFTY-THREE OF THIS ARTICLE;
(E) AN ASSESSMENT OF ANY REASONABLY FORESEEABLE RISK OF UNLAWFUL
DISCRIMINATION ARISING FROM THE DEPLOYER'S USE OF THE AUTOMATED EMPLOY-
MENT DECISION TOOL AND A DESCRIPTION OF THE SAFEGUARD IMPLEMENTED OR
THAT WILL BE IMPLEMENTED BY SUCH DEPLOYER TO MITIGATE SUCH RISK;
S. 5641--A 3
(F) A DESCRIPTION OF HOW THE AUTOMATED EMPLOYMENT DECISION TOOL IS
USED AND MONITORED BY THE DEPLOYER WHEN IT IS THE CONTROLLING FACTOR IN
A CONSEQUENTIAL EMPLOYMENT DECISION; AND
(G) A DESCRIPTION OF HOW THE AUTOMATED EMPLOYMENT DECISION TOOL HAS
BEEN OR WILL BE EVALUATED FOR VALIDITY OR RELEVANCE.
§ 753. REQUIREMENTS FOR A DEVELOPER OF AN AUTOMATED EMPLOYMENT DECI-
SION TOOL. 1. A DEVELOPER SHALL PROVIDE A DEPLOYER WITH A STATEMENT
REGARDING THE INTENDED USE OF THE AUTOMATED EMPLOYMENT DECISION TOOL AND
DOCUMENTATION REGARDING:
(A) THE KNOWN LIMITATIONS OF THE CONSEQUENTIAL AUTOMATED DECISION
TOOL, INCLUDING ANY REASONABLY FORESEEABLE RISK OF UNLAWFUL DISCRIMI-
NATION ARISING FROM ITS INTENDED USE;
(B) A DESCRIPTION OF THE TYPE OF DATA USED TO PROGRAM OR TRAIN THE
AUTOMATED EMPLOYMENT DECISION TOOL; AND
(C) A DESCRIPTION OF HOW THE AUTOMATED EMPLOYMENT DECISION TOOL WAS
EVALUATED FOR VALIDITY AND EXPLAINABILITY BEFORE SALE OR LICENSING.
2. WITHIN ONE YEAR OF THE EFFECTIVE DATE OF THIS SECTION, AND ANNUALLY
THEREAFTER, A DEVELOPER SHALL PERFORM AN IMPACT ASSESSMENT FOR ANY AUTO-
MATED EMPLOYMENT DECISION TOOL MADE AVAILABLE FOR SALE OR LICENSING.
3. THE IMPACT ASSESSMENT REQUIRED PURSUANT TO SUBDIVISION ONE OF THIS
SECTION SHALL INCLUDE, BUT NOT BE LIMITED TO:
(A) A STATEMENT OF THE INTENDED PURPOSE OF THE AUTOMATED EMPLOYMENT
DECISION TOOL AND ITS INTENDED BENEFITS, USES, AND DEPLOYMENT CONTEXTS;
(B) A DESCRIPTION OF THE AUTOMATED EMPLOYMENT DECISION TOOL'S OUTPUT
AND HOW SUCH OUTPUT IS INTENDED TO BE THE CONTROLLING FACTOR IN CONSE-
QUENTIAL EMPLOYMENT DECISIONS;
(C) A SUMMARY OF THE TYPE OF DATA THE AUTOMATED EMPLOYMENT DECISION
TOOL IS INTENDED TO COLLECT FROM AN INDIVIDUAL WHEN IT IS THE CONTROL-
LING FACTOR IN A CONSEQUENTIAL EMPLOYMENT DECISION;
(D) AN ASSESSMENT OF ANY REASONABLY FORESEEABLE RISK OF UNLAWFUL
DISCRIMINATION ARISING FROM THE INTENDED USE OF THE AUTOMATED EMPLOYMENT
DECISION TOOL AND A DESCRIPTION OF THE SAFEGUARD IMPLEMENTED OR THAT
WILL BE IMPLEMENTED BY THE DEVELOPER TO MITIGATE SUCH RISK; AND
(E) A DESCRIPTION OF HOW THE AUTOMATED EMPLOYMENT DECISION TOOL CAN BE
MONITORED BY THE DEPLOYER WHEN IT IS THE CONTROLLING FACTOR IN A CONSE-
QUENTIAL EMPLOYMENT DECISION.
4. THIS SECTION DOES NOT REQUIRE A DEVELOPER TO DISCLOSE ANY TRADE
SECRET, AS DEFINED BY SECTION 1839 OF TITLE 18 OF THE UNITED STATES
CODE, OR OTHER PRIVILEGED OR CONFIDENTIAL BUSINESS INFORMATION TO A
DEPLOYER.
§ 754. AI GOVERNANCE. 1. A DEPLOYER OR DEVELOPER SHALL ESTABLISH,
DOCUMENT, IMPLEMENT, AND MAINTAIN A GOVERNANCE PROGRAM THAT CONTAINS
REASONABLE ADMINISTRATIVE AND TECHNICAL SAFEGUARDS TO MAP, MEASURE,
MANAGE, AND GOVERN THE REASONABLY FORESEEABLE RISK OF UNLAWFUL DISCRIMI-
NATION ASSOCIATED WITH THE USE OR INTENDED USE OF AN AUTOMATED EMPLOY-
MENT DECISION TOOL.
2. THE SAFEGUARDS REQUIRED PURSUANT TO SUBDIVISION ONE OF THIS SECTION
SHALL BE APPROPRIATE TO:
(A) THE USE OR INTENDED USE OF THE AUTOMATED EMPLOYMENT DECISION TOOL;
(B) THE ENTITY'S ROLE AS A DEPLOYER, DEVELOPER, OR BOTH;
(C) THE DEPLOYER OR DEVELOPER'S SIZE, COMPLEXITY, AND RESOURCES;
(D) THE NATURE, CONTEXT, AND SCOPE OF THE ACTIVITIES OF THE DEPLOYER
OR DEVELOPER IN CONNECTION WITH THE AUTOMATED EMPLOYMENT DECISION TOOL;
AND
(E) THE TECHNICAL FEASIBILITY AND COST OF AVAILABLE TOOLS, ASSESS-
MENTS, AND OTHER MEANS USED BY THE DEPLOYER OR DEVELOPER TO MAP, MEAS-
S. 5641--A 4
URE, MANAGE, AND GOVERN THE RISKS ASSOCIATED WITH AN AUTOMATED EMPLOY-
MENT DECISION TOOL.
3. A GOVERNANCE PROGRAM REQUIRED PURSUANT TO SUBDIVISION ONE OF THIS
SECTION SHALL BE DESIGNED TO, AT A MINIMUM:
(A) DESIGNATE ONE OR MORE EMPLOYEES TO BE RESPONSIBLE FOR OVERSEEING
AND MAINTAINING THE GOVERNANCE PROGRAM AND COMPLIANCE WITH THIS ARTICLE;
(I) AN EMPLOYEE DESIGNATED PURSUANT TO THIS PARAGRAPH MAY ASSERT TO
THEIR EMPLOYER A GOOD FAITH BELIEF THAT THE DESIGN, PRODUCTION, OR USE
OF AN AUTOMATED EMPLOYMENT DECISION TOOL FAILS TO COMPLY WITH THE
REQUIREMENTS OF THIS ARTICLE.
(II) AN EMPLOYER OF AN EMPLOYEE DESIGNATED PURSUANT TO THIS PARAGRAPH
SHALL CONDUCT A PROMPT AND COMPLETE ASSESSMENT OF ANY COMPLIANCE ISSUE
RAISED BY SUCH EMPLOYEE.
(B) IDENTIFY AND IMPLEMENT SAFEGUARDS TO ADDRESS REASONABLY FORESEEA-
BLE RISKS OF UNLAWFUL DISCRIMINATION RESULTING FROM THE USE OR INTENDED
USE OF AN AUTOMATED EMPLOYMENT DECISION TOOL;
(C) WHEN ACTING AS A DEPLOYER, CONDUCT IMPACT ASSESSMENTS IN ACCORD-
ANCE WITH SECTION SEVEN HUNDRED FIFTY-TWO OF THIS ARTICLE;
(D) WHEN ACTING AS A DEVELOPER, MEET ALL OBLIGATIONS REQUIRED PURSUANT
TO SECTION SEVEN HUNDRED FIFTY-THREE OF THIS ARTICLE;
(E) CONDUCT AN ANNUAL AND COMPREHENSIVE REVIEW OF THE POLICIES, PRAC-
TICES, AND PROCEDURES TO ENSURE COMPLIANCE WITH THIS ARTICLE;
(F) MAINTAIN THE RESULTS OF THE IMPACT ASSESSMENT REQUIRED BY THIS
ARTICLE FOR TWO YEARS AFTER THE COMPLETION OF SUCH IMPACT ASSESSMENT;
AND
(G) EVALUATE AND MAKE REASONABLE ADJUSTMENTS TO ADMINISTRATIVE AND
TECHNICAL SAFEGUARDS IN LIGHT OF MATERIAL CHANGES IN TECHNOLOGY, THE
RISKS ASSOCIATED WITH THE AUTOMATED EMPLOYMENT DECISION TOOL, THE STATE
OF TECHNICAL STANDARDS, AND CHANGES IN THE BUSINESS ARRANGEMENTS OR
OPERATIONS OF THE DEPLOYER OR DEVELOPER.
§ 755. TRANSPARENCY. 1. A DEPLOYER SHALL, AT OR BEFORE THE TIME OF A
CONSEQUENTIAL EMPLOYMENT DECISION, NOTIFY THE INDIVIDUAL THAT IS THE
SUBJECT OF THE CONSEQUENTIAL EMPLOYMENT DECISION THAT AN AUTOMATED
EMPLOYMENT DECISION TOOL IS IN USE.
2. A DEPLOYER SHALL PROVIDE THE FOLLOWING INFORMATION TO AN INDIVIDUAL
NOTIFIED PURSUANT TO SUBDIVISION ONE OF THIS SECTION:
(A) A STATEMENT OF THE PURPOSE OF THE AUTOMATED EMPLOYMENT DECISION
TOOL;
(B) A PLAIN LANGUAGE DESCRIPTION OF HOW THE AUTOMATED EMPLOYMENT DECI-
SION TOOL IS THE CONTROLLING FACTOR IN THE CONSEQUENTIAL EMPLOYMENT
DECISION; AND
(C) CONTACT INFORMATION OF THE DEPLOYER.
3. A DEPLOYER OR DEVELOPER SHALL MAKE PUBLICLY AVAILABLE, IN A READILY
ACCESSIBLE MANNER, A PLAIN LANGUAGE POLICY THAT PROVIDES A SUMMARY OF
THE FOLLOWING:
(A) THE TYPE OF AUTOMATED EMPLOYMENT DECISION TOOL CURRENTLY IN USE OR
MADE AVAILABLE TO OTHERS FOR USE; AND
(B) HOW THE DEPLOYER OR DEVELOPER MANAGES ANY REASONABLY FORESEEABLE
RISK OF UNLAWFUL DISCRIMINATION THAT ARISES FROM THE AUTOMATED EMPLOY-
MENT DECISION TOOL CURRENTLY IN USE OR MADE AVAILABLE TO OTHERS FOR USE.
§ 756. ENFORCEMENT. 1. THE ATTORNEY GENERAL MAY INITIATE AN INVESTI-
GATION OF A DEPLOYER OR DEVELOPER IF A PREPONDERANCE OF THE EVIDENCE
ESTABLISHES A SUSPICION OF A VIOLATION OF THIS ARTICLE.
(A) UPON THE REQUEST OF THE ATTORNEY GENERAL, A DEPLOYER OR DEVELOPER
SHALL, WITHIN FORTY-FIVE DAYS, PROVIDE TO THE ATTORNEY GENERAL ANY
IMPACT ASSESSMENT PERFORMED PURSUANT TO THIS ARTICLE.
S. 5641--A 5
(B) THE DISCLOSURE OF AN IMPACT ASSESSMENT PURSUANT TO PARAGRAPH (A)
OF THIS SUBDIVISION DOES NOT CONSTITUTE A WAIVER OF ANY ATTORNEY-CLIENT
PRIVILEGE OR WORK-PRODUCT PROTECTION THAT MIGHT OTHERWISE EXIST WITH
RESPECT TO SUCH IMPACT ASSESSMENT AND ANY INFORMATION CONTAINED THEREIN.
(C) A TRADE SECRET, AS DEFINED BY SECTION 1839 OF TITLE 18 OF THE
UNITED STATES CODE, THAT IS CONTAINED IN AN IMPACT ASSESSMENT DISCLOSED
TO THE ATTORNEY GENERAL PURSUANT TO PARAGRAPH (A) OF THIS SUBDIVISION IS
EXEMPT FROM ARTICLE SIX OF THE PUBLIC OFFICERS LAW.
2. (A) THE ATTORNEY GENERAL SHALL PROVIDE WRITTEN NOTICE TO A DEPLOYER
OR DEVELOPER OF AN ALLEGED VIOLATION OF THIS ARTICLE AT LEAST FORTY-FIVE
DAYS PRIOR TO COMMENCING AN ENFORCEMENT ACTION.
(B) THE DEPLOYER OR DEVELOPER MAY CURE THE NOTICED VIOLATION WITHIN
FORTY-FIVE DAYS OF RECEIVING THE WRITTEN NOTICE REQUIRED BY PARAGRAPH
(A) OF THIS SUBDIVISION.
§ 757. COMPLIANCE. A DEPLOYER OR DEVELOPER THAT COMPLIES WITH THIS
ARTICLE SHALL BE DEEMED COMPLIANT WITH ANY LAW, REGULATION, RULE,
REQUIREMENT, OR STANDARD RELATED TO THE PERFORMANCE OF AN IMPACT ASSESS-
MENT, AUDIT, OR GOVERNANCE PROGRAM, OR THE EQUIVALENT THEREOF, OF AN
AUTOMATED EMPLOYMENT DECISION TOOL THAT IS ADOPTED, MAINTAINED, OR
ENFORCED BY A POLITICAL SUBDIVISION OF NEW YORK STATE.
§ 2. This act shall take effect immediately.