Business Analyst: US Raters

About the role

This role is for one of our clients

We are looking for detail-oriented and analytical Business Analysts – US Raters to support a project focused on evaluating and comparing responses generated by multiple AI chatbots. The role involves reviewing chatbot outputs, assessing their quality against predefined criteria, conducting structured evaluations, and providing accurate, well-supported final judgments.

The ideal candidate will have at least three years of experience in business analysis or a related field, strong analytical and communication skills, and the ability to evaluate information objectively. This is a fully remote, short-term contract opportunity for candidates based in the United States who can commit to the required working hours and project schedule.

Job Details

Role: Business Analyst – US Raters

Experience: 3+ years

Location: United States only

Employment Type: Short-term contract

Contract Duration: 16 weeks

Compensation: USD 30 per hour

Start Date: Immediate

Work Mode: Fully remote

Availability: Full-time commitment of 8 hours per day

Time Zone Requirement: At least 4 hours of overlap with US Pacific Time (PST)

Work Schedule: Five working days per week, including weekends as required, with two weekdays off

Requirements

Key Responsibilities

Review, analyze, and compare responses generated by multiple AI chatbots.

Evaluate chatbot responses based on predefined criteria, including accuracy, relevance, completeness, clarity, consistency, and overall quality.

Gather, analyze, and document business requirements and translate them into clear evaluation guidelines.

Conduct structured assessments and provide objective, evidence-based judgments.

Analyze workflows, processes, and data to identify gaps, inconsistencies, and areas for improvement.

Prepare reports, summaries, and supporting documentation to communicate evaluation findings.

Collaborate with project managers and cross-functional teams to clarify requirements and resolve assessment-related questions.

Track task progress, quality metrics, and deliverables to ensure timely completion.

Identify recurring issues in chatbot responses and share actionable observations.

Maintain high standards of accuracy, consistency, confidentiality, and documentation throughout the project.

Required Qualifications and Skills

Bachelor's degree in Business Administration, Finance, Computer Science, or a related field.

At least 3 years of experience as a Business Analyst or in a similar analytical role.

Strong analytical thinking, problem-solving, and decision-making skills.

Excellent written and verbal communication skills.

Proficiency in Microsoft Excel, SQL, Power BI, Tableau, or similar analytical tools.

Experience with requirement gathering, process mapping, and business documentation.

Ability to work effectively with cross-functional teams and manage multiple priorities.

Strong attention to detail and the ability to make consistent, objective assessments.

Familiarity with Agile or Scrum methodologies is an advantage.

Ability to follow detailed instructions, meet deadlines, and work independently in a remote environment.

Engagement Benefits

Opportunity to contribute to projects focused on AI evaluation and chatbot response quality.

Fully remote work arrangement.

Exposure to structured AI assessment and quality assurance processes.

Opportunity to work on projects with broader business and technological applications.

Clearly defined contract duration, hourly compensation, and project expectations.

Important Engagement Details

This is a project-based contract with a duration of 16 weeks.

Assigned tasks will involve comparing responses from multiple chatbots and submitting a final assessment based on defined criteria.

Candidates must be available for 8 hours per day, five days per week.

A minimum of four hours of overlap with US Pacific Time is required.

The schedule may include weekend work, with two weekdays off each week.

Candidates must be based in the United States and comply with the applicable country-specific eligibility guidelines.

Consistent evaluation quality, adherence to project instructions, and timely task completion are essential.

Posting text as published by Weekday 1.

The evidence behind this listing

Workplace

Remote Employer field

Seniority

Not established

Employment type

Not established

Location as listed

United States

Pay and work authorization

Stated pay

Not stated

Visa sponsorship

Not stated

Security clearance

Not established

Citizenship

Not established