Business Analyst with AI evaluation skills

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs. **Role Overview** We are looking for a detail-oriented **Business Analyst** to support evaluation and annotation workflows focused on quality, accuracy, and structured reasoning. This role is ideal for someone who is comfortable working with digital tools, performing side-by-side evaluations, and providing clear, well-supported justifications based on fact-checking. ### What You’ll Do * Perform side-by-side (SxS) evaluations on GHD, comparing outputs and assessing quality, accuracy, and relevance. * Conduct fact-checking to validate information and identify inconsistencies or inaccuracies. * Provide detailed, well-structured justifications to support evaluation decisions. * Follow established evaluation guidelines and quality standards consistently. * Use browser-based tools and extensions to support analysis and review tasks. * Execute simple command-line instructions when required to support evaluation workflows. * Document findings clearly and communicate insights to stakeholders when needed. **Commitments Required: 6-8 hours per day with an overlap of 3 hours with PST.** **Employment type: Contractor assignment (no medical/paid leave)** Duration of contract: 2 months Location: Argentina, Brazil, Peru, Colombia, Chile, Mexico **Selection process: 60 min technical test (comparing AI outputs)** * Solid comfort using a computer in a professional setting. * Experience working with browser extensions and online tools. * Ability to run basic command-line commands (no advanced programming required). * Strong analytical and critical thinking skills. * High attention to detail and ability to justify decisions clearly and objectively. * Comfortable working with evaluation frameworks, comparisons, and structured analysis. * Previous experience with evaluation, annotation, QA, or audit-type work. * Familiarity with data quality, content evaluation, or model/output assessments. * Good written communication skills in English. * Work in a fully remote environment. * Opportunity to work on cutting-edge AI projects with leading Tech companies.