Data Analyst, AI

About the Role At Félix, we are building the future of remittances through a seamless, AI-powered WhatsApp experience. We’re looking for a Data Analyst for our AI Team, who is obsessed with making our chatbot & customer experience "insanely great." You won’t just be pulling data; you will be the guardian of our AI’s quality. You will work closely with Engineers and Product Managers to ensure our agents are accurate, helpful, and human-centric. We need a "natural investigator" who can dive into a dataset to understand why a model hallucinated or where the context was lost, turning those findings into a better product for millions of Latino immigrants. Responsibilities * AI Performance & Metrics: Design and maintain dashboards in PowerBI tools (Omni, a Looker-equivalent) to track the "health" of our AI agents, focusing on F1 scores, precision-recall tradeoffs, and intent recognition accuracy. * Quality Control (The "Anti-Hallucination" Task): Deep dive into conversation logs to identify, categorize, and quantify hallucinations or instances where the AI lost context. * Data Modeling for AI: Build and optimize SQL-based data models on our GCP (BigQuery, DBT, Firestore) infrastructure to evaluate model versions and prompt iterations. * Collaborative Experimentation: Partner with the AI Engineering team to analyze A/B tests on different LLM prompts and configurations, balancing the tradeoff between response speed and accuracy. * User-Obsessed Insights: Translate complex AI metrics into "human stories" for the rest of the team, explaining how technical tweaks improve the actual user experience on WhatsApp. * Automation: Proactively identify ways to automate the evaluation of conversational data to help us scale faster. Requirements Experience: 2-3+ years of experience as a Data Analyst, ideally within AI, NLP, or Product-focused teams. Proven 1-2+ years of experience measuring Chatbot/LLM metrics. You should be comfortable discussing F1 scores, confusion matrices, and the tradeoffs between model creativity and factual accuracy. Technical Core: Strong SQL skills (you’ll live in BigQuery / DBT / Firestore) and experience with BI tools like Omni / Tableau / PowerBI / Looker or similar. The "Felix" Vibe: A startup mindset—you are proactive, you have a bias towards action, and you don’t wait for permission to fix something that’s broken. Communication: Ability to explain to a non-technical stakeholder why a 1% drop in F1 score matters for our users and impact on other KPI’s. Language: Advanced English and Spanish (crucial for analyzing our users' regional nuances). Nice to have Experience with Python for data manipulation and analysis. Background working in GCP (BigQuery, Cloud Storage, etc.). Experience in a startup or high-growth environment. Familiarity with growth marketing metrics (acquisition funnels, retention cohorts, engagement KPIs).