Explore

AI Product Analyst

As an AI Product Analyst at August, you will be instrumental in enhancing our product's capabilities, focusing on analyzing and optimizing AI-driven features. This role combines analytical skills with a strong foundation in machine learning (ML) and natural language processing (NLP) to improve the user experience and functionality of our health AI solutions.

Responsibilities

Analyze user interactions and feedback to refine and optimize AI conversation quality.

Develop and set up analytics pipelines to systematically analyze usage patterns across cohorts to optimizing AI conversation quality for different use cases.

Collaborate closely with cross-functional teams, including engineering, product, and medical experts, to design, test, and deploy new product features.

Develop and maintain metrics to assess the effectiveness of NLP and ML implementations.

Provide insights and recommendations for the continuous improvement of AI models, including fine-tuning transformer-based models.

You might be a good fit if you have:

1+ years of experience in analyzing AI-driven products, particularly those involving large language models (LLMs), NLP and ML systems.

Proficiency in Python, SQL, and experience with data handling, efficient querying techniques, and familiarity with ClickHouse, similar platforms, and data tooling frameworks (e.g., Pandas, NumPy, TensorFlow, PyTorch, Hugging Face, MS Excel).

Demonstrated ability to set up and manage analytics pipelines and perform complex data analysis, with strong problem-solving and critical thinking skills.

Strong understanding of large language models (LLMs) and experience with their practical applications and fine-tuning.

A results-oriented approach, with a willingness to embrace flexibility and drive impactful changes.

The ability to adapt and pick up slack, even if it goes outside your job description.

Want to print your doc?
This is not the way.

Try clicking the ⋯ next to your doc name or using a keyboard shortcut (

CtrlP

) instead.