Qualifications:- +7 years of Product Management experience, preferably within the e-commerce sector.- Experience working and establishing credibility with cross-functional leaders.- Strong communication skills, both written and verbal.- Previous experience in AI/LLM model evaluation.- Deep knowledge of tracking real model performance metrics rather than UX-only metrics.- Ability to dig into the details without losing sight of the bigger picture.- Product management experience with a strong process orientation.-Engineering degree strongly preferred.
Responsibilities:- Design and implement evaluation frameworks for AI models, focusing on hallucination rate, latency, accuracy, and model consistency.- Develop evaluation tooling, dashboards, and automated benchmarks to measure AI model performance.- Own A/B testing for model selection and performance validation.- Collaborate closely with machine learning engineers on real-time model monitoring.- Embrace a process-focused approach, using clear workflows in Jira, Gantt charts, and effective engineering story management.- Ability to demonstrate how model evaluations have directly improved product outcomes.
About RYZ Labs:RYZ Labs is a startup studio built in 2021 by two lifelong entrepreneurs. The founders of RYZ have worked at some of the world's largest tech companies and some of the most iconic consumer brands. They have lived and worked in Argentina for many years and have decades of experience in Latam. What brought them together is the passion for the early phases of company creation and the idea of attracting the brightest talents in order to build industry-defining companies in a post-pandemic world.
Our teams are remote and distributed throughout the US and Latam. They use the latest cutting-edge technologies in cloud computing to create applications that are scalable and resilient. We aim to provide diverse product solutions for different industries, planning to build a large number of startups in the upcoming years.
At RYZ, you will find yourself working with autonomy and efficiency, owning every step of your development. We provide an environment of opportunities, learning, growth, expansion, and challenging projects. You will deepen your experience while sharing and learning from a team of great professionals and specialists.
Our values and what to expect:- Customer First Mentality - every decision we make should be made through the lens of the customer.- Bias for Action - urgency is critical, expect that the timeline to get something done is accelerated.- Ownership - step up if you see an opportunity to help, even if not your core responsibility. - Humility and Respect - be willing to learn, be vulnerable, and treat everyone who interacts with RYZ with respect.- Frugality - being frugal and cost-conscious helps us do more with less- Deliver Impact - get things done in the most efficient way. - Raise our Standards - always be looking to improve our processes, our team, and our expectations. The status quo is not good enough and never should be.
Reportar empleo
