C
AI prompt and quality engineer
Actively Hiring
Full-time $105k - $147k Posted about 1 year ago
AI prompt and quality engineer
Global / Hong Kong / Kuala Lumpur / London / Penang / Singapore / Taipei
CMC /
Contractor /
Remote
Responsibilities
- Quality Monitoring: Conduct daily quality assurance on AI Chatbot responses through manual sampling and user feedback to assess accuracy, relevance, and naturalness.
- Issue Resolution: Detect response-quality issues promptly; document root causes, propose actionable improvements, and follow through to closure.
- Model Tuning: Collaborate with engineering teams to optimize AI models by participating in data annotation, parameter adjustment, and other enhancement tasks to boost performance and answer quality.
- Data Analysis: Collect and analyze user-conversation data to uncover user needs and pain points, providing data-driven insights for optimization.
- Process Improvement: Refine quality-control workflows to increase efficiency and ensure standardization of QA and tuning processes.
Requirements
1. Technical Skills
- Solid understanding of AI Chatbot mechanisms and quality-evaluation criteria.
- Basic data-analysis skills; proficient in SQL, Excel, and related tools.
- Foundational knowledge of Natural Language Processing (NLP) and Machine Learning.
2. Experience
- 2+ years of relevant experience; prior optimization experience with AI or conversational products is preferred.
- Experience with industry-leading AI Chatbot products is a strong plus.
3. Soft Skills
- Strong communication and collaboration abilities.
- Meticulous, patient, and adept at identifying and solving problems.
- Thrives in a fast-paced environment and demonstrates a strong learning aptitude.
Tags & Focus Areas
Ai Engineer Prompt Remote
About Coin Market Cap Ltd
Collect and organize product requirements on both the users' and business' side. Imitate and write new business requirements documents according to mature business requirements documents. Follow up problems and bugs that occur during the product launch and operation, imitate and write new bug report documents according to mature bug report documents. Assist with other operational matters. Have experience in writing Product operations SOP and be able to design SOP process rigorously.