If you have a Candidate Login already, but have forgotten your password please use the steps to reset your password. If you have forgotten your email login, please contact [email protected] subject Workday Candidate Login
When creating your Workday account and entering personal information like name, address, please do not use ALL CAPS.
Thank you!
NOTICE: For Privacy Policy please review here
Job Responsibilities
Welo Data is seeking a creative and analytical Prompt Engineer & Data Analyst
to join our team.
In this role, you will be instrumental in refining and evaluating large language models (LLMs).
You'll design prompts, create high-quality datasets, and perform rigorous analysis to directly
improve the functionality, accuracy, and safety of cutting-edge AI systems. Your expertise will
help us build smarter, more reliable, and more helpful technology.
Key Responsibilities
Prompt Engineering & Model Evaluation
- Design, test, and iteratively refine complex and creative prompts to enhance AI model
- capabilities in reasoning, instruction following, and contextual understanding.
- Conduct rigorous side-by-side (SxS) comparisons of AI-generated outputs, providing
- detailed rationales and quality ratings to identify the superior response.
- Develop "golden" datasets, ideal responses, and granular evaluation rubrics to
- serve as benchmarks for model training and performance analysis.
- Engineer adversarial prompts and red-team scenarios to systematically identify
- model vulnerabilities, biases, and safety gaps across various policies (e.g., Harassment,
- Hate Speech, Dangerous Content).
Data Curation & Analysis
- Create, annotate, and review diverse datasets across text, audio, and video formats to
- support model training and localization.
- Perform in-depth fact-checking and analysis to ensure model responses are accurate,
- relevant, and grounded in reliable sources.
- Establish and document style guides, content standards, and evaluation procedures
- to ensure consistency and quality across all projects.
- Analyze model outputs to identify trends, document error patterns, and categorize
- failures, providing actionable feedback to engineering teams.
Collaboration & Training
- Train, mentor, and guide other team members on prompt engineering best practices,
- evaluation methodologies, and quality standards.
- Collaborate with engineering and product teams to translate evaluation insights into
- actionable model improvements.
Multimodal AI Training
- For voice projects, script and perform dialogues portraying various personas (e.g.,
- customer, agent) and accents to generate realistic conversational data for AI voice
- agents.
- For video projects, author precise text prompts using professional video production
- terminology (e.g., shot angles, camera movements, lighting) to guide generative video
- models.
Qualifications
Additional Job Details:
- Bachelor's degree or equivalent experience in Linguistics, Computational Linguistics,
- Communications, Technical Writing, or a related analytical field.
- Native or near-native fluency in English with exceptional writing and editorial skills.
- Proven experience in a role involving AI data annotation, content quality review, search
- quality rating, or prompt engineering.
- A highly detail-oriented and analytical mindset, with the ability to deconstruct complex
- instructions and evaluate outputs with precision.
- Ability to interpret code, datasets, and system workflows at a conceptual level (no
- coding required).
- Ability to work independently and manage workflows effectively in a remote environment.
Nice to Have
- Multilingual proficiency in one or more languages in addition to English.
- Direct experience with generative AI tools for text, voice, or video.
- Background in QA testing, rubric design, or AI safety and ethics evaluation.
- Familiarity with data annotation platforms and model evaluation tools.