Senior Applied AI Engineer (LLMs, Azure)
Actively Hiring
Full-time Posted 6 months ago
Responsibilities
- check_circle Design and optimize advanced prompts for document understanding and data extraction use cases
- check_circle Collaborate with business stakeholders to understand document structures, semantics and key-value relationships
- check_circle Create PoCs using Python to validate prompt effectiveness and iterate quickly
- check_circle Maintain a prompt library with a focus on quality, reusability and compliance with security and privacy guidelines
- check_circle Perform prompt validation, stress testing and failover scenario modeling for different LLMs
- check_circle Analyze LLM output quality, fine-tune prompts and propose model-specific prompt strategies
- check_circle Work with ML engineers on fine-tuning initiatives to improve model accuracy for specific document domains
- check_circle Document best practices, prompt strategies and experiment results in a structured format
- check_circle Identify and mitigate risks related to prompt injection, hallucination or other LLM-specific vulnerabilities
Basic qualifications
- Proven experience with at least 2 LLM production projects designing and deploying prompts in real-world applications
- Excellent understanding of prompt structure and contexts
- Proficiency in Python with experience in LLM APIs, prompt engineering frameworks and data manipulation tools such as Pandas
- Experience with at least one fine-tuning or retrieval-augmented generation (RAG) pipeline implementation
- Familiarity with prompt evaluation tools and metrics such as BLEU, ROUGE and semantic similarity, as well as human-in-the-loop validation
- Understanding of LLM-related security concerns including prompt injection, output filtering, API limitations and output structuring
- Excellent communication skills and ability to translate complex document requirements into actionable prompt logic
- Strong analytical mindset with attention to both high-level design and low-level output consistency
Preferred qualifications
- Experience with vector databases and retrieval-augmented generation
- Exposure to tools like LangChain, LlamaIndex or similar
- Prior work with OCR, NLP or intelligent document processing (IDP) pipelines
- We gather like-minded people: Engineering community of industry professionals Friendly team and enjoyable working environment Flexible schedule and opportunity to work remotely within Poland Chance to work abroad for up to 60 days annually Business-driven relocation opportunities
- Engineering community of industry professionals
- Friendly team and enjoyable working environment
- Flexible schedule and opportunity to work remotely within Poland
- Chance to work abroad for up to 60 days annually
- Business-driven relocation opportunities
- We provide growth opportunities: Outstanding career roadmap Leadership development, career advising, soft skills, and well-being programs Certification (GCP, Azure, AWS) Unlimited access to LinkedIn Learning, Get Abstract, Cloud Guru English classes
- Outstanding career roadmap
- Leadership development, career advising, soft skills, and well-being programs
- Certification (GCP, Azure, AWS)
- Unlimited access to LinkedIn Learning, Get Abstract, Cloud Guru
- English classes
- We cover it all: Stable income (Employment Contract or B2B) Participation in the Employee Stock Purchase Plan Benefits package (health insurance, multisport, shopping vouchers) Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and more Referral bonuses Corporate, social and well-being events
- Stable income (Employment Contract or B2B)
- Participation in the Employee Stock Purchase Plan
- Benefits package (health insurance, multisport, shopping vouchers)
- Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and more
- Referral bonuses
- Corporate, social and well-being events
- Please, note: The set of bonuses might vary based on the role you apply for – specifics will be discussed with our recruiter during the general interview. We will reach out to selected candidates exclusively.
- The set of bonuses might vary based on the role you apply for – specifics will be discussed with our recruiter during the general interview.
- We will reach out to selected candidates exclusively.
Tags & Focus Areas
Remote Ai Ai Engineer Generative Ai
About EPAM Systems
Shape the future of global data science infrastructure as a Site Reliability Engineer at EPAM. You'll architect, implement, and support cutting-edge platforms like Alteryx, Dataiku, and Azure Machine Learning that power critical business insights across wealth management, investment banking, and corporate functions.