Net2Source Inc. is an award-winning total workforce solutions company recognized by Staffing Industry Analysts for our accelerated growth of 300% in the last 3 years with over 5500+ employees globally, with over 30+ locations in the US and global operations in 32 countries. We believe in providing staffing solutions to address the current talent gap – Right Talent – Right Time – Right Place – Right Price and acting as a Career Coach to our consultants.
Position: Lead Big Data Engineer (Airflow, Python & Kafka)
Location: Vancouver, BC, Canada (Onsite)
Full Time Hire / Permanent
HM Update: We are looking for someone coming from a Data Engineering background, with strong experience in Airflow and Python. They should be well versed in Kafka or any other data orchestration tool. Experience in design architecture and big data platform would be required.
Job Description:
As a Big Data Engineer create and maintain the architecture and systems using distributed computing frameworks. Design and build integrations between internal systems to support planning, forecasting, and scenario modelling. Operationalize ML models for demand forecasting, inventory optimization, and supply chain analytics. Develop intuitive tools for planners and business users to interact with forecasts, adjust plans, and simulate outcomes. Establish and maintain CI/CD pipelines using Gitlab to automate testing, deployment, and monitoring. Drive agile product development, working closely with Product, UX, and Planning teams to deliver high-impact features. Mentor engineers and promote best practices in architecture, testing, and DevOps.
Champion strong engineering practices, including:
Test-driven development (TDD)
Code reviews and pair programming
Scalable architecture and modular design
Observability, logging, and performance monitoring
Key Responsibilities:
8+ years of experience in software engineering, with 2+ years in technical leadership role.
Strong full stack development skills with modern frameworks (React, Next.js, Node.js) are preferred.
Experience with Python (Pytest), Pandas, or ML libraries (e.g., Prophet, XGBoost, TensorFlow).
Experience with streaming frameworks such as Kafka
Knowledge of SQL, ETL, Data-warehousing and data-modelling techniques
Experience with Snowflake, Airflow, Postgres, or similar cloud offerings.
Proven experience implementing and managing CI/CD pipelines and automated testing frameworks.
Strong understanding of cloud infrastructure (AWS, GCP, or Azure).
Excellent communication and cross-functional collaboration skills.
Anaplan model building experience is a plus.
Why work with us - At Net2Source, we believe everyone has an opportunity to lead. We see the importance of your perspective and your ability to create value. We want you to fit in—with an inclusive culture, focus on work-life fit and well-being, and a supportive, connected environment; but we also want you to stand out—with opportunities to have a strategic impact, innovate, and take necessary steps to make your mark. We help clients with new skilling, talent strategy, leadership development, employee experience, transformational change management and beyond.
Equal Employment Opportunity Statement:
Net2Source is an Equal Opportunity Employer. We believe that no one should be discriminated against because of their differences, such as age, disability, ethnicity, gender, gender identity and expression, religion or sexual orientation. Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law.
Awards and Accolades:
- America's Most Honored Businesses (Top 10%)
- Awarded by USPAAC for Fastest Growing Business in the US
- 12th Fastest Growing Staffing Company in USA by Staffing industry Analysts in the US (2020, 2019, 2020)
- Fastest 50 by NJ Biz (2020, 2019, 2020)
- INC 5000 Fastest growing for 8 consecutive years in a row (only 1.26% companies make it to this list)
- Top 100 by Dallas Business Journal (2020 and 2019)
- Proven Supplier of the Year by Workforce Logiq (2020 and 2019)
- 2019 Spirit of Alliance Award by Agile1
- 2018 Best of the Best Platinum Award by Agile1
- 2018 TechServe Alliance Excellence Awards Winner
- 2017 Best of the Best Gold Award by Agile1(Act1 Group)
Thanks & Regards
Abhishek Kumar
Sr. Technical Recruiter
201-365-4885