This position will support the design and delivery of secure, scalable, and traceable data pipelines in Azure, with a focus on integrating and transforming sensitive, public-facing datasets. The candidate will build ingestion workflows and transformation logic to support reporting, analytics, and public transparency initiatives. This role requires experience with Azure-native tools, strong ETL/ELT capabilities, and a strong commitment to data quality, auditability, and responsible data use. The candidate will be working with an existing software development team in an Agile/Scrum environment.
Skill
Required / Desired
At least 3 years of experience building and maintaining ETL/ELT pipelines in enterprise environments using Azure-native tools. | Required | 3 | Years |
Hands-on expertise with Azure Data Factory, Dataflows, Synapse Pipelines, or similar orchestration tools. | Required | 3 | Years |
Proficiency in SQL, Python, or PySpark for transformation logic and data cleansing workflows. | Required | 3 | Years |
Experience with Delta Lake, Azure Data Lake Storage Gen2, JSON, and Parquet formats. | Required | 3 | Years |
Ability to build modular, reusable pipeline components using metadata-driven approaches and robust error handling. | Required | 3 | Years |
Familiarity with public data sources, government transparency datasets, and publishing workflows. | Required | 3 | Years |
Knowledge of data masking, PII handling, and encryption techniques to manage sensitive data responsibly. | Required | 3 | Years |
Experience with data quality frameworks, including automated validation, logging, and data reconciliation methods. | Required | 3 | Years |
Strong grasp of DevOps/DataOps practices, including versioning, testing, and CI/CD for data pipelines. | Required | 3 | Years |
Experience supporting data publishing for oversight, regulatory, or open data initiatives is highly desirable. | Required | 3 | Years |
Certifications such as DP-203 (Azure Data Engineer Associate) or Azure Solutions Architect are a plus. | Highly desired | 3 | Years |
...knowledge to build their own recruiting business. If you're ready for a dynamic, growth-oriented... ...Join Us? Collaborative Environment: Partner with top-performing recruiters and expand... ...'re looking to pivot into recruiting, we want to hear from you! Driven & Competitive:...
...**Job Responsibilities:** - Answer incoming phone calls and assist patients with check-in and check-out processes. - Collect copays... ...Optional training available for those interested in becoming a Research Assistant for ongoing clinical studies. - Enjoy the...
Job Title: Freelance Narrative Consultant & Game Writer (US Citizen)Location: Remote-US/ChinaJob Type: Freelance (Project-based)Hi, we are MerJoy, a game studio based in Chengdu. We are launching a new hybrid casual game primarily for millennial women in the U.S. It...
...guests and employees. Amazing people, creating wonder.The Role: We seek a talented and experienced Massage & Fitness Coach.Description Brief: The Wellness Coach is responsible for leading scheduled fitness classes, conducting Personal Training Sessions, and providing...
...- Vernon Hills Vernon Hills, IL This is a 6 Month Contract - NO C2C. Required Knowledge, Skills, and Abilities: (Companies ATS Questions): 1. Do you have SAP MFG- PI Experience 2. Must be a US Citizen or Green Card holder. (Please indicate which)3. Salary...