Data Ingestion Engineer (RARR Job 6408)

We are looking for a Data Ingestion Engineer to build and manage scalable data ingestion pipelines that extract, transform, and load data from XML and PDF sources into Microsoft Fabric EDW. The role focuses on enabling reliable, governed data pipelines to support enterprise analytics and reporting.

Primary Skill Set

• Microsoft Fabric Data Pipelines Lakehouse Notebooks
• PySpark Spark-based data processing
• XML parsing XPath schema mapping
• PDF data extraction toolslibraries
• Data ingestion and transformation frameworks
• Medallion architecture Bronze Silver Gold
• SQL and DeltaParquet data formats

Secondary Skills Good to Have

• Power BI integration and data consumption
• Azure Data Factory Synapse background
• Data quality and validation frameworks
• CICD and Gitbased deployments
• Data governance and documentation practices

Roles Responsibilities

• Develop pipelines to ingest data from XML and PDF sources
• Implement parsing and transformation logic to standard formats
• Load data into Fabric Lakehouse layers Bronze Silver Gold
• Build reusable ingestion frameworks and automate processing
• Handle incremental loads error handling and scheduling
• Collaborate with data architects BI teams and business users
• Maintain documentation for ingestion logic and data mappings