Azure Data Factory (Data engineer) (NCS/Job/ 311)

Azure Data Factory

Responsibilities:

• Designing, building, and maintaining data processing systems using Azure Data Factory
• Creating and maintaining data pipeline architecture
• Building infrastructure for optimal extraction, transformation, and loading (ETL) of data from various sources using SQL and Azure technologies
• Collaborating with stakeholders, including executive, product, data, and design teams, to assist with data-related technical issues and support their data infrastructure needs
• Monitoring data pipelines and resolving any issues that arise
• Performing data quality checks and validating the accuracy of data transformations
• Maintaining the security and compliance of data processes according to relevant regulations
• Optimizing data pipelines for performance and cost efficiency
• Staying up-to-date with the latest Azure Data Factory updates and features
• Documenting the design and operation of data pipelines for future reference and troubleshooting
• Training other team members on the use of Azure Data Factory

Requirements:

• Bachelor's degree in Computer Science, Information Technology, or a related field
• 4+ years of experience in data engineering or similar roles
• Proficiency with Microsoft Azure Data Factory and other Azure services
• Strong understanding of data warehousing concepts
• Experience with big data tools and frameworks (e.g., Hadoop, Spark)
• Excellent analytical and problem-solving skills