Python/Scala/PySpark Data Engineer(Ign Job/ 36)
For Offers Technology Consulting And Digital Solutions Globally.
4 - 8 Years
Full Time
Up to 30 Days
Up to 20 LPA
2 Position(s)
Bangalore / Bengaluru
4 - 8 Years
Full Time
Up to 30 Days
Up to 20 LPA
2 Position(s)
Bangalore / Bengaluru
Posted By : Ignitivesearch Consulting Private limited
Job Skills
Pyspark - SqlJob Description
- 4+ years of experience in Data Warehouse project / ETL / Data Engineering
- Clear concept of dimensional data modelling(Logical), SCDs, Normalisation and denormalizations.
- Thoroughly translating the logical models to physical and data flows per the business requirements.
- Update and optimise the local and metadata models.
- Could evaluate the implemented data system for the variances, discrepancies and efficiencies
- Troubleshoot and optimise the existing data flows, models and processing jobs by modularising.
- Explore ways to enhance the data quality and reliability.
- Strong in writing UDF
- Previous knowledge of implementing the DQ framework on Spark would be an added advantage.
- Good in writing programming using Python/Scala/PySpark is a must.
- Strong knowledge of spark framework.
Matching Jobs
Software Tester
For Engineering Services, Design Led Manufacturing, Networks.
Bangalore / Bengaluru
6 - 8 Years ( Full Time )
%202.acdadb8c.png&w=32&q=75){kind=small}
Automation Testing, C#, Ci/Cd & Git, Cucumber, Jmeter, Python, Selenium
Not disclosed
Machine Learning Engineer
For It Services And Consulting
Bangalore / Bengaluru, Gurgaon / Gurugram
3 - 6 Years ( Full Time )
Airflow, Python
Not disclosed
ETL Testing
For It Service And Consulting
Bangalore / Bengaluru, Bengaluru
3 - 6 Years ( Full Time )
Azure Databricks, Ci/Cd, Data Warehousing, Etl, Git, Pyspark, Python, Sql
Not disclosed