Pyspark+ PowerBi developer(NCS/Job/ 1025)

Data Engineering (PySpark):

• Design, develop, and optimize robust ETL pipelines using PySpark.

• Handle large volumes of structured and unstructured data.

• Implement data quality checks, deduplication, and validation logic.

• Integrate data from multiple sources like APIs, databases, cloud storages (Azure/AWS/GCP).

• Schedule and monitor Spark jobs using orchestration tools (ADF, Airflow, etc.).

Data Visualization (Power BI):

• Design and build Power BI dashboards and reports based on business requirements.

• Implement DAX expressions, calculated columns, and measures.

• Develop data models with star/snowflake schemas optimized for reporting.

• Publish and manage datasets and reports on Power BI Service and workspaces.

Collaboration:

• Work closely with Business Analysts, Data Scientists, and Product Teams to gather requirements.

• Translate data insights into business-relevant dashboards and reports.

• Provide ad-hoc analysis and insights for leadership decision-making.