Spark with Scala or Java Developer and Lead (NCS/Job/ 733)

For A Reputed Large Multinational Technology Company

4 - 10 Years

Full Time

Up to 30 Days

Up to 30 LPA

1 Position(s)

Chennai, Pune, Greater Noida

No longer accepting applications

Discover more job opportunities that match your interests.

Job Skills

B2 Band – 4yrs to 6yrs

B3 Band – 7yrs to 10yrs

Good to have experience on Snowflake, AWS - Data platform Cloud experience

Overall 5+ Years of IT experience and 2+ Years of relevant experience with Big Data Technologies (such as – Spark Scala, Hadoop, Hive, HBase, Python, Kafka)
Hands on experience in Basic & Advance Java
Hands on experience in Apache Spark – Scala and deep understanding of distributed systems
Hands on experience in Core Spark API and Spark Streaming APIs
Relevant experience with handling different file formats – JSON, Avro, Parquet, CSV, XML, Text files
Experience working with HDFS, Hive, S3, Mongo DB and SQL database integration
Hands on experience in creating Scala/Spark Jobs for data transformation & aggregation
Sound exposure to ETL pipelines implementation, batch scheduling and automation
Proficient in writing hive queries and understand hive internals
Have good work exposure with Data integration/Data acquisition framework or similar kind of framework
Strong understanding of big data concepts and distributed computing
Experience with source control management like git , bitbucket
Familiar with all phases of development life cycle and agile development methodologies
Excellent problem-solving skills and attention to details
Strong communication and collaboration skills
Strong exposure to Unix commands and Unix shell scripting
Strong exposure to Oracle/SQL database
Must be able to code, and assist of other team members

B2 Band – 4yrs to 6yrs

B3 Band – 7yrs to 10yrs

- Design, code, test, document and implement application release projects as part of development team.

- Experience in programming/debugging used in business applications.

- Work with BA and understand all functional and technical requirements of the project.

- Spark 2.0 and above. Java 8 and above.

- Scala / Python, Hive / Oracle, Unix Shell Scripting.

- Agile methodologies

- Spring Boot and Rest API