What you'll do:

• Develop and optimize Spark applications to process large-scale data efficiently.
• Collaborate with cross-functional teams to design and implement data-driven solutions.
• Troubleshoot and resolve performance issues in Spark jobs.
• Stay up-to-date with the latest trends and advancements in Spark and Scala technologies.

What makes you a great fit:

• Proficient in data pipelines, Kafka, Kafka streams, connectors, etc.
• Strong experience with Apache Spark, Spark Streaming, and Spark SQL.
• Solid understanding of distributed computing and big data processing frameworks.
• Familiarity with Hadoop ecosystem components (HDFS, Hive, HBase) is a plus.