Scala, Spark/pyspark • Primary skills:Domain->Finacle-Core-Functional->Finacle-Core-WMS->Grand Master,Technology->Big Data - Data Processing->Spark,Technology->Java->Apache Core Skills 5–9 years of experience in data engineering / big data development Strong hands-on expertise in Scala (mandatory for this role) Extensive experience with Apache Spark (Scala and/or PySpark) Solid understanding of ETL processes and data pipelines Strong proficiency in SQL and database concepts Technical Skills Deep knowledge of Spark architecture and execution model Experience with Spark performance tuning and optimization Strong data modeling and warehousing concepts Familiarity with version control tools (Git) Understanding of distributed computing principles Preferred Skills Experience with Spark Streaming / Kafka Hands-on with Databricks platform Knowledge of Airflow or workflow orchestration tools Familiarity with Docker/Kubernetes Exposure to NoSQL databases (Cassandra, MongoDB, HBase) Big Data & Sp...