We are looking for a Data Engineer with significant experience (9+ years) in Python and Spark for a full-time onsite position, five days a week. This role is crucial for developing effective software solutions.
As a Data Engineer, you will utilize your Python and Pyspark skills to design software solutions and conduct data analysis. Your tasks will also include gathering data from HBase, performing transformations with Apache Spark, and creating back-end services and APIs for seamless data integration.
Key Responsibilities:
• Develop and maintain software solutions in Python
• Implement Pyspark programs for data analysis
• Gather data from HBase for business transformations
• Create back-end services and integrate databases
• Enhance application performance and security
Requirements:
• Minimum of 9 years in data engineering/development
• Expertise in Python, Spark, and Pyspark
• Experience with Apache Spark DataFrames and RDDs
• Knowledge of database...