JD

Responsibilities:

• Design and Development: Design, develop, and maintain Hadoop applications, including data ingestion, processing, and storage.
• Data Processing: Develop and optimize Hadoop MapReduce jobs, Hive queries, and Pig scripts for data processing and analysis.
• Data Management: Manage and maintain Hadoop clusters, including configuration, monitoring, and troubleshooting.
• Collaboration: Work with cross-functional teams to identify and prioritize project requirements, provide technical guidance, and ensure data quality.
• Innovation: Stay up to date with industry trends, new technologies, and best practices in big data and Hadoop.

Required Skills:

• Hadoop Ecosystem: In-depth knowledge of Hadoop, HDFS, MapReduce, Hive, Pig, HBase, and Spark.
• Programming: Strong programming skills in Java, Python, or Scala.
• Big Data Technologies: Experience with big data techn...