America's Job Portal
Position Description:
We are Canada's largest independent information technology services firm, and after 45 years, we're still growing! Join Canada's largest IT Company as a Java Developer in our Banking Services Division.
This is a hybrid role requiring on-site presence at the client office a minimum of 4 days per week (subject to change).
Your future duties and responsibilities:
β’ Design, develop, and maintain scalable ETL/data pipelines using Apache Spark.
β’ Process large structured and unstructured datasets across distributed systems.
β’ Build real-time and batch processing solutions (Spark Streaming/Structured Streaming).
β’ Work with big data technologies including Hadoop, Hive, HBase, and Kafka.
β’ Optimize Spark jobs for performance, scalability, and resource utilization.
β’ Design data models and manage distributed storage (HDFS, S3, Azure Blob).
β’ Implement monitoring, logging, and production support...