Job Location: Pune
Employment Type: Full-Time
Experience: 5-10 Year
Role Overview:
We are looking for a Senior Data Engineer to join our team and contribute to building high-performance, scalable data solutions that power seamless experiences for real estate professionals and customers. The ideal candidate has a strong background in Big Data, Java, and Cloud Technologies and thrives in fast-paced, agile environments. If you are passionate about designing efficient data pipelines and working with cutting-edge technologies like Apache Spark, Kafka, and AWS, we want to hear from you!
Key Responsibilities:
- Design, develop, and optimize scalable data pipelines and processing frameworks for high-volume datasets.
- Build and maintain real-time stream processing solutions using Apache Flink or Apache Spark with messaging platforms like Kafka/Pulsar.
- Develop ETL workflows and handle both structured and unstructured data processing at scale.
- Implement and manage NoSQL databases (e.g., MongoDB, DynamoDB) and SQL-based solutions (e.g., PostgreSQL, Athena).
- Work with AWS cloud services (Lambda, SNS, S3, Batch Jobs, Step Functions, EC2, ECR) to build robust data architectures.
- Collaborate with cross-functional teams to understand business requirements and design innovative data solutions.
- Follow Agile methodologies and contribute to sprint planning, code reviews, and deployment processes.
Skills & Experience Required:
- Experience in Apache Spark & Scala – building high-volume, low-latency data pipelines.(Min 5years)
- Experience in real-time stream processing (Apache Flink/Spark) with Kafka/Pulsar.(Min 5 years)
- Experience in data pipeline development, ETL, and big data processing.( Min 7 years)
- Experience in NoSQL databases (MongoDB, DynamoDB) and SQL-based systems (PostgreSQL, Athena). (Min 2 years)
- Hands-on experience with AWS services (Lambda, SNS, S3, Step Functions, EC2, etc.).(Min 2 years)
- Experience in Java development.(5+ years)
- Proficiency in Git/GitLab and working within an Agile framework.
- Strong problem-solving skills, excellent communication, and a proactive approach to challenges.
