Python Developer

Innovate is the brand face of INCORES Strategic Services LLP — short for Innovate Consultancy Resources. Ours is a multi-domain talent solutions partner offering HR, Technology, Staffing and Digital Marketing Services. We collaborate with leading consulting and implementation partners to deliver top-quality talent to major enterprises and organizations across India. We're a multidisciplinary consultancy delivering creative, digital, and strategic solutions to help businesses innovate, grow, and lead.

Job Description:

Python Developer – Spark, AWS Lambda (4–7 Years Experience)

Innovate is actively assisting one of our esteemed clients in hiring a detail-oriented and result-driven Python Developer - Spark, AWS Lambda. The selected candidate will play a critical role in ensuring the quality and reliability of applications by designing test strategies, writing test cases, and automating functional and regression tests.

Innovate is hiring an experienced Python Developer with expertise in Apache Spark and AWS Lambda for one of our prestigious IT clients. The ideal candidate should have strong backend development skills, large-scale data processing experience, and proven ability in building serverless applications on AWS.

This is a confidential requirement with a globally recognized IT services company. Full client details will be shared with shortlisted candidates.

Role Overview:

You will be responsible for developing and optimizing data processing workflows using PySpark, implementing serverless solutions with AWS Lambda, and integrating data pipelines within cloud environments. This role requires strong problem-solving skills, hands-on coding expertise, and familiarity with distributed computing.

Key Responsibilities:

• Develop and maintain scalable PySpark data processing pipelines.
• Design, build, and deploy AWS Lambda serverless applications.
• Work with AWS services such as API Gateway, S3, DynamoDB, CloudWatch, and IAM.
• Integrate Spark-based ETL jobs with AWS-based data systems.
• Optimize Spark jobs for performance and scalability.
• Write clean, reusable, and efficient Python code for data transformations and backend APIs.
• Collaborate with data engineers, architects, and DevOps teams to deliver end-to-end solutions.
• Participate in Agile ceremonies, code reviews, and technical design discussions.

Must-Have Skills:

• 4–7 years of professional experience in Python development.
• Strong experience in Apache Spark / PySpark for large-scale data processing.
• Hands-on experience in AWS Lambda application development.
• Knowledge of AWS services such as S3, API Gateway, CloudWatch, DynamoDB, and IAM.
• Solid understanding of ETL concepts and data processing best practices.
• Proficiency with SQL and working with both relational and NoSQL databases.
• Familiarity with Git, CI/CD pipelines, and Agile development methodologies.

Good to Have:

• Experience with Databricks or AWS Glue.
• Knowledge of infrastructure as code tools like Terraform or AWS CloudFormation.
• Exposure to data lake/lakehouse architecture.
• AWS Certification (Developer Associate, Data Analytics, or Solutions Architect).
• Knowledge of containerization (Docker, Kubernetes).

Engagement Details:

• Location: PAN India
• Notice Period: Immediate joiners preferred / up to 30 days
• Compensation: Best in market based on experience