Pune, Maharashtra, India
Information Technology
Full-Time
S M Software Solutions Inc
Overview
Location: Hyderabad
Contract Duration: 6 Months
Experience Required: 8+ years (Overall), 5+ years (Relevant)
🔧 Primary Skills
Contract Duration: 6 Months
Experience Required: 8+ years (Overall), 5+ years (Relevant)
🔧 Primary Skills
- Python
- Spark (PySpark)
- SQL
- Delta Lake
- Strong understanding of Spark core: RDDs, DataFrames, DataSets, SparkSQL, Spark Streaming
- Proficient in Delta Lake features: time travel, schema evolution, data partitioning
- Experience designing and building data pipelines using Spark and Delta Lake
- Solid experience in Python/Scala/Java for Spark development
- Knowledge of data ingestion from files, APIs, and databases
- Familiarity with data validation and quality best practices
- Working knowledge of data warehouse concepts and data modeling
- Hands-on with Git for code versioning
- Exposure to CI/CD pipelines and containerization tools
- Nice to have: experience in ETL tools like DataStage, Prophecy, Informatica, or Ab Initio
Similar Jobs
View All
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in