Chennai, Tamil Nadu, India
Information Technology
Full-Time
UST
Overview
Role Description
We are seeking a highly skilled and experienced SQL to Databricks Migration Specialist to join our team. The core responsibility of this role is to migrate SQL-based Crystal Reports to the Databricks platform while ensuring seamless integration and optimal performance. This role demands strong technical capabilities, problem-solving skills, and the ability to collaborate effectively with cross-functional teams.
Key Responsibilities
- Job Title: Software Engineering – Azure Data Engineer (Databricks) Experience: 8+ Years Location: Chennai / Mumbai / Gurgaon
- Must-Have Skills:
- Strong proficiency in SQL, PySpark, Databricks, ADLS Gen2, and Azure Data Factory (ADF)
- Working knowledge of Python
- Prior experience with SQL to Databricks migration
- Good understanding of Crystal Reports or similar reporting tools
- Experience working in an Azure cloud environment
We are seeking a highly skilled and experienced SQL to Databricks Migration Specialist to join our team. The core responsibility of this role is to migrate SQL-based Crystal Reports to the Databricks platform while ensuring seamless integration and optimal performance. This role demands strong technical capabilities, problem-solving skills, and the ability to collaborate effectively with cross-functional teams.
Key Responsibilities
- Analyze Existing Crystal Reports:
- Review current Crystal Reports utilizing SQL queries
- Identify underlying data sources, dependencies, and complexity
- Evaluate compatibility with Databricks
- Design Data Models on Databricks:
- Work with stakeholders to understand reporting requirements
- Translate SQL queries into optimized SparkSQL/PySpark code
- Design efficient, scalable data models using Delta Lake
- Migrate Reports to Databricks:
- Develop and implement migration strategies
- Rewrite/modify reports using Apache Spark APIs on Databricks
- Ensure data integrity and validation during migration
- Performance Optimization:
- Profile and optimize migrated reports for Databricks clusters
- Apply best practices (query tuning, caching, partitioning, etc.)
- Documentation & Training:
- Document all migration processes and resolutions
- Conduct training or prepare guides for end-users on using reports in Databricks
- Bachelor's degree in Computer Science or a related field (or equivalent experience)
- Strong SQL and experience with Apache Spark, SparkSQL, PySpark
- Moderate knowledge of Python
- Familiarity with Azure Databricks and cloud data tools
- Experience with Crystal Reports or other reporting platforms
- Strong analytical and communication skills
- Strong proficiency in SQL, PySpark, Databricks, ADLSGen2, and ADF
- Moderate knowledge in Python
Similar Jobs
View All
2 Hours ago
Data Analyst (Kannada Speakers)
AI & Machine Learning Advancement
- 1 - 20 Yrs
- Karnataka, India
For thousands of years, maps have provided humans with the knowledge they need to make decisions. As a Maps Evaluator, you will have the opportunity to provide ground truth for your town, city or country.
At Peroptyx, we are looking for Data Ana...
2 Hours ago
Data Analyst (Marathi Speakers)
AI & Machine Learning Advancement
- 1 - 20 Yrs
- India, Pune
For thousands of years, maps have provided humans with the knowledge they need to make decisions. As a Maps Evaluator, you will have the opportunity to provide ground truth for your town, city or country.
At Peroptyx, we are looking for Data...
2 Hours ago
Data Analyst (Telugu Speakers)
AI & Machine Learning Advancement
- 1 - 20 Yrs
- Andhra Pradesh, Telangana, India
For thousands of years, maps have provided humans with the knowledge they need to make decisions. As a Maps Evaluator, you will have the opportunity to provide ground truth for your town, city or country.
At Peroptyx, we are looking for Data Ana...
1 Day ago
Java Developer – Payments Domain
Information Technology
- 4 - 7 Yrs
- Mumbai (All Areas)
We are hiring Java Developers with 4–6 years of hands-on experience in backend development, particularly within the Payments or FinTech domain. The ideal candidate should possess a strong foundation in Java technologies and be capable of working in a...
1 Day ago
SAP Functional Architect
Information Technology
- 40,00,000 - 45,00,000 INR - Annual
- 12 - 15 Yrs
- Bangalore, Chennai
We are seeking an experienced SAP Pre-Sales Architect with a strong functional background and deep expertise in at least one SAP functional area. The ideal candidate will have extensive knowledge of cross-module integrations and a proven track record...
1 Day ago
Senior React Native Developer
Information Technology
- 7 - 12 Yrs
- Jaipur
The NineHertz is on the lookout for a Senior React Native Developer who is passionate about mobile app development and thrives in a fast-paced environment. This is a fantastic opportunity to work with a dynamic team, drive innovation, and help delive...
1 Day ago
Senior Data & AI Analytics Engineer (Remote)
AI & Machine Learning Advancement
- 18,00,000 - 24,00,000 INR - Annual
- 5 - 8 Yrs
- Pune
Job Ref: NT-DAAI-003
Experience: 5–8 years
Client: A prestigious AI-first tech company
Notice: Early joiners preferred (Immediate- 30 days)
We are hiring on behalf of a prestigious AI-first technology client for a Senior Data & AI Analytics En...
1 Day ago
AI Engineering Manager (Remote)
Information Technology
- 40,00,000 - 50,00,000 INR - Annual
- 10 - 15 Yrs
- Pune
Experience: 10 to 15 years
Location: Remote
Notice Period: Immediate to 30 days preferred
Client: Leading mid-sized firm specializing in AI-driven solutions
Overview:
We are looking for an AI Engineering Manager to lead a dynamic team of ...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in