Bangalore, Karnataka, India
Information Technology
Full-Time
Cognizant
Overview
Role: Data Engineer
Experience: 7 to 9 years
Skills: Databricks SQL, Databricks Delta Lake, Databricks Workflows, PySpark, Amazon S3, and Amazon Redshift
Responsibility
Experience: 7 to 9 years
Skills: Databricks SQL, Databricks Delta Lake, Databricks Workflows, PySpark, Amazon S3, and Amazon Redshift
Responsibility
- Design and implement data pipelines, ETL processes, and data storage solutions that support data-intensive applications(4+ Years)
- Develop, test, and maintain architectures such as databases and large-scale data processing systems using tools such as Spark, Databricks and SQL (4+ Years)
- Solid in Java/Python, Datastructure and Algorithms (4+)
- Experience designing and delivering Transactional, Warehouse, Analytical and Reporting Data Platforms leveraging modern cloud data technologies (3+ years)
- Experience in cloud development with the AWS platform (3+ years)
- Experience in an Agile/Scrum team environment (2+ years)
- Develop and maintain data pipelines using PySpark to ensure efficient data processing.
- Implement and manage data storage solutions using Amazon S3 and Amazon Redshift.
- Utilize Databricks SQL to perform complex data queries and generate actionable insights.
- Oversee the integration of Databricks Delta Lake for optimized data storage and retrieval.
- Design and automate workflows using Databricks Workflows to streamline data operations.
- Collaborate with cross-functional teams to understand data requirements and deliver solutions.
- Ensure data quality and integrity through rigorous testing and validation processes.
- Provide technical support and troubleshooting for data-related issues.
- Lead the development of data models and schemas to support business analytics.
- Conduct performance tuning and optimization of data processing tasks.
- Stay updated with the latest industry trends and technologies to enhance data solutions.
- Document all development processes and maintain comprehensive technical documentation.
- Mentor junior developers and provide guidance on best practices.
Similar Jobs
View All
1 Day ago
TrueFan - Senior Machine Learning Engineer
Information Technology
- Thiruvananthapuram, Kerala, India
About UsTrueFan is at the forefront of AI-driven content generation, leveraging cutting-edge generative models to build next-generation products. Our mission is to redefine content generation space through advanced AI technologies, including deep ge...
1 Day ago
Salesforce commerce cloud consultant
Information Technology
- Thiruvananthapuram, Kerala, India
Salesforce Commerce Cloud consultant 5+ Years of Experience 6 to 12 months Mode - Remote 1.1LPM - 1.2LPM Max Key Responsibilities Translate business requirements into scalable Salesforce Service Cloud solutions, in collaboration with CAE's technic...
1 Day ago
Cloud Infrastructure Engineer
Information Technology
- Thiruvananthapuram, Kerala, India
DescriptionInvent the future with us. Recognized by Fast Company’s 2023 100 Best Workplaces for Innovators List, Ampere is a semiconductor design company for a new era, leading the future of computing with an innovative approach to CPU design focuse...
1 Day ago
Devops Engineer- Intermetiate
Information Technology
- Thiruvananthapuram, Kerala, India
BackJD: Dev ops Engineer:As a DevOps Specialist- should be able to take ownership of the entire DevOps process, including Automated CI/CD pipelines and deployment to production.They should also be comfortable with risk analysis and prioritization.Le...
1 Day ago
Sr Data Scientist (London)
Information Technology
- Thiruvananthapuram, Kerala, India
AryaXAI stands at the forefront of AI innovation, revolutionizing AI for mission-critical, highly regulated industries by building explainable, safe, and aligned systems that scale responsibly. Our mission is to create AI tools that empower research...
1 Day ago
Software Test Engineer
Information Technology
- Thiruvananthapuram, Kerala, India
By clicking the “Apply” button, I understand that my employment application process with Takeda will commence and that the information I provide in my application will be processed in line with Takeda’s Privacy Notice and Terms of Use. I further att...
1 Day ago
Software Developer 5 (Java Fullstack)
Information Technology
- Thiruvananthapuram, Kerala, India
Job DescriptionBuilding off our Cloud momentum, Oracle has formed a new organization - Oracle Health Applications & Infrastructure. This team focuses on product development and product strategy for Oracle Health, while building out a complete platfo...
1 Day ago
Java Developer - Spring Frameworks
Information Technology
- Thiruvananthapuram, Kerala, India
Java DescriptionWe are looking for a passionate and talented Java Developer with 2-3 years of hands-on experience to join our growing development team.The ideal candidate should have a strong foundation in Java technologies and the ability to develo...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in