Chennai, Tamil Nadu, India
Information Technology
Full-Time
symplr
Overview
The objectives of a Data Engineer typically revolve around designing, implementing, and managing robust data architectures and infrastructures. The Data Engineer will play a key role in driving the organization's data strategy, ensuring the efficient flow and storage of data, and supporting data-driven decision-making processes.
Duties & Responsibilities
Duties & Responsibilities
- Data Model Design:
- Develop and maintain a scalable and efficient data models and schemas that support the storage, processing, and retrieval of data.
- Data Integration:
- Implement robust ELT (Extract, Load, Transform) processes to integrate data from various sources into a unified and consistent format.
- Ensure seamless data flow between different systems, databases, and applications.
- Data Quality:
- Implement data validation and cleansing processes to ensure the accuracy and reliability of data.
- Emerging Technologies:
- Stay abreast of emerging technologies and trends in the field of data engineering.
- Database Management:
- Manage and optimize database systems, including relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra).
- Performance Optimization:
- Identify and address performance bottlenecks in data processing and storage systems.
- Optimize queries, indexing strategies, and data partitioning for improved performance.
- Scalability and Reliability:
- Ensure that data systems are scalable to handle growing volumes of data.
- Implement redundancy and fault-tolerance measures to enhance data system reliability.
- Strong hands-on expertise with AWS services such as S3, Glue, Lambda, Athena, Redshift, Step Functions, Streaming tools like Apache Kafka \ Amazon Kinesis.
- Proficiency in Python, PySpark, experience with ELT and orchestration tools
- Strong hands-on expertise on Apache Hudi \ Apache Iceberg
- Strong hands-on expertise In SQL
- Experience using GitHub for version control and collaboration
- Develop, optimize, and maintain ELT processes for data integration.
- Strong communication skills to interface with technical and business stakeholders.
- Knowledge of cloud infrastructure automation (e.g., Terraform, CloudFormation).
- Experience with DevOps CICD pipelines and source code management.
- AWS Certification, experience in platform automation and monitoring frameworks.
- Bachelor’s degree (B.A.) from four-year college or university, or equivalent combination of education and experience.
- 7+ years of experience in data engineering or a related role
- Proficient in data modeling, ELT development, and database management.
- Experience with big data technologies and distributed computing frameworks
Similar Jobs
View All
1 Day ago
Java Developer
Information Technology
- Bangalore, Karnataka, India
Position: Java Developer Experience: 3+ yrsLocation: Baner, Pune Position Requirements BE/B.Tech or Similar (Technology/IT/Computer Science or related field). 3+ years relevant work experience designing and developing applications in high-paced env...
1 Day ago
Data Analyst - Senior Engineer
Information Technology
- Bangalore, Karnataka, India
Why Join Iris?Are you ready to do the best work of your career at one of India’s Top 25 Best Workplaces in IT industry? Do you want to grow in an award-winning culture that truly values your talent and ambitions?Join Iris Software — one of the faste...
1 Day ago
Software Developer- .Net C#
Information Technology
- Bangalore, Karnataka, India
Why Join Siemens?Siemens Energy is focused on helping customers navigate the worlds most pressing energy problems.As a world leader in developing and producing the most advanced engineering technologies, we improve lives and further human achievemen...
1 Day ago
Automation Tester
Information Technology
- Bangalore, Karnataka, India
We are seeking a skilled Automation Tester proficient in Java, Selenium WebDriver, and API testing. You will be responsible for developing and maintaining automation frameworks and scripts to improve testing efficiency and product quality. Key Respon...
1 Day ago
Power BI Technical Lead - Data Analytics
Information Technology
- Bangalore, Karnataka, India
DescriptionWe are seeking a highly skilled and experienced Power BI Tech Lead to drive the design, development, and deployment of business intelligence solutions. The ideal candidate will have deep expertise in Power BI, SQL, SSRS, and Report Builde...
1 Day ago
Field Network Engineer
Information Technology
- Bangalore, Karnataka, India
This job is provided by apna.co About Atria Convergence Technologies Ltd:ACT (Atria Convergence Technologies Ltd.) was born out of a vision to become the most admired in home entertainment, education, and interactive services provider in India. Toda...
1 Day ago
Data Scientist
Information Technology
- Bangalore, Karnataka, India
Job Description: We are seeking a highly motivated and enthusiastic Data Scientist withover 2-3 years of experience to join our dynamic team. The ideal candidate will have astrong background in AI/ML analytics and a passion for leveraging data to dr...
1 Day ago
Automation Test Engineer
Information Technology
- Bangalore, Karnataka, India
Key Responsibilities Design, develop, and maintain automated test cases using the Leapwork platform. Collaborate with QA, development, and product teams to understand testing requirements and develop comprehensive automation strategies. Analyze t...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in