Free cookie consent management tool by TermsFeed Data Architect- AWS-Big Data | Antal Tech Jobs
Back to Jobs
2 Weeks ago

Data Architect- AWS-Big Data

decor
Information Technology
Full-Time
InfoCepts

Overview

Position: Data Architect- AWS-Big Data


Purpose of the Position:

As a Data Architect, you will be responsible for designing and optimizing complex Big Data solutions using AWS services, ensuring a balance between cost and performance. Responsibilities include assessing existing technology, performing impact assessments, optimizing designs, and documenting projects. The role involves effective communication of architectural decisions, conducting Proof-of-Concepts and design solutions, suggesting automation and providing expert advice.


Location: Nagpur/Pune/Chennai/Bangalore


Type of Employment: Full-time


Key Result Areas and Activities:

  • Technology Assessment and Impact Analysis: Evaluate existing technology and data integration frameworks, and conduct impact assessments based on requirements.
  • Big Data Use Case Design: Create complex Big Data use cases using AWS services, focusing on cost, performance, and durability.
  • Optimization and Performance: Recommend optimizations to balance cost and performance in existing designs.
  • Architectural Communication and Proof-of-Concepts: Communicate architectural decisions to stakeholders, conduct Proof-of-Concepts, document findings, and lead design reviews.
  • Process Improvement and Automation: Implement automation to improve processes and enhance team productivity, while providing expert advice, troubleshooting, and support for client proposals.

Essential Skills:

  • Experience of AWS services (S3,EC2, EMR, Athena, AWS Glue, Lambda) and AWS VPC, subnets, security groups, and route tables
  • Expertise in MPP databases (AWS Redshift, Snowflake, SingleStore) and Data Warehousing concepts
  • Proficient in Big Data technologies, specifically Apache Spark, and table formats like Delta Lake or Apache Iceberg
  • Strong programming skills in Scala and Python, along with SQL proficiency and experience with orchestration tools like Apache Airflow
  • Skilled in developing ETL workflows with complex transformations (SCD, deduplication, aggregation)
  • Proficient in operating systems, including Linux and Windows

Desirable Skills:

  • Prior experience working in a large media company would be an added advantage. Knowledge of Data Fabric and Data Mesh concepts
  • Programming Language: Java, Bash
  • Cloud Databases: AWS Aurora

Qualifications:

  • Bachelor's degree in computer science, engineering, or related field (Master's degree is a plus)
  • Demonstrated continued learning through one or more technical certifications or related methods
  • 9 years of IT experience with minimum 5 years of experience on cloud-related projects

Qualities:

  • Hold strong technical knowledge and experience with the capability to deep dive and research in various technical fields
  • Self-motivated and focused on delivering outcomes for a fast-growing team and organization
  • Able to communicate persuasively through written, verbal and client presentations
  • Effective and self-organized in cross-functional team and across different time zones
Location

India

Years Of Exp

9 to 12 years

Share job
Similar Jobs
View All
1 Day ago
TrueFan - Senior Machine Learning Engineer
Information Technology
  • Thiruvananthapuram, Kerala, India
About UsTrueFan is at the forefront of AI-driven content generation, leveraging cutting-edge generative models to build next-generation products. Our mission is to redefine content generation space through advanced AI technologies, including deep ge...
decor
1 Day ago
Salesforce commerce cloud consultant
Information Technology
  • Thiruvananthapuram, Kerala, India
Salesforce Commerce Cloud consultant  5+ Years of Experience 6 to 12 months Mode - Remote 1.1LPM - 1.2LPM Max Key Responsibilities Translate business requirements into scalable Salesforce Service Cloud solutions, in collaboration with CAE's technic...
decor
1 Day ago
Cloud Infrastructure Engineer
Information Technology
  • Thiruvananthapuram, Kerala, India
DescriptionInvent the future with us. Recognized by Fast Company’s 2023 100 Best Workplaces for Innovators List, Ampere is a semiconductor design company for a new era, leading the future of computing with an innovative approach to CPU design focuse...
decor
1 Day ago
Devops Engineer- Intermetiate
Information Technology
  • Thiruvananthapuram, Kerala, India
BackJD: Dev ops Engineer:As a DevOps Specialist- should be able to take ownership of the entire DevOps process, including Automated CI/CD pipelines and deployment to production.They should also be comfortable with risk analysis and prioritization.Le...
decor
1 Day ago
Sr Data Scientist (London)
Information Technology
  • Thiruvananthapuram, Kerala, India
AryaXAI stands at the forefront of AI innovation, revolutionizing AI for mission-critical, highly regulated industries by building explainable, safe, and aligned systems that scale responsibly. Our mission is to create AI tools that empower research...
decor
1 Day ago
Software Test Engineer
Information Technology
  • Thiruvananthapuram, Kerala, India
By clicking the “Apply” button, I understand that my employment application process with Takeda will commence and that the information I provide in my application will be processed in line with Takeda’s Privacy Notice and Terms of Use. I further att...
decor
1 Day ago
Software Developer 5 (Java Fullstack)
Information Technology
  • Thiruvananthapuram, Kerala, India
Job DescriptionBuilding off our Cloud momentum, Oracle has formed a new organization - Oracle Health Applications & Infrastructure. This team focuses on product development and product strategy for Oracle Health, while building out a complete platfo...
decor
1 Day ago
Java Developer - Spring Frameworks
Information Technology
  • Thiruvananthapuram, Kerala, India
Java DescriptionWe are looking for a passionate and talented Java Developer with 2-3 years of hands-on experience to join our growing development team.The ideal candidate should have a strong foundation in Java technologies and the ability to develo...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media