Data Architect - Big Data Platform

Overview

Data Architect

Location : Bangalore/Coimbatore (WFO)

Job Type : Permanent

Experience : 8 Years and above

Experience

• 6+ years of experience in data engineering, data warehousing, or big data platforms.
• Proven experience in AWS cloud ecosystem (S3, Glue, EMR, Lambda, Redshift, Athena).
• Strong hands-on expertise with Apache Spark (Core, SQL, Streaming) and PySpark.
• Practical knowledge of Databricks for collaborative data engineering and ML workflows.
• Proficiency in Snowflake for data warehousing and analytics use cases.
• Strong programming skills in Python and SQL.
• Expertise in data modeling, ETL/ELT pipeline design, and data warehousing concepts.
• Experience with distributed and real-time processing frameworks like Flink
• Exposure to at least one BI tool (Tableau, Power BI, or QuickSight)
• Domain understanding in BFSI/ Fintech (preferred)
• Preferred experience in working with either Snowflake or Databricks
• Prior experience in designing and implementing at least 2+ large-scale production data migration or modernization projects
  
  

• Design and architect scalable, secure, and performant big data solutions using AWS, Snowflake, or Databricks
• Strong understanding of performance tuning, cost optimization, and pipeline monitoring for reliable production workloads.
• Partner with business leaders, product managers, and clients to translate business objectives into technical data solutions
• Establish and enforce coding standards, architecture guidelines, and design patterns across projects
• Lead and mentor a team of data engineers and analysts, promoting best practices in data design and engineering
• Conduct code and architecture reviews, ensuring high-quality deliverables and adherence to technical standards.
• Collaborate with cross-functional teams to ensure seamless data delivery and alignment with business goals
  
  

• Technologies : AWS, Snowflake, Databricks, Spark, Python, SQL, Airflow, Kafka
• Frameworks : Spark Core, Spark SQL, Spark Streaming/Flink
• Soft Skills : Leadership, stakeholder management, Team Management, communication, problem-solving, decision-making
  
  

(ref:hirist.tech)