Senior Consultant-Python Data Engineer

Summary

Position Summary

AI & Data

In this age of disruption, organizations need to navigate the future with confidence, embracing decision making with clear, data-driven choices that deliver enterprise value in a dynamic business environment.

The AI & Data team leverages the power of data, analytics, robotics, science and cognitive technologies to uncover hidden relationships from vast troves of data, generate insights, and inform decision-making. The offering portfolio helps clients transform their business by architecting organizational intelligence programs and differentiated strategies to win in their chosen markets.

AI & Data will work with our clients to:

• Implement large-scale data ecosystems including data management, governance and the integration of structured and unstructured data to generate insights leveraging cloud-based platforms
• Leverage automation, cognitive and science-based techniques to manage data, predict scenarios and prescribe actions
• Drive operational efficiency by maintaining their data ecosystems, sourcing analytics expertise and providing As-a-Service offerings for continuous insights and improvements.
  
  

Python Developer – Sr Consultant

Work you’ll do

Data Pipeline Development:

Design, develop, and optimize robust ETL pipelines using Python to ingest, cleanse, and transform data from various sources (e.g., APIs, databases, files).

• Data Transformation:
  
  

Implement complex data transformation logic to convert source data formats, structures, and values to meet target system specifications (e.g., schema mapping, data type conversions, business rule enforcement).

• Data Quality & Validation:
  
  

Apply validation rules, perform data profiling, and ensure high data quality through error handling, logging, and reconciliation processes.

• Collaboration:
  
  

Work closely with data architects, business analysts, and target system owners to understand requirements and ensure alignment of data outputs.

• Performance Optimization:
  
  

Tune Python scripts and data workflows for efficiency, scalability, and reliability, especially when handling large datasets.

• Documentation & Best Practices:
  
  

Maintain clear documentation of data flows, transformation logic, and pipeline configurations. Follow industry best practices for code quality, version control, and testing.

Required:

• - Technical Skills:
• - Advanced proficiency in Python (including libraries like pandas, numpy, pySpark, etc.)
• - Experience with ETL frameworks and tools (e.g., Apache Airflow, Luigi, Prefect)
• - Familiarity with relational and non-relational databases (SQL, NoSQL)
• - Understanding of data modeling and schema design
• - Experience with cloud data platforms (AWS, Azure, GCP) is a plus
• - Analytical & Problem-Solving:
• - Strong ability to analyze source and target data structures
• - Skill in identifying data quality issues and designing remediation steps
• - Communication & Collaboration:
• - Ability to translate business requirements into technical specifications
• - Comfortable working in cross-functional teams
• - Education & Experience:
• - Bachelor’s degree in Computer Science, Engineering, Mathematics, or related field
• 6 to 9+ years of experience in data engineering or similar roles
• Example Scenario
• Suppose a retail company is migrating its customer data from legacy systems to a new cloud-based CRM. The Python Data Engineer would:
• - Analyze source data formats and the CRM’s target schema
• - Write Python scripts to transform and map fields (e.g., splitting full names, normalizing addresses)
• - Validate transformed data against business rules (e.g., mandatory fields, unique constraints)
• - Automate the pipeline to run nightly, ensuring new data is always up-to-date in the CRM
• CSS3
  
  

Our purpose

Deloitte’s purpose is to make an impact that matters for our people, clients, and communities. At Deloitte, purpose is synonymous with how we work every day. It defines who we are. Our purpose comes through in our work with clients that enables impact and value in their organizations, as well as through our own investments, commitments, and actions across areas that help drive positive outcomes for our communities.

Our people and culture

Our inclusive culture empowers our people to be who they are, contribute their unique perspectives, and make a difference individually and collectively. It enables us to leverage different ideas and perspectives, and bring more creativity and innovation to help solve our clients' most complex challenges. This makes Deloitte one of the most rewarding places to work.

Professional development

At Deloitte, professionals have the opportunity to work with some of the best and discover what works best for them. Here, we prioritize professional growth, offering diverse learning and networking opportunities to help accelerate careers and enhance leadership skills. Our state-of-the-art DU: The Leadership Center in India, located in Hyderabad, represents a tangible symbol of our commitment to the holistic growth and development of our people. Explore DU: The Leadership Center in India .

Benefits To Help You Thrive

At Deloitte, we know that great people make a great organization. Our comprehensive rewards program helps us deliver a distinctly Deloitte experience that helps that empowers our professionals to thrive mentally, physically, and financially—and live their purpose. To support our professionals and their loved ones, we offer a broad range of benefits. Eligibility requirements may be based on role, tenure, type of employment and/ or other criteria. Learn more about what working at Deloitte can mean for you.

Recruiting tips

From developing a stand out resume to putting your best foot forward in the interview, we want you to feel prepared and confident as you explore opportunities at Deloitte. Check out recruiting tips from Deloitte recruiters.

Requisition code: 300058