Overview
Job Title: AWS Data Engineer – IoT Industry
Location: [Hyderabad]
Employment Type: Full-time
Experience Level: [Mid / Senior]
Department: Data Engineering / IoT Solutions
Job Summary:
We are seeking a skilled AWS Data Engineer to join our team focused on IoT data solutions. In this role, you will be responsible for designing, building, and maintaining scalable data pipelines and architectures in the AWS cloud ecosystem. Your work will directly support real-time and batch processing of data collected from IoT devices and sensors across multiple environments.
Key Responsibilities:
- Design and implement scalable ETL/ELT pipelines for ingesting, processing, and storing data from IoT devices.
- Build and maintain data lakes and data warehouses on AWS using services such as S3, Glue, Redshift, Athena, and Lake Formation.
- Work with real-time streaming data using services like Kinesis Data Streams, Kinesis Data Analytics, and Kafka.
- Optimize data storage and access patterns for both structured and unstructured data.
- Implement data quality, governance, and monitoring best practices.
- Collaborate with Data Scientists, IoT Engineers, and DevOps teams to ensure reliable data delivery and infrastructure automation.
- Ensure data security and compliance with industry standards.
- Design Step Functions state machines (or MWAA) that ingest & process data from IoT telemetry, manufacturing ERP/MES dumps,
field-service CRM exports, and finance CSVs/SaaS APIs.
- Trigger via EventBridge, manage retries, and alert through SNS/Slack.
- IoT Core MQTT rules Aurora Postgres for telemetry.
- AWS Glue jobs / AppFlow / Lambda to pull data from SAP, Oracle, Salesforce / Service Now, S3 uploads, etc.
- dbt + Python in CodeBuild to cleanse, dedupe, enrich, and unify data into Raw Silver Gold
- All pipelines deployed with CodePipeline + CDK, monitored in CloudWatch
Required Skills & Qualifications:
- Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
- 5–12 years of experience in data engineering, preferably in IoT or industrial domains.
- Proficient in AWS cloud services, including but not limited to S3, Glue, Lambda, Redshift, Athena, DynamoDB, and Kinesis.
- Strong programming skills in Python, Scala,
- Experience with SQL and NoSQL databases.
- Familiarity with data modeling, data warehousing, and big data tools (e.g., Apache Spark, Hive).
Ingestion :
1. AWS IoT Core (MQTT)
2. AWS Glue Jobs / Workflows for ERP/CSV
3. AWS AppFlow or custom Lambda for SaaS (Salesforce, Service Now)
Job Type: Full-time
Pay: ₹501,241.62 - ₹1,841,015.39 per year
Work Location: In person