Vadodara, Gujarat, India
Information Technology
Full-Time
Cloudesign
Overview
Role: Azure Data Engineer
Location: Bangalore (JP Nagar - Hybrid Model)
Exp: 7 - 9 Years
Education: B.E/B.Tech(CS/IS)
Location: Bangalore (JP Nagar - Hybrid Model)
Exp: 7 - 9 Years
Education: B.E/B.Tech(CS/IS)
- Overall, 7 to 9 years of experience in cloud data and analytics platforms such as AWS, Azure, or GCP
- Including 3+ years’ experience with Azure cloud Analytical tools is a must
- Including 5+ years of experience working with data & analytics concepts such as SQL, ETL, ELT, reporting and report building, data visualization, data lineage, data importing & exporting, and data warehousing
- Including 3+ years of experience working with general IT concepts such as integrations, encryption, authentication & authorization, batch processing, real-time processing, CI/CD, automation
- Advanced knowledge of cloud technologies and services, specifically around Azure Data Analytics tools
- Azure Functions (Compute)
- Azure Blob Storage (Storage)
- Azure Cosmos DB (Databases)
- Azure Synapse Analytics (Databases)
- Azure Data Factory (Analytics)
- Azure Synapse Serverless SQL Pools (Analytics)
- Azure Event Hubs (Analytics- Realtime data)
- Strong coding skills in languages such as
- SQL
- Python
- PySpark
- Experience in data streaming technologies such as Kafka or Azure Event Hubs
- Experience in handling unstructured streaming data is highly desired
- Knowledge of Business Intelligence Dimensional Modelling, Star Schemas, Slowly Changing Dimensions
- Broad understanding of data engineering methodologies and tools, including Data warehousing, DevOps/DataOps, Data ingestion, ELT/ETL and Data visualization tools
- Knowledge of database management systems, data modelling, and data warehousing best practices
- Experience in software development on a team using Agile methodology
- Knowledge of data governance and security practices
- Develop and implement strategies for processing and analysing large volumes of IoT data, ensuring scalability and performance.
- Design, develop, and maintain streaming and batch data pipelines in Azure cloud environment
- Participate in the planning and prioritization of development tasks, ensuring efficient use of resources and timely delivery of projects
- Collaborate with data analysts and data scientists to understand their data requirements and develop solutions to meet their needs.
- Optimize and tune data pipelines for performance and scalability.
- Develop and maintain monitoring and alerting solutions to ensure data quality and availability.
- Collaborate with our Platform team to ensure data analytics infrastructure is secure, reliable, and highly available.
- Continuously research and evaluate new tools and technologies to improve data processing and analytics capabilities.
- Conduct code reviews to ensure adherence to coding standards and best practices.
- Capture and document data lineage, metadata, and data dictionaries to ensure comprehensive data governance.
Similar Jobs
View All
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in