Azure DevOps Engineer

Job Title: Azure DevOps Engineer

Experience: 3–8 Years

Location: Hyderabad (Work from Office)

About The Role

We are seeking an experienced Azure DevOps Engineer with strong expertise in data integration, pipeline design, and Azure services. The ideal candidate will have hands-on experience in designing, building, and maintaining scalable data solutions while ensuring security, performance, and compliance.

Core Technical Skills

Data Integration & ETL

Strong understanding of ETL/ELT concepts and methodologies.

Expertise in data pipeline design patterns, transformations, and mappings.

Experience with error handling, data validation, and performance optimization.

Azure Services

Storage: Blob Storage, Data Lake Gen2, SQL Database.

Compute: Azure SQL, Synapse Analytics, Databricks.

Integration: Logic Apps, Event Hubs, Service Bus.

Security: Key Vault, Azure AD authentication.

Programming & Scripting

SQL (T-SQL): Stored procedures, transformations.

PowerShell: Automation and resource management.

Python/C#: Custom activities, data processing.

JSON & Expressions: ARM templates, ADF expressions.

Data Formats & Protocols

Proficient in CSV, JSON, Parquet, Avro, ORC.

Database connectivity: SQL Server, Oracle, MySQL, PostgreSQL.

Experience with REST APIs, on-premises data gateway configuration.

Azure Data Factory (ADF) Skills

Pipeline Development: Copy, Data Flow, Lookup, ForEach, If Condition.

Triggers: Schedule, Tumbling Window, Event-based.

Use of parameters, variables, dynamic content, expressions.

Debugging & Monitoring: Pipeline monitoring, error handling, performance tuning.

Data Flows: Complex transformations, wrangling flows, schema drift handling.

Integration Runtime: Azure, self-hosted, SSIS runtime configurations.

Operational Skills

Monitoring, troubleshooting, and performance tuning.

Error diagnosis and cost optimization.

Security & Governance: RBAC, encryption, compliance (GDPR, HIPAA).

Data lineage and metadata management.

DevOps Integration

Version control: Git repositories.

CI/CD pipelines: Implementation and automation.

Environment promotion strategies.

ARM template deployment.

Business & Analytical Skills

Knowledge of data warehouse, Delta Lake, Lambda & Kappa architectures.

Star schema and dimensional modeling expertise.

Ability to analyze business requirements, data sources, and performance needs.

Strong communication skills for stakeholder management.