Bangalore, Karnataka, India
Information Technology
Full-Time
HealthEdge
Overview
Overview
Sr. Data Engineer
What will you do:
Sr. Data Engineer
What will you do:
- Build data pipe lines t o assemble large, complex sets of data that meet non-functional and functional business requirements
- Develop ETL s olutions using Python, Powershell , SQL, SSIS etc. to load and automate complex datasets in PDF, Excel, flat files, JSON, XML, EDI etc.
- Take the full ownership of end-to-end data processes on Azure Cloud environments
- Work closely with data architect, SMEs and other technology partners to develop & execute data architecture and product roadmap
- Collaborate with the backend developers independently to understand the legacy applications and implement the feature s in a new system.
- Troubleshoot issues and other operational bottlenecks to support continuous data delivery for various applications.
- Take initiatives to make changes and improvements, work on technical debt, new and complex challenges .
- Implement complex warehouse views, make database design decisions to support the UI need, optimize scripts to periodically refresh large volume datasets.
- Perform code reviews and coach team members
- Develop reports on data dictionary, server metadata, data files and implement the reporting tools as needed.
- Implement best practices for data updates and development, troubleshoot performance and other data related issues on multiple product applications.
- Keep current on big data and data visualization technology trends, evaluate, work on proof-of concept and make recommendations on cloud technologies.
- 7 + years of data engineering experience working in partnership with large data sets and cloud architecture
- Deep experience in building data pipelines using the ETL tools and paradigms and loading data to and from RDBMS such Postgres, SQL Server, Oracle or similar.
- Proficient in cloud services technologies such as Microsoft Fabric, Azure Data Factory, Data Lake, and other related technologies
- Proficient in using SSDT tools for building SQL server relational databases, databases in Azure SQL, Analysis Services data models, Integration Services packages and Reporting Services reports
- Solid experience building data solu tions with the programming language s such as Python, Powershell
- Advanced T-SQL and ETL automation experience
- Experience working with orchestration tools such as Airflow and building complex dependency workflows
- Self-motivated with the ability to work and learn new technology independently
- Great problem-solving capabilities, troubleshooting data issues and experience in stabilizing big data systems.
- Excellent communication and presentation skills
- Hands-on de e p experience with cloud data migration, and experience working with analytic platforms like Fabric, Databricks on the cloud
- Certification in one of the cloud platforms (AWS/GCP/Azure)
- Experience with real -time data streaming tools like Kafka, Kinesis or any similar tools.
- Experience with the US health care reimbursement-related terminology and data is a plus
Similar Jobs
View All
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in