Overview
As a Data Engineer - DataOps, you are responsible for creating and maintaining software development lifecycle activities pertaining to the business applications. You will design, code, test, debug, and document existing and new enhancements.
Responsibilities:
- Partner with data engineering, and business teams to set KPIs, SLAs, and SLIs for the quality and availability of data.
- Validate the data pipeline executions to ensure that they are completed within the SLA’s.
- Troubleshoot issues related to data pipelines, data integrations, bug fixes, performance bottlenecks.
- Work with multiple cross functional teams like Data Engineering, Business Analytics, IT and Vendor Support to resolve any incidents / problems.
- Continuously monitor and alert for any anomalies in the data.
- Implement role-based security, including AD integration, security policies, and auditing across the data platform environment.
- Test data to make sure it matches business logic and meets basic operational thresholds.
- Work with Data Scientists to support the AI / ML model development environments and operationalization of the models.
- Closely monitor and optimize the data platform infrastructure cost.
- On-call support for P1 issues on weekends / holidays on rotation basis.
- A desire to work in a collaborative, intellectually curious environment.
Qualifications:
- A bachelor's degree in computer science or equivalent
- 5+ years of experience as a Data Engineer,
- Experience with Azure big data tools: Azure Databricks, Azure Synapse, HDInsight, ADLS
- Experience with relational SQL and NoSQL databases.
- Excellent problem solving and analytic skills associated with working on structured and unstructured datasets using Azure bigdata tools.
- Experience with data pipeline and workflow management tools: ADF and Logic Apps
- Experience with Azure cloud services: VM, Azure Databricks, Azure SQL DB, Azure Synapse
- Experience with stream-processing systems: Azure Streams
- Experience with scripting languages Python. and have strong knowledge in developing Python notebooks.
At Wesco, we build, connect, power and protect the world. As a leading provider of business-to-business distribution, logistics services and supply chain solutions, we create a world that you can depend on.
Our Company’s greatest asset is our people. Wesco is committed to fostering a workplace where every individual is respected, valued, and empowered to succeed. We promote a culture that is grounded in teamwork and respect. With a workforce of over 20,000 people worldwide, we embrace the unique perspectives each person brings. Through comprehensive benefits and active community engagement, we create an environment where every team member has the opportunity to thrive.
Learn more about Working at Wesco here and apply online today!
Founded in 1922 and headquartered in Pittsburgh, Wesco is a publicly traded (NYSE: WCC) FORTUNE 500® company.
Wesco International, Inc., including its subsidiaries and affiliates (“Wesco”) provides equal employment opportunities to all employees and applicants for employment. Employment decisions are made without regard to race, religion, color, national or ethnic origin, sex, sexual orientation, gender identity or expression, age, disability, or other characteristics protected by law. US applicants only, we are an Equal Opportunity Employer.
Los Angeles Unincorporated County Candidates Only: Qualified applicants with arrest or conviction records will be considered for employment in accordance with the Los Angeles County Fair Chance Ordinance and the California Fair Chance Act.
Similar Jobs
View All
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in