Overview
Senior Data Engineer – Azure
This is a hands on data platform engineering role that places significant emphasis on consultative data engineering engagements with a wide range of customer stakeholders; Business Owners, Business Analytics, Data Engineering teams, Application Development, End Users and Management teams.
You Will:
Design and build resilient and efficient data pipelines for batch and real-time streaming
Architect and design data infrastructure on cloud using Infrastructure-as-Code tools.
Collaborate with product managers, software engineers, data analysts, and data scientists to build scalable and data-driven platforms and tools.
Provide technical product expertise, advise on deployment architectures, and handle in-depth technical questions around data infrastructure, PaaS services, design patterns and implementation approaches.
Collaborate with enterprise architects, data architects, ETL developers & engineers, data scientists, and information designers to lead the identification and definition of required data structures, formats, pipelines, metadata, and workload orchestration capabilities
Address aspects such as data privacy & security, data ingestion & processing, data storage & compute, analytical & operational consumption, data modeling, data virtualization, self-service data preparation & analytics, AI enablement, and API integrations.
Lead a team of engineers to deliver impactful results at scale.
Execute projects with an Agile mindset.
Build software frameworks to solve data problems at scale.
Technical Requirements:
7+ years of data engineering experience leading implementations of large-scale lakehouses on Databricks, Snowflake, or Synapse. Prior experience using DBT and PowerBI will be a plus.
3+ years' experience architecting solutions for developing data pipelines from structured, unstructured sources for batch and realtime workloads.
Extensive experience with Azure data services (Databricks, Synapse, ADF) and related azure infrastructure services like firewall, storage, key vault etc. is required.
Strong programming / scripting experience using SQL and python and Spark.
Strong Data Modeling, Data lakehouse concepts.
Knowledge of software configuration management environments and tools such as JIRA, Git, Jenkins, TFS, Shell, PowerShell, Bitbucket.
Experience with Agile development methods in data-oriented projects
Other Requirements:
Highly motivated self-starter and team player and demonstrated success in prior roles.
Track record of success working through technical challenges within enterprise organizations
Ability to prioritize deals, training, and initiatives through highly effective time management
Excellent problem solving, analytical, presentation, and whiteboarding skills
Track record of success dealing with ambiguity (internal and external) and working collaboratively with other departments and organizations to solve challenging problems
Strong knowledge of technology and industry trends that affect data analytics decisions for enterprise organizations
Certifications on Azure Data Engineering and related technologies.
"Remote postings are limited to candidates residing within the country specified in the posting location"
About Rackspace Technology
We are the multicloud solutions experts. We combine our expertise with the world’s leading technologies — across applications, data and security — to deliver end-to-end solutions. We have a proven record of advising customers based on their business challenges, designing solutions that scale, building and managing those solutions, and optimizing returns into the future. Named a best place to work, year after year according to Fortune, Forbes and Glassdoor, we attract and develop world-class talent. Join us on our mission to embrace technology, empower customers and deliver the future.
More on Rackspace Technology
Though we’re all different, Rackers thrive through our connection to a central goal: to be a valued member of a winning team on an inspiring mission. We bring our whole selves to work every day. And we embrace the notion that unique perspectives fuel innovation and enable us to best serve our customers and communities around the globe. We welcome you to apply today and want you to know that we are committed to offering equal employment opportunity without regard to age, color, disability, gender reassignment or identity or expression, genetic information, marital or civil partner status, pregnancy or maternity status, military or veteran status, nationality, ethnic or national origin, race, religion or belief, sexual orientation, or any legally protected characteristic. If you have a disability or special need that requires accommodation, please let us know.
Similar Jobs
View All
2 Hours ago
Data Analyst (Odia Speakers)
AI & Machine Learning Advancement
- 1 - 20 Yrs
- Jharkhand, Andhra Pradesh, Odisha
For thousands of years, maps have provided humans with the knowledge they need to make decisions. As a Maps Evaluator, you will have the opportunity to provide ground truth for your town, city or country.
At Peroptyx, we are looking for Data Ana...
2 Hours ago
Data Analyst (Kannada Speakers)
AI & Machine Learning Advancement
- 1 - 20 Yrs
- Karnataka, India
For thousands of years, maps have provided humans with the knowledge they need to make decisions. As a Maps Evaluator, you will have the opportunity to provide ground truth for your town, city or country.
At Peroptyx, we are looking for Data Ana...
4 Hours ago
Technical Lead - Backend Development - Node.Js
Finance & Banking
- 50,00,000 - 55,00,000 INR - Annual
- 6 - 8 Yrs
- Bangalore
What youʼll be doing
We are much more than our job descriptions, but here is where you will begin:
● Collaborate with stakeholders, including product owners, project managers, and scrum masters, to define and clarify project requirements.
● Transl...
5 Hours ago
Engineering Manager
Finance & Banking
- 55,00,000 - 60,00,000 INR - Annual
- 8 - 12 Yrs
- Bangalore
What youʼll be doing
Weʼre much more than our job descriptions, but hereʼs where youʼll begin:
● Lead and deliver large-scale platform and product initiatives that impact millions of users.
● Collaborate with product, design, and business teams to...
9 Hours ago
Technical Project Manager (WordPress)
Information Technology
- 6 - 10 Yrs
- Ahmedabad
Location: Ahmedabad / Remote
Experience: 6+ Years
About Us:
E2M Solutions is home to a growing remote team of WordPress experts building innovative digital solutions. We pride ourselves on delivering consistent value and excellence to our client...
9 Hours ago
Senior WordPress Frontend Developer
Information Technology
- 5 - 10 Yrs
- Ahmedabad
At E2M Solutions, we're building a powerhouse remote team to deliver high-performing, user-centric WordPress solutions. If you live and breathe frontend development and are looking to work on cutting-edge WordPress projects with a passionate global t...
16 Hours ago
UI/UX Designer
Healthcare & Life Sciences
- 2 - 5 Yrs
- Anywhere in India/Multiple Locations
We’re Hiring: UI/UX Designer (Full-time / Part-time / Freelance / Remote) 🌟
We are looking for a highly creative and passionate UI/UX Designer to join us in designing our website.
🔹 What We’re Looking For:
Strong proficiency in Figma and/or Photos...
1 Day ago
Senior Data Engineer
Information Technology
- 4 - 8 Yrs
- Bangalore
We are looking for a skilled and driven Data Engineer to join our dynamic technology team. As a Data Engineer, you will be responsible for building and maintaining robust, scalable, and high-performance data pipelines and platforms. This role involve...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in