Hyderabad, Telangana, India
Information Technology
Full-Time
techcarrot
Overview
Job Description
Job Description
Data Engineer
As a Data Engineer in our team, you will be responsible for assessing complex new data sources and quickly turning these into business insights. You also will support the implementation and integration of these new data sources into our Azure Data platform.
Responsibilities
Requirements
ADF , Databricks , Python , Pyspark , SQL , Synapse
Job Description
Data Engineer
As a Data Engineer in our team, you will be responsible for assessing complex new data sources and quickly turning these into business insights. You also will support the implementation and integration of these new data sources into our Azure Data platform.
Responsibilities
- You are detailed reviewing and analyzing structured, semi-structured and unstructured data sources for quality, completeness, and business value.
- You design, architect, implement and test rapid prototypes that demonstrate value of the data and present them to diverse audiences.
- You participate in early state design and feature definition activities.
- Responsible for implementing robust data pipeline using Microsoft, Databricks Stack
- Responsible for creating reusable and scalable data pipelines.
- You are a Team-Player, collaborating with team members across multiple engineering teams to support the integration of proven prototypes into core intelligence products.
- You have strong communication skills to effectively convey complex data insights to non-technical stakeholders.
- You have an experience working collaboratively in cross-functional teams and manage multiple projects simultaneously.
- Advanced working knowledge and experience with relational and non-relational databases.
- Experience building and optimizing Big Data pipelines, architectures, and datasets.
- Strong analytic skills related to working with structured and unstructured datasets.
- Hands-on experience in Azure Databricks utilizing Spark to develop ETL pipelines.
- Strong proficiency in data analysis, manipulation, and statistical modeling using tools like Spark, Python, Scala, SQL, or similar languages.
- Strong experience in Azure Data Lake Storage Gen2, Azure Data Factory, Databricks, Event Hub, Azure Synapse.
- Familiarity with several of the following technologies: Event Hub, Docker, Azure Kubernetes Service, Azure DWH, API Azure, Azure Function, Power BI, Azure Cognitive Services.
- Azure DevOps experience to deploy the data pipelines through CI/CD.
- Minimum 5-7 years of practical experience as Data Engineer.
- Bachelor’s degree in computer science, software engineering, information technology, or a related field.
Requirements
ADF , Databricks , Python , Pyspark , SQL , Synapse
Similar Jobs
View All
11 Hours ago
Program Manager
Information Technology
- 15 - 18 Yrs
- Gurgaon / Gurugram
We’re Hiring | Program Manager
Location: Gurugram, India
Domain: Program Management | Digital Systems | Java/.NET | Agile | Fintech/Supply Chain
Are you a strategic thinker with deep experience in program management of digital products? We’re lo...
11 Hours ago
Technical Fullstack Architect - Node.js
Information Technology
- 50,00,000 - 60,00,000 INR - Annual
- 12 - 18 Yrs
- Hyderabad
About the Role:
We are seeking a Fullstack Technical Architect with deep expertise in backend development using Node.js and proficiency in frontend technologies like React or any modern JavaScript framework. You will play a key role in building an...
11 Hours ago
Principal Engineer - Fullstack
Information Technology
- 30,00,000 - 40,00,000 INR - Annual
- 8 - 12 Yrs
- Mumbai
Looking for candidate who is enthusiastic to work in a Startup environment and build things from Scratch individually
Candidate has past experience in scalable consumer facing applications managing latency and traffic FullStack Individual Contribu...
12 Hours ago
Asst. Manager / Dy. Manager – Talent Acquisition
Automotive
- 4,00,000 - 8,00,000 INR - Yearly
- 4 - 8 Yrs
- West Bengal
We are looking for dynamic and experienced professionals for the Talent Acquisition team at our Kharagpur Plant location. The incumbent will be responsible for managing the full-cycle recruitment process for both technical and functional roles across...
1 Day ago
Data Analyst (Kannada Speakers)
AI & Machine Learning Advancement
- 1 - 1 Yrs
- Karnataka, India
For thousands of years, maps have provided humans with the knowledge they need to make decisions. As a Maps Evaluator, you will have the opportunity to provide ground truth for your town, city or country.
At Peroptyx, we are looking for Data Ana...
1 Day ago
Data Analyst (Telugu Speakers)
AI & Machine Learning Advancement
- 1 - 1 Yrs
- Andhra Pradesh, Telangana, India
For thousands of years, maps have provided humans with the knowledge they need to make decisions. As a Maps Evaluator, you will have the opportunity to provide ground truth for your town, city or country.
At Peroptyx, we are looking for Data Ana...
1 Day ago
Solution Architect – Databricks
Information Technology
- 40,00,000 - 50,00,000 INR - Annual
- 9 - 15 Yrs
- Mumbai
Summary role description:
Hiring for a Solution Architect – Databricks for global technology consulting and system integration firm specializing in data engineering, AI and ML.
Company description:
Our client is a US-headquarte...
1 Day ago
Interesting Job Opportunity: Utilli - Full Stack Developer - Node.js/React.js
Information Technology
- Bangalore, Karnataka, India
Job SummaryWe are seeking a highly skilled Full Stack Engineer to lead a team of developers in building and maintaining scalable web applications. This role requires a hands-on leader with deep expertise in JavaScript frameworks and modern developme...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in