Information Technology
Full-Time
tek analytix
Overview
Key Result Areas And Activities
- ETL Pipeline Development and Maintenance
- Design, develop, and maintain ETL pipelines using Cloudera tools such as Apache NiFi, Apache Flume, and Apache Spark.
- Create and maintain comprehensive documentation for data pipelines, configurations, and processes.
- Data Integration and Processing
- Integrate and process data from diverse sources including relational databases, NoSQL databases, and external APIs.
- Performance Optimization
- Optimize performance and scalability of Hadoop components (HDFS, YARN, MapReduce, Hive, Spark) to ensure efficient data processing.
- Identify and resolve issues related to data pipelines, system performance, and data integrity.
- Data Quality and Transformation
- Implement data quality checks and manage data transformation processes to ensure accuracy and consistency.
- Data Security and Compliance
- Apply data security measures and ensure compliance with data governance policies and regulatory requirements.
- Proficiency in Cloudera Data Platform (CDP) - Cloudera Data Engineering.
- Proven track record of successful data lake implementations and pipeline development.
- Knowledge of data lakehouse architectures and their implementation.
- Hands-on experience with Apache Spark and Apache Airflow within the Cloudera ecosystem.
- Proficiency in programming languages such as Python, Java, Scala, and Shell.
- Exposure to containerization technologies (e.g., Docker, Kubernetes) and system-level understanding of data structures, algorithms, distributed storage, and compute.
- Experience with other CDP services like Dataflow, Stream Processing
- Familiarity with cloud environments such as AWS, Azure, or Google Cloud Platform
- Understanding of data governance and data quality principles
- CCP Data Engineer Certified
- 7+ years of experience in Cloudera/Hadoop/Big Data engineering or related roles
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field
- Can influence and implement change; demonstrates confidence, strength of conviction and sound decisions.
- Believes in head-on dealing with a problem; approaches in logical and systematic manner; is persistent and patient; can independently tackle the problem, is not over-critical of the factors that led to a problem and is practical about it; follow up with developers on related issues.
- Able to consult, write, and present persuasively.
- Able to work in a self-organized and cross-functional team.
- Able to iterate based on new information, peer reviews, and feedback.
- Able to work seamlessly with clients across multiple geographies.
- Research focused mindset.
- Proficiency in English (read/write/speak) and communication over email.
- Excellent analytical, presentation, reporting, documentation, and interactive skills.
Similar Jobs
View All
11 Hours ago
Program Manager
Information Technology
- 15 - 18 Yrs
- Gurgaon / Gurugram
We’re Hiring | Program Manager
Location: Gurugram, India
Domain: Program Management | Digital Systems | Java/.NET | Agile | Fintech/Supply Chain
Are you a strategic thinker with deep experience in program management of digital products? We’re lo...
11 Hours ago
Technical Fullstack Architect - Node.js
Information Technology
- 50,00,000 - 60,00,000 INR - Annual
- 12 - 18 Yrs
- Hyderabad
About the Role:
We are seeking a Fullstack Technical Architect with deep expertise in backend development using Node.js and proficiency in frontend technologies like React or any modern JavaScript framework. You will play a key role in building an...
12 Hours ago
Principal Engineer - Fullstack
Information Technology
- 30,00,000 - 40,00,000 INR - Annual
- 8 - 12 Yrs
- Mumbai
Looking for candidate who is enthusiastic to work in a Startup environment and build things from Scratch individually
Candidate has past experience in scalable consumer facing applications managing latency and traffic FullStack Individual Contribu...
12 Hours ago
Asst. Manager / Dy. Manager – Talent Acquisition
Automotive
- 4,00,000 - 8,00,000 INR - Yearly
- 4 - 8 Yrs
- West Bengal
We are looking for dynamic and experienced professionals for the Talent Acquisition team at our Kharagpur Plant location. The incumbent will be responsible for managing the full-cycle recruitment process for both technical and functional roles across...
1 Day ago
Data Analyst (Kannada Speakers)
AI & Machine Learning Advancement
- 1 - 1 Yrs
- Karnataka, India
For thousands of years, maps have provided humans with the knowledge they need to make decisions. As a Maps Evaluator, you will have the opportunity to provide ground truth for your town, city or country.
At Peroptyx, we are looking for Data Ana...
1 Day ago
Data Analyst (Telugu Speakers)
AI & Machine Learning Advancement
- 1 - 1 Yrs
- Andhra Pradesh, Telangana, India
For thousands of years, maps have provided humans with the knowledge they need to make decisions. As a Maps Evaluator, you will have the opportunity to provide ground truth for your town, city or country.
At Peroptyx, we are looking for Data Ana...
1 Day ago
Solution Architect – Databricks
Information Technology
- 40,00,000 - 50,00,000 INR - Annual
- 9 - 15 Yrs
- Mumbai
Summary role description:
Hiring for a Solution Architect – Databricks for global technology consulting and system integration firm specializing in data engineering, AI and ML.
Company description:
Our client is a US-headquarte...
1 Day ago
Interesting Job Opportunity: Utilli - Full Stack Developer - Node.js/React.js
Information Technology
- Bangalore, Karnataka, India
Job SummaryWe are seeking a highly skilled Full Stack Engineer to lead a team of developers in building and maintaining scalable web applications. This role requires a hands-on leader with deep expertise in JavaScript frameworks and modern developme...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in