Sr. Data Engineer

Overview

Role :- Sr. Data Engineer

Location :- Bengaluru (Hybrid)

Company :- The Briminc Softech

About The Briminc Softech

https://www.linkedin.com/company/thebriminc/

At The Briminc Softech, we are a specialized staff augmentation, Strategic IT hiring, Remote team setup and project-based hiring company connecting exceptional IT talent with innovative organizations worldwide. We focus exclusively on placing senior technical professionals with clients who need specialized expertise for their projects and teams. As part of our elite technical community, you'll gain access to diverse contract opportunities with industry-leading clients, competitive compensation, and the flexibility to work on projects that align with your skills and interests. We value technical excellence and build lasting relationships with our talent, ensuring consistent access to quality projects. We have all compliances in place.
We partner with multinational corporations (MNCs) working in advanced technologies, offering you opportunities to work on cutting-edge projects that expand your technical expertise.

Roles and Responsibilities:

• Design and develop data ingestion frameworks for batch and real-time data processing using distributed systems.
• Create, implement, and maintain streaming data solutions leveraging technologies like Kafka, Apache Spark, and Hadoop.
• Develop data transformation pipelines, ensuring high performance, scalability, and reliability of data systems.
• Work closely with business analysts and stakeholders to understand requirements and translate them into technical ETL solutions.
• Build, deploy, and support application code and analytical models across various environments.
• Integrate open-source data tools to enhance analytics capabilities and operationalize them for enterprise usage.
• Use tools like Python, Java, Hive, Presto, and Scala to prototype and build data engineering solutions.
• Ensure adherence to data governance policies by implementing or validating data lineage, data quality checks, and data classification.
• Participate in on-call support rotation, ensuring high availability and incident resolution.
• Align solutions with company-wide software development lifecycle (SDLC) and DevOps best practices.
• Provide recommendations for process improvements and develop innovative solutions for complex data engineering challenges.
• Collaborate with cross-functional teams to support delivery of critical data projects and enterprise data platforms.

External Skills And Expertise
Must-Have Skills & Qualifications:

• Bachelors degree in computer science, Engineering, or a related field; masters degree preferred.
• 5+ years of experience in data engineering or a related role.
• Proficiency in Apache Airflow for workflow scheduling and management.
• Strong experience with Hadoop ecosystems, including HDFS, MapReduce, Hive, Presto.
• Expertise in Apache Spark/ Scala, Kafka for large-scale and real time data processing.
• Proficient in Python
• Advanced SQL skills for data analysis and reporting.
• Experience with cloud platforms (e.g., AWS, Google Cloud, Azure) preferably GCP is a plus.
• Strong analytical and problem-solving skills.
• Excellent communication and collaboration abilities.

Mandate Skills :- SCALA , Spark, Airflow, Hadoop, Python , SQL, BigQuery

Job Types: Full-time, Contractual / Temporary
Contract length: 12 months

Pay: ₹18,900.58 - ₹100,942.31 per month

Schedule:

• Monday to Friday
• Morning shift

Ability to commute/relocate:

• Bengaluru, Karnataka: Reliably commute or planning to relocate before starting work (Required)

Application Question(s):

• How much years of experience you have as sr. Data Engineer
• what is your current CTC ?
• What is your expected CTC ?
• What is your is notice in days?

Location:

• Bengaluru, Karnataka (Required)

Work Location: Hybrid remote in Bengaluru, Karnataka