Data Engineer III

If you are looking for a career at a dynamic company with a people-first mindset and a deep culture of growth and autonomy, ACV is the right place for you! Competitive compensation packages and learning and development opportunities, ACV has what you need to advance to the next level in your career. We will continue to raise the bar every day by investing in our people and technology to help our customers succeed. We hire people who share our passion, bring innovative ideas to the table, and enjoy a collaborative atmosphere.

Who we are:

ACV is a technology company that has revolutionized how dealers buy and sell cars online. We are transforming the automotive industry. ACV Auctions Inc. (ACV), has applied innovation and user-designed, data driven applications and solutions. We are building the most trusted and efficient digital marketplace with data solutions for sourcing, selling and managing used vehicles with transparency and comprehensive insights that were once unimaginable. We are disruptors of the industry and we want you to join us on our journey. Our network of brands include ACV Auctions, ACV Transportation, ClearCar, MAX Digital and ACV Capital within its Marketplace Products, as well as, True360 and Data Services.

ACV Auctions in Chennai, India are looking for talented individuals to join our team. As we expand our platform, we're offering a wide range of exciting opportunities across various roles in corporate, operations, and product and technology. Our global product and technology organization spans product management, engineering, data science, machine learning, DevOps and program leadership. What unites us is a deep sense of customer centricity, calm persistence in solving hard problems, and a shared passion for innovation. If you're looking to grow, lead, and contribute to something larger than yourself, we'd love to have you on this journey. Let's build something extraordinary together. Join us in shaping the future of automotive!

At ACV we focus on the Health, Physical, Financial, Social and Emotional Wellness of our Teammates and to support this we offer industry leading benefits and wellness programs.

Who we are looking for:

The data engineering team's mission is to provide high availability and high resiliency as a core service to our ACV applications. The team is responsible for ETL’s using different ingestion and transformation techniques. We are responsible for a range of critical tasks aimed at ensuring smooth and efficient functioning and high availability of ACVs data platforms. We are a crucial bridge between Infrastructure Operations, Data Infrastructure, Analytics, and Development teams providing valuable feedback and insights to continuously improve platform reliability, functionality, and overall performance.

We are seeking a talented data professional as a Data Engineer III to join our Data Engineering team. This role requires a strong focus and experience in software development, multi-cloud based technologies, in memory data stores, and a strong desire to learn complex systems and new technologies. It requires a sound foundation in database and infrastructure architecture, deep technical knowledge, software development, excellent communication skills, and an action-based philosophy to solve hard software engineering problems.

What you will do:

As a Data Engineer at ACV Auctions, you HAVE FUN !! You will design, develop, write, and modify code. You will be responsible for development of ETLs, application architecture, optimizing databases & SQL queries. You will work alongside other data engineers and data scientists in the design and development of solutions to ACV’s most complex software problems. It is expected that you will be able to operate in a high performing team, that you can balance high quality delivery with customer focus, and that you will have a record of delivering and guiding team members in a fast-paced environment.

• Design, develop, and maintain scalable ETL pipelines using Python and SQL to ingest, process, and transform data from diverse sources.
• Write clean, efficient, and well-documented code in Python and SQL.
• Utilize Git for version control and collaborate effectively with other engineers.
• Implement and manage data orchestration workflows using industry-standard orchestration tools (e.g., Apache Airflow, Prefect)..
• Apply a strong understanding of major data structures (arrays, dictionaries, strings, trees, nodes, graphs, linked lists) to optimize data processing and storage.
• Support multi-cloud application development.
• Contribute, influence, and set standards for all technical aspects of a product or service including but not limited to, testing, debugging, performance, and languages.
• Support development stages for application development and data science teams, emphasizing in MySQL and Postgres database development.
• Influence companywide engineering standards for tooling, languages, and build systems.
• Leverage monitoring tools to ensure high performance and availability; work with operations and engineering to improve as required.
• Ensure that data development meets company standards for readability, reliability, and performance.
• Collaborate with internal teams on transactional and analytical schema design.
• Conduct code reviews, develop high-quality documentation, and build robust test suites
• Respond-to and troubleshoot highly complex problems quickly, efficiently, and effectively.
• Participate in engineering innovations including discovery of new technologies, implementation strategies, and architectural improvements.
• Participate in on-call rotation
  
  

What you will need:

• Bachelor’s degree in computer science, Information Technology, or a related field (or
  
  

equivalent work experience)

• Ability to read, write, speak, and understand English.
• 3+ years of experience programming in Python
• 3+ years of experience with ETL workflow implementation (Airflow, Python)
• 3+ years work with continuous integration and build tools.
• 2+ year of experience with Cloud platforms preferably in AWS or GCP
• Knowledge of database architecture, infrastructure, performance tuning, and optimization techniques.
• Knowledge in day-day tools and how they work including deployments, k8s, monitoring systems, and testing tools.
• Proficient in version control systems including trunk-based development, multiple release planning, cherry picking, and rebase.
• Proficient in databases (RDB), SQL, and can contribute to table definitions.
• Self-sufficient debugger who can identify and solve complex problems in code.
• Deep understanding of major data structures (arrays, dictionaries, strings).
• Experience with Domain Driven Design.
• Experience with containers and Kubernetes.
• Experience with database monitoring and diagnostic tools, preferably Data Dog.
• Hands-on skills and the ability to drill deep into the complex system design and implementation.
• Proficiency in SQL query writing and optimization.
• Familiarity with database security principles and best practices.
• Familiarity with in-memory data processing
• Knowledge of data warehousing concepts and technologies, including dimensional modeling and ETL frameworks
• Strong communication and collaboration skills, with the ability to work effectively in a fast paced global team environment.
• Experience working with:
• SQL data-layer development experience; OLTP schema design
• Using and integrating with cloud services, specifically: AWS RDS, Aurora, S3, GCP
• Github, Jenkins, Python
  

Nice to Have Qualifications:

• Experience with Airflow, Docker, Visual Studio, Pycharm, Redis, Kubernetes, Fivetran, Spark, Dataflow, Dataproc, EMR
• Experience with database monitoring and diagnostic tools, preferably DataDog.
• Hands-on experience with Kafka or other event streaming technologies.
• Hands-on experience with micro-service architecture
  
  

Our Values

Trust & Transparency | People First | Positive Experiences | Calm Persistence | Never Settling

At ACV, we are committed to an inclusive culture in which every individual is welcomed and empowered to celebrate their true selves. We achieve this by fostering a work environment of acceptance and understanding that is free from discrimination. ACV is committed to being an equal opportunity employer regardless of sex, race, creed, color, religion, marital status, national origin, age, pregnancy, sexual orientation, gender, gender identity, gender expression, genetic information, disability, military status, status as a veteran, or any other protected characteristic. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you have a disability or special need that requires reasonable accommodation, please let us know.

Data Processing Consent

When you apply to a job on this site, the personal data contained in your application will be collected by ACV Auctions Inc. and/or one of its subsidiaries ("ACV Auctions"). By clicking "apply", you hereby provide your consent to ACV Auctions and/or its authorized agents to collect and process your personal data for purpose of your recruitment at ACV Auctions and processing your job application. ACV Auctions may use services provided by a third party service provider to help manage its recruitment and hiring process. For more information about how your personal data will be processed by ACV Auctions and any rights you may have, please review ACV Auctions' candidate privacy notice here. If you have any questions about our privacy practices, please contact datasubjectrights@acvauctions.com.