Overview
What does day-to-day look like:
* Analyze and triage GitHub issues across trending open-source libraries.
* Set up and configure code repositories, including Dockerization and environment setup.
* Evaluating unit test coverage and quality.
* Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
* Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs.
* Opportunities to lead a team of junior engineers to collaborate on projects.
Required Skills:
* Strong experience with Java
* Proficiency with Git, Docker, and basic software pipeline setup.
* Ability to understand and navigate complex codebases.
* Comfortable running, modifying, and testing real-world projects locally.
* Experience contributing to or evaluating open-source projects is a plus.
* Nice to Have:
* Previous participation in LLM research or evaluation projects.
Experience building or testing developer tools or automation agents.
Job Types: Full-time, Contractual / Temporary
Contract length: 3-6 months
Pay: ₹400.00 - ₹500.00 per hour
Expected hours: 8 per week
Application Question(s):
- Are you comfortable with Shift timings - 4 hours flexible and rest 5hours candidate needs to be available from 7:30pm to 12:30am
- Do you have Proficiency with Git, Docker, and basic software pipeline setup.
- Do you have experience in Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
Experience:
- Java: 5 years (Required)