Python Software Engineer

We are looking for experienced Senior Python Software Engineers / Tech Leads to work on an AI-focused software engineering project involving real-world open-source codebases and LLM evaluation.

You will work hands-on with GitHub repositories, troubleshoot and triage software issues, configure development environments, evaluate test coverage, and assess how effectively LLMs can understand and fix real-world software problems.

Key Responsibilities

• Analyze and triage GitHub issues across trending open-source libraries.
• Set up and configure software repositories and development environments.
• Work with Docker and local development environments.
• Evaluate unit test coverage and test quality.
• Modify, run, and test real-world Python codebases locally.
• Assess LLM performance in software bug-fixing scenarios.
• Collaborate with researchers to identify challenging repositories and issues for LLM evaluation.
• Potentially lead and collaborate with junior engineers.

Required Skills

• 5+ years of overall software engineering experience.
• Strong Python programming experience.
• Proficiency with Git and Docker.
• Understanding of basic software pipeline setup.
• Ability to navigate and understand complex codebases.
• Strong debugging, testing, and problem-solving skills.
• Comfortable running, modifying, and testing real-world projects locally.
• Experience with open-source projects is an advantage.

Nice to Have

• Experience with LLM research or LLM evaluation projects.
• Experience building or testing developer tools or automation agents.
• Experience working with public GitHub repositories.
• Previous experience in AI/ML or developer-focused AI projects.

Work Requirements

• Minimum 8 hours per day / 40 hours per week.
• Must be available for at least 4 hours of overlap with PST.
• Fully remote opportunity.
• 3-month contractor assignment.
• Contractor role does not include medical or paid leave.

Why Join?

Work on a cutting-edge AI project focused on evaluating how Large Language Models interact with real-world software code, combining practical software engineering with AI research.

Interested candidates can apply with their updated resume.
[email protected]

Pay: Up to ₹150,000.00 per month

Application Question(s):

• Do you have hands-on experience with Git, Docker, and working with complex codebases?
• Do you have experience analyzing, debugging, modifying, and testing real-world Python projects or open-source GitHub repositories?

Experience:

• Python: 3 years (Preferred)

Work Location: Remote