Python Engineer

About the Role

We are looking for an experienced Python Software Engineer / Tech Lead to work on an AI-focused software engineering project involving real-world open-source repositories and LLM evaluation.

You will work hands-on with Python codebases, GitHub issues, Docker environments, testing, and software quality evaluation while helping assess how effectively AI/LLM systems can understand and modify real-world code.

Key Responsibilities

• Analyze and triage GitHub issues across open-source Python libraries.
• Set up and configure software repositories and development environments.
• Dockerize repositories and manage local development environments.
• Evaluate unit-test coverage and test quality.
• Run, modify, debug, and test real-world Python codebases locally.
• Assess LLM performance in software bug-fixing scenarios.
• Identify challenging repositories and issues for LLM evaluation.
• Collaborate with researchers on AI/LLM evaluation projects.
• Potentially lead and guide junior engineers.

Required Skills

• 5+ years of overall software engineering experience
• Strong hands-on experience with Python
• Good knowledge of Git and GitHub
• Hands-on experience with Docker
• Understanding of software development pipelines
• Ability to understand and navigate complex codebases
• Strong experience running, modifying, debugging, and testing projects locally
• Open-source contribution or evaluation experience is a plus.

Nice to Have

• Experience with LLM research or evaluation
• Experience building/testing developer tools or automation agents
• Experience working with open-source projects
• Experience working in a fully remote environment.

Contract Details

• Contract Duration: 3 months
• Commitment: Minimum 40 hours per week / 8 hours per day
• Time Zone: Minimum 4 hours overlap with PST
• Employment Type: Contractor assignment
• Leave: No medical/paid leave.

Ideal Candidate

We are looking for a strong Python engineer who is comfortable working directly with complex codebases, debugging and testing existing projects, using Git/Docker, and interested in AI/LLM evaluation.

Pay: Up to ₹1,500,000.00 per year

Benefits:

• Work from home

Application Question(s):

• How many years of experience do you have with Git/GitHub?
• Have you worked with complex open-source codebases?

Experience:

• Python: 5 years (Required)

Work Location: Remote