Senior Data Scientist (GenAI)

Job Title: Data Scientist (AI) SDE-3

Location: Noida / Bangalore

Experience: 5–8 Years

Employment Type: Full-time

About PhysicsWallah:

PhysicsWallah (PW) is one of India's leading education technology companies, empowering millions of learners through innovative digital learning solutions. We are building next-generation AI platforms to transform education through personalized learning, intelligent tutoring, content generation, and AI-powered learning experiences.

As an Data Scientist SDE-3 , you will play a key technical leadership role in shaping our Generative AI and Large Language Model (LLM) initiatives. You will work closely with Product, Engineering, and AI teams to build scalable, production-grade AI systems that power experiences for millions of students.

If you're passionate about solving complex AI challenges and building state-of-the-art LLM applications at scale, we'd love to hear from you.

Roles & Responsibilities:

• Design, develop, and deploy production-grade Generative AI and LLM-powered applications.
• Architect and implement scalable Retrieval-Augmented Generation (RAG) pipelines for knowledge-intensive AI systems.
• Fine-tune foundation models using techniques such as LoRA, QLoRA, PEFT, and RLHF .
• Optimize LLM inference for latency, throughput, scalability, and infrastructure cost .
• Build intelligent Agentic AI and multi-agent systems capable of autonomous reasoning and task execution.
• Design scalable vector search architectures using modern vector databases.
• Develop robust evaluation pipelines, including LLM-as-a-Judge methodologies for automated quality assessment.
• Build and maintain end-to-end ML workflows, experimentation pipelines, and model observability.
• Collaborate with Product Managers, Engineering teams, and Data Scientists to translate business problems into AI-powered solutions.
• Drive architectural decisions, establish AI best practices, and mentor engineers across teams.
• Stay up to date with the latest advancements in Generative AI, LLM optimization, and model serving technologies.

Skills & Qualifications:

Required Skills:

Large Language Models & Generative AI

• Strong experience designing and deploying production-grade LLM applications.
• Hands-on expertise with:
• vLLM or Text Generation Inference (TGI) or SGLang
• Retrieval-Augmented Generation (RAG)
• LLM Fine-tuning
• LoRA , QLoRA , or PEFT
• Reinforcement Learning from Human Feedback (RLHF)
• Quantization and/or Distillation
• LLM-as-a-Judge evaluation frameworks

AI Frameworks

Experience with one or more of the following:

• LangChain
• LangGraph
• LlamaIndex

Vector Databases

Hands-on experience with one or more:

• Pinecone
• Weaviate
• pgvector

Deep Learning & Model Optimization

• Hugging Face Transformers
• PyTorch
• Flash Attention
• Transformer architectures

Agentic AI

Experience building:

• AI Agents
• Multi-Agent Systems
• Autonomous AI workflows

MLOps & Experiment Tracking

Experience with:

• MLflow
• Langfuse
• Weights & Biases (W&B)

Performance Optimization

Strong understanding of:

• LLM latency optimization
• LLM inference optimization
• GPU utilization
• Cost optimization for production AI systems

Qualifications

• Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Machine Learning, Data Science, or a related field.
• 5–8 years of experience in Machine Learning, Data Science, AI Engineering, or related domains.
• Proven experience building and deploying AI solutions in production environments.
• Strong understanding of distributed systems, scalable architectures, and cloud platforms (AWS, Azure, or GCP).
• Excellent problem-solving, communication, and stakeholder management skills.
• Experience mentoring engineers and driving technical initiatives is highly preferred.

Why Join PhysicsWallah?

• Build AI products that impact millions of learners across India.
• Work on cutting-edge technologies in Generative AI, LLMs, Agentic AI, and RAG .
• Solve challenging real-world problems with large-scale AI systems.
• Collaborate with high-performing Product, Engineering, and AI teams.
• Enjoy a fast-paced, ownership-driven culture where innovation is encouraged.
• Lead strategic AI initiatives and influence the future of AI-powered education.
• Accelerate your career by working on some of the most impactful AI use cases in the EdTech ecosystem.