Data Engineer - Python

We are looking forward to hire Python Professionals in the following areas :

:

Experience required: 5-7 years

Core Technical Skills

• Python

  • Backend service development and business logic implementation
  • Retry and error-handling mechanisms
  • Data schema modeling and validation using Pydantic
  • REST API development and request handling

• SQL / Snowflake

  • • MERGE and STREAM-based CDC pipeline development
    • Task scheduling and stored procedure implementation
    • Secure Views and Secure Data Sharing
    • Streaming data ingestion using Snowpipe and Snowpipe Streaming
    • RBAC, role management, and grant administration
    • Warehouse performance tuning and optimization

• Terraform

  • Infrastructure as Code (IaC) for Snowflake resource provisioning
  • Database, role, warehouse, and grant management
  • Modular and reusable infrastructure deployments
  • Automated environment provisioning and standardization

• AWS

  • Lambda-based event-driven ingestion workflows
  • S3 data lake storage architecture
  • Glue Data Catalog integration
  • IAM-based security and access control implementation

• Palantir Foundry

  • Workshop-based GUI and application development
  • Backend workflow and process orchestration
  • Data request, approval, and provisioning workflows
  • Multi-stage approval lifecycle management with role-based ownership transitions

• Version Control CI Engineering

  • Git-based source control and branching strategies
  • Pre-commit hook framework implementation
  • Python linting and formatting using Ruff
  • Pull request templates and review governance
  • AI-assisted development workflows (Plan Build Review)

Data Modeling Interchange Formats

• • JSON-based configuration and request schema design
  • Hierarchical and relational data modeling
  • Cross-platform data model synchronization

Platform Domain Expertise

• Enterprise Data Provisioning Request Portals
  • End-to-end ownership of data request platforms
  • Palantir Foundry Workshop GUI development
  • Workflow orchestration and Python-based execution engines
  • Integration with Snowflake and AWS target platforms

Data Virtualization Analytics Platform Integration

• • • Output-port and ownership-privilege management
    • Source-to-target data model synchronization
    • Integration of hierarchical data structures across platforms

Industrial / OT Data Integration

• • • Integration of Aveva PI process historian data
    • Event-driven ingestion pipelines using Lambda Snowpipe Snowflake
    • Secure data sharing architectures
    • OT entity modeling and governance framework design

Multi-Stage Approval Workflow Design

• • Workflow development in Palantir Foundry
  • Role-based approval and ownership handoffs
  • End-to-end request lifecycle management:
    • Requester
    • Data Steward
    • Data Owner
    • Engineering Team
    • Business Verification Team

Data Access Governance

• • Access request and approval workflow implementation
  • Role-Based Access Control (RBAC) design
  • Self-service data provisioning solutions
  • Business-owner-driven governance models

• Regulated Environment Delivery

  • Dev QA Production deployment management
  • Controlled release and promotion workflows
  • Support for validated and GxP-equivalent environments

Compliance-focused system delivery and governance practices

Our Hyperlearning workplace is grounded upon four principles

• Flexible work arrangements, Free spirit, and emotional positivity
• Agile self-determination, trust, transparency, and open collaboration
• All Support needed for the realization of business goals,
• Stable employment with a great atmosphere and ethical corporate culture

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.