AWS Migration Platform Engineer

Required Skills & Experience

AWS & Cloud Engineering

• Hands-on experience with AWS Lambda, Step Functions, SQS, SNS, EventBridge, API Gateway, SSM Parameter Store, and Secrets Manager.
• Strong experience with AWS Fargate, ECS, and AWS Batch.
• Deep understanding of AWS S3, including object metadata, lifecycle policies, prefix structures, storage tiers, and large-scale object transfers.

Object Storage Migration

• Experience migrating large object datasets from on-premises or S3-compatible storage platforms (Dell ECS, OBSv2, etc.) to AWS S3.
• Strong understanding of migration patterns including manifests, batching, validation, partitioning, retries, and governance controls.
• Experience balancing migration throughput while managing bandwidth, compute resources, object counts, and network constraints.

Rclone

• Hands-on experience configuring and operating rclone for large-scale migrations.
• Experience with transfer optimization, checksums, validation, retries, logging, and advanced rclone capabilities.

Python Development

• Strong Python development experience.
• Experience building automation, APIs, Lambda functions, logging frameworks, JSON processing, exception handling, and data access services.

DynamoDB

• Experience designing and operating DynamoDB tables.
• Understanding of partition keys, indexes, scans, updates, batch writes, state management, and migration tracking.

Networking & Security

• Understanding of Direct Connect, Transit Gateway, VPC networking, routing, private subnets, and S3 Gateway Endpoints.
• Strong IAM knowledge including roles, policies, cross-account access, STS, least-privilege security design, and Secrets Manager.

Monitoring & Deployment

• Experience with CloudWatch metrics, alarms, logs, dashboards, and operational telemetry.
• Experience with GitLab repositories, CI/CD pipelines, infrastructure deployment practices, and environment management.

Nice to Have Skills & Experience

• Experience with Dell ECS, OBSv2, or other enterprise S3-compatible object storage platforms.
• Experience delivering enterprise-scale migrations within regulated production environments.
• Experience operating within hub-and-spoke AWS account structures.
• Strong technical documentation and stakeholder reporting skills.
• Experience creating runbooks, operational procedures, architecture documentation, and support documentation.

Job Description

Insight Global is seeking an OBSv2 to AWS S3 Migration Platform Engineer to join a leading financial services client. This individual will lead the design, development, and operation of a secure, scalable migration platform responsible for moving large-scale object data from OBSv2 and other S3-compatible storage platforms into AWS S3. The role combines software engineering, cloud infrastructure, automation, and operational excellence to deliver enterprise-scale migration capabilities across multiple AWS environments.

Own the end-to-end object storage migration lifecycle from source platforms (OBSv2, Dell ECS, and other S3-compatible storage solutions) into AWS S3.

• Design and develop AWS-based orchestration solutions using Lambda, Step Functions, Fargate, Batch, SQS, DynamoDB, and EventBridge.
• Build and support manifest-driven and dynamic migration workflows including partitioning, batching, task sizing, retry handling, validation, and completion tracking.
• Configure, deploy, and operate high-volume migration tooling utilizing rclone for secure, large-scale object transfers.
• Implement governance controls around bandwidth allocation, throttling, queue management, prioritization, and migration scheduling.
• Develop Python-based automation and serverless services to support migration execution, monitoring, validation, and reporting.
• Create observability solutions using CloudWatch dashboards, metrics, logs, alarms, health checks, and operational telemetry reporting.
• Support AWS networking, security, IAM, and multi-account deployment requirements.
• Produce technical documentation, architecture diagrams, operational runbooks, implementation guides, and executive-ready reporting.
• Provide production support, troubleshooting, performance tuning, and continuous improvement for migration operations.