Java and Data Engineer Architect

JD

Senior Software Engineer/ Architect — Java, AWS, Apache Flink, and Snowflake

Responsibilities

Design and Develop Cloud Applications: Build, maintain, and enhance scalable Java applications and microservices using Quarkus, Spring Boot, or similar Java frameworks.

Serverless Application Development: Design, develop, deploy, and support AWS Lambda functions for event-driven processing, automation, integrations, and backend services.

Apache Flink Data Processing: Develop and maintain Apache Flink applications using Java for real-time and batch data processing, data transformation, stream processing, and integration with multiple data sources and destinations.

Data Warehouse Development and Management: Design, develop, and optimize data warehouse solutions using Snowflake or a similar cloud-based data warehouse. Create and maintain schemas, tables, views, SQL queries, stored procedures, data models, and data-integration processes to support analytics, reporting, and downstream applications.

Data Integration and Pipeline Development: Build reliable data pipelines that ingest, transform, validate, and distribute data across applications, databases, cloud services, Snowflake, and downstream systems.

API and System Integration: Develop REST APIs and integrate applications with databases, AWS services, third-party platforms, internal systems, and other enterprise applications.

AWS Cloud Services: Work with AWS services such as Lambda, API Gateway, S3, CloudWatch, IAM, Secrets Manager, SQS, SNS, EventBridge, and other services required to support cloud-native solutions.

Application and Pipeline Performance Optimization: Analyze and improve the performance, scalability, reliability, resource utilization, data-processing speed, and response times of applications and pipelines.

Data Quality and Governance: Implement data validation, reconciliation, error handling, monitoring, and quality controls to ensure data accuracy, consistency, security, and availability.

Testing and Quality Assurance: Develop and maintain unit, integration, end-to-end, and data-quality tests using tools such as JUnit, Mockito, Testcontainers, and appropriate data-testing frameworks.

Monitoring and Troubleshooting: Monitor application and pipeline logs, metrics, alerts, and system health. Investigate and resolve production incidents, data issues, deployment failures, performance problems, and service interruptions.

CI/CD and Deployment Automation: Support continuous integration and continuous delivery pipelines, automated builds, testing, code-quality checks, artifact management, and deployments across development, testing, staging, and production environments.

Infrastructure as Code: Develop and maintain AWS infrastructure configurations using Terraform or similar infrastructure-as-code tools.

Code Reviews and Development Standards: Participate in code reviews, follow clean-code and secure-coding practices, and contribute to reliable, maintainable, and scalable software solutions.

Documentation: Create and maintain technical documentation, API documentation, data-flow documentation, deployment procedures, troubleshooting guides, architecture documentation, and operational runbooks.

Agile Collaboration: Participate in daily stand-ups, sprint planning, backlog refinement, sprint reviews, retrospectives, and other Agile ceremonies.

Jira Project Management: Create, update, and track Jira work items. Maintain accurate task status, estimates, priorities, acceptance criteria, dependencies, risks, and delivery information.

Cross-Functional Collaboration: Work with product managers, business analysts, data engineers, QA engineers, DevOps engineers, architects, and other stakeholders to understand requirements and deliver effective technical solutions.

Qualifications

Required Skills

10+ years of experience in software engineering, backend development, cloud application development, or data engineering.

Strong proficiency in Java and object-oriented programming.

Hands-on experience with Quarkus, Spring Boot, or similar Java frameworks.

Experience developing, deploying, and supporting AWS Lambda functions.

Strong hands-on experience with AWS cloud services and serverless application development.

Practical experience developing data-processing and streaming applications using Apache Flink.

Experience designing and maintaining Apache Flink pipelines for real-time or batch data processing.

Mandatory hands-on experience with SNOWFLAKE or a similar cloud-based data warehouse.

Experience with Snowflake data modeling, schema design, SQL development, views, stored procedures, query optimization, and performance tuning.

Strong understanding of data warehousing concepts, data integration, data quality, data governance, and analytical workloads.

Experience developing REST APIs, microservices, event-driven applications, and asynchronous processing solutions.

Strong experience working with SQL and relational databases.

Knowledge of AWS services such as S3, CloudWatch, IAM, Secrets Manager, API Gateway, SQS, and SNS.

Experience with unit-testing and mocking frameworks such as JUnit and Mockito.

Strong understanding of CI/CD pipelines and automated software delivery.

Experience with Git, branching strategies, pull requests, and code reviews.

Experience troubleshooting application, integration, data-pipeline, and production issues.

Experience with monitoring, logging, alerting, and production support.

Familiarity with Docker and containerized applications.

Experience working in an Agile development environment.

Hands-on experience using Jira for task tracking, sprint planning, estimation, reporting, and delivery management.

Strong analytical, problem-solving, communication, and collaboration skills.