Daniel Joseph

• Developed, monitored, and troubleshooted automated data pipelines for the insurance industry using Dagster, reducing processing time and mitigating human errors through streamlined orchestration. • Performed end-to-end ETL processes for both structured and unstructured data, loading into optimized databases to support analytics and reporting. • Built interactive dashboards using Streamlit for internal stakeholders and Power BI for business users, enabling real-time data visualization and improved decision-making. • Developed AI-powered data extraction tools, integrating AWS Textract for document parsing, achieving 95%+ accuracy in text recognition and significantly accelerating document processing workflows. • Designed and maintained cloud-native solutions utilizing AWS services such as Lambda, S3, EventBridge, Secrets Manager, and CloudWatch, ensuring scalability and resilience. • Created Grafana dashboards connected to CloudWatch for system performance monitoring, reducing downtime and enhancing observability. • Contributed to system architecture and design, emphasizing flexibility, scalability, and future-proofing. • Worked extensively with SQL and NoSQL databases, including MSSQL, PostgreSQL, and MongoDB, for data warehousing and real-time applications. • Authored comprehensive project documentation, improving knowledge transfer and reducing onboarding time for new developers.

Supported development and deployment of core ETL pipelines. Improved code quality and unit testing coverage.