Senior Databricks Developer

Senior Databricks Developer

About Intelactsoft

Since our creation in 2012, we have been guided by two essential questions:

• Is there a way to serve clients better, faster, and smarter?
• Do our work and initiatives have a positive impact on people’s lives, be they clients or employees?

Our mission is to create a warm and creative environment where employees and partners collaborate to deliver high-performing technology solutions that make a difference. We embrace challenges, strive for audacious goals, and remain true to our values and beliefs.

We are Intelactsoft. Join us to create a positive impact and help us grow together with you!

PLEASE NOTE:

Hybrid: 2–3 days/weekB2B collaboration, 12 months.

Responsibilities

• Design, develop, and maintain data ingestion, transformation, and publishing processes using Azure Databricks and PySpark.
• Build and optimise scalable ETL/ELT pipelines for large data volumes.
• Develop Delta Lake structures and data models for operational and analytical use cases.
• Implement incremental processing, data historisation, and Change Data Capture mechanisms.
• Integrate data from multiple sources, including Oracle, SQL Server, APIs, files, and banking applications.
• Contribute to the design and evolution of the organisation’s Data Lakehouse architecture.
• Design scalable and high-performing data models.
• Contribute to platform architecture, development standards, and engineering best practices.
• Ensure end-to-end data lineage, consistency, and traceability.
• Implement automated Data Quality controls.
• Develop data reconciliation and validation processes.
• Configure monitoring, alerting, and logging for production data pipelines.
• Investigate and resolve production incidents.
• Manage data reloads, reruns, corrections, and recovery processes.
• Optimise PySpark and SQL workloads for performance and cost efficiency.
• Identify and eliminate processing bottlenecks.
• Optimise Databricks resource consumption.
• Contribute to the automation of development, testing, and deployment processes.
• Take end-to-end ownership of technical deliveries.
• Provide technical guidance and mentorship to other team members.

Tools / Software Knowledge & Competencies

• Minimum 5 years of experience in Data Warehouse, Big Data, or enterprise data platform development.
• Minimum 2–3 years of hands-on Databricks experience.
• Proven experience with complex Data Warehouse, Data Mart, or Data Lake implementations.
• Strong experience developing end-to-end data pipelines.
• Solid understanding of Data Lakehouse architecture.
• Hands-on experience with:
• Azure Databricks
• PySpark
• Advanced SQL
• Delta Lake
• Data modelling
• ETL/ELT development
• Data Quality frameworks
• Pipeline orchestration
• Git and Jira
• Experience implementing data historisation, CDC, reconciliation, and validation processes.
• Strong knowledge of Spark optimisation and distributed data processing.
• Ability to take full ownership of technical deliveries and provide technical leadership.

Education & Soft Skills

• Bachelor’s degree in Computer Science, Engineering, Information Systems, Mathematics, or a related field.
• Strong analytical and problem-solving skills.
• Excellent attention to detail and focus on data quality.
• Ability to work autonomously and manage end-to-end responsibilities.
• Collaborative mindset and mentoring abilities.
• Effective communication with both technical and business teams.
• Results-oriented approach and strong sense of ownership.
• Ability to work effectively in complex and dynamic environments.

Benefits

• Access to impactful financial projects
• Continuous professional development
• Attractive compensation based on experience.

Advantages

• Azure Data Factory
• Kafka and event-streaming technologies
• Advanced Python
• CI/CD implementation
• Unity Catalog
• Data Governance
• Machine Learning on Databricks
• Qlik Sense
• Experience in the banking or financial-services sector
• Knowledge of Retail Banking products and processes
• Experience with financial and management reporting
• Understanding of risk, compliance, and regulatory reporting
• Knowledge of banking data flows and enterprise analytical ecosystems
• Working remote/hybrid
• Friendly team and collaborative work environment
• Projects of high complexity
• Numerous team-building activities.

DISCLAIMER: Only shortlisted candidates will be contacted for the next stages.

Is this interesting enough for you?

Start a conversation with us by email at [email protected] .

What’s next?

• Getting-to-know-each-other meeting
• Technical skills assessment
• Client meeting
• Onboarding
• Let the challenge begin!

Stalk us!

Website: www.intelactsoft.com

Facebook: facebook.com/intelactsoft