System Soft Technologies

<p><strong>Job Responsibilities and Qualifications for Databricks Engineer:</strong></p>
<ul>
<li>Design, develop, and maintain scalable data pipelines using Databricks, PySpark, Python, and SQL.</li>
<li>Implement Medallion Architecture, including Bronze, Silver, and Gold data layers.</li>
<li>Build data ingestion pipelines from databases, APIs, files, and streaming sources into the Bronze layer.</li>
<li>Develop data cleansing, validation, standardization, deduplication, and transformation logic in the Silver layer.</li>
<li>Create business-ready datasets, aggregations, and dimensional models in the Gold layer.</li>
<li>Use Delta Lake for reliable data storage, schema enforcement, schema evolution, and transaction management.</li>
<li>5+ years of experience in data engineering or related roles.</li>
<li>Strong hands-on experience with Databricks and Medallion Architecture.</li>
<li>Strong programming skills in PySpark, Python, and SQL.</li>
<li>Experience implementing Bronze, Silver, and Gold data layers.</li>
<li>Strong knowledge of Delta Lake and lakehouse concepts.</li>
</ul>


Databricks Consultant with Medallion Architecture

Databricks Consultant with Medallion Architecture

This job is no longer available

Talents

Recruiters

About