Senior Software Engineer

If you think of yourself as a Data Wizard with a deep understanding of data engineering technologies and experience leading a team, we encourage you to apply for this exciting opportunity at IDfy. Architecting & implementing Data Pipelines & Frameworks to provide a better developer experience for our dev teams.

We are the match if you...

• Experience in creating & managing data ingestion pipelines based on the ELT (Extract, Load & Transform) model, at scale.
• You own defining Data Models, Transformation Logic & Data Flow in your current role. Know-how of Logstash, Apache BEAM & Dataflow, Apache Airflow, ClickHouse, Grafana, InfluxDB/VictoriaMetrics, BigQuery.
• Understanding of Product Development Methodologies; we follow Agile methodology.
• Strong understanding with hands-on experience of data warehouses; a minimum of 4 years of experience in any data warehousing stack is a must.
• You have a knack for understanding data & can derive insights from it. Experience with any TimeSeries DB (we use InfluxDB & VictoriaMetrics) and Alerting /
• Anomaly Detection Frameworks.
• Visualization Tools: Metabase/ PowerBI/Tableau.
• Experience in developing software in the Cloud such as GCP / AWS.
• A passion for exploring new technologies and express yourself through technical

blogs.

Here’s what your day would look like...

• As a SSE in the Data Fabric pod, you will play a crucial role in driving the development of innovative data solutions at IDfy. You would be working on the Data Fabric platform which provides Data as a service (DaaS) and Insight as a service (IaaS) for people at IDfy and customers of IDfy.
• You will oversee the design, development, and implementation of software components that power our data platform. Your leadership and technical expertise will be instrumental in ensuring that our data solutions meet the highest quality, efficiency, and scalability standards. The Data Fabric platform is the backbone for our Insights, Analytics & Invoicing needs at IDfy, it serves a whopping 150TB reads/month, and close to 700M rows are ingested via the platform.
• Architecting & implementing Data Pipelines & Frameworks to provide a better developer experience for our dev teams. Helping other PODs in IDfy define their data landscape and onboarding them onto our platform.
• Manage the platform and its scale. Optimize the infrastructure for cost as we scale. Provide guidance and support to your team members, helping them to develop their skills and grow professionally.
• Track project progress, identify risks, and develop contingency plans to ensure that projects pass the IDfy quality gates and are delivered on time and within budget.
• Keep abreast of the latest trends and technologies in Data Engineering, GenAI, and Data Science.