Software Engineer, Big Data

Who you are

• 2+ years of professional software development experience with a focus on Python and big data technologies
• Experience with Spark, Kafka, Hadoop, Hive, and/or other big data technologies
• Comprehensive computer science fundamentals in coding, object-oriented programming, data structures, and algorithms
• Experience with containerization technologies like Docker and/or Kubernetes
• 4+ years of professional software development experience, with a focus on Python and big data technologies
• BS/MS/PhD in Mathematics, Computer Science, Physics, related technical field or equivalent practical experience
• Experience with data integration tools like Apache Kafka, Flume, and NiFi
• Familiarity with data storage technologies such as Delta Lake, HBase, Cassandra, and MongoDB
• Familiarity with Apache Hudi, Apache Beam, Apache Flink, Google Cloud Dataflow, Amazon Kinesis Data Analytics, and/or Azure Databricks

What the job involves

• Our team has a unique opportunity to work on applications and data at scale, serving millions of jobseekers and tens of thousands of customers. We’re working on building an efficient marketplace of jobseekers and employers and need senior data engineers to build fast, scalable, and effective applications, stream and batch data processing, ML infrastructure and a variety of other systems all to help connect people to their next job. We provide an essential service and have a thriving business as a result
• Our stack is complex and we’re looking for engineers who know how to write evolvable, properly instrumented, and efficient code as part of a growing distributed system. We’re working on data driven systems and applications and need people who can build fast services and processes to power all of the intelligence we use to help change people’s lives
• Build data processing and exploration pipelines along with ML infrastructure to power our intelligence
• Deploy a range of cloud-based technologies for critical projects
• Write, test, instrument, and deploy code to our Kubernetes environment
• Help drive the innovation and evolution of ZipRecruiter