Software Engineer - Backend

Databricks

Amsterdam, NL
  • Job Type: Full-Time
  • Function: Engineering Software
  • Post Date: 06/02/2021
  • Website: databricks.com
  • Company Address: , San Francisco, CA

About Databricks

Databricks is focused on making Big Data easier than ever before by delivering a turnkey cloud platform built around Spark, the lightening-fast open source cluster computing framework.

Job Description

At Databricks, we are obsessed with enabling data teams to solve the world’s toughest problems, from security threat detection to cancer drug development. We do this by building and running the world’s best data and AI infrastructure platform, so our customers can focus on the high value challenges that are central to their own missions.

Founded in 2013 by the original creators of Apache Spark, Databricks has grown from a tiny corner office in Berkeley, California to a global organization with over 1000 employees. Thousands of organizations, from small to Fortune 100, trust Databricks with their mission-critical workloads, making us one of the fastest growing SaaS companies in the world.

Our engineering teams build highly technical products that fulfill real, important needs in the world. We constantly push the boundaries of data and AI technology, while simultaneously operating with the resilience, security and scale that is critical to making customers successful on our platform.

We develop and operate one of the largest scale software platforms. The fleet consists of millions of virtual machines, generating terabytes of logs and processing exabytes of data per day. At our scale, we regularly observe cloud hardware, network, and operating system faults, and our software must gracefully shield our customers from any of the above.

As a software engineer with a backend focus, you will work closely with your team and product management to prioritize, design, implement, test, and operate micro-services for the Databricks platform and product. This implies, among others, writing software in Scala/Java, building data pipelines (Apache Spark, Apache Kafka), integrating with third-party applications, and interacting with cloud APIs (AWS, Azure, CloudFormation, Terraform).

Below are some example teams you can join:

Jobs: Make it simple to put data engineering and machine learning workloads into production on Databricks. When customers crunch through petabytes of data, they do it with Databricks Jobs. With exponential growth of the service and the mission-critical requirements to support production workloads, the distributed architecture is expected to scale to 10x the current usage while making the service 10x more reliable. We are working on hard technical problems that span the full stack, including: distributed systems, at-scale service architecture and monitoring, workflow DAG optimizations, distributed computation, schedulers and UI.

Storage & IO: Deliver reliable and high performance services and client libraries for storing and accessing humongous amount of data on cloud storage backends, e.g., AWS S3, Azure Blob Store.

Billing & Usage Infrastructure: Build reliable, scalable services, e.g. Scala, Kubernetes, and data pipelines, e.g. Spark, Databricks, to power the pricing infrastructure that serves millions of cluster-hours per day and develop product features that empower customers to easily view and control platform usage.

Competencies

  • BS/MS/PhD in Computer Science, or a related field
  • 2+ years of production level experience in one of: Java, Scala, C++, or similar language.
  • Comfortable working towards a multi-year vision with incremental deliverables.
  • Driven by delivering customer value and impact.
  • Experience in architecting, developing, deploying, and operating large scale distributed systems.
  • Experience working on a SaaS platform or with Service-Oriented Architectures.
  • Good knowledge of SQL.
  • Experience with software security and systems that handle sensitive data.
  • Experience with cloud technologies, e.g. AWS, Azure, GCP, Docker, Kubernetes.

 Benefits

  • Awesome coworkers
  • Top of market compensation
  • 25 days of vacation
  • Catered lunch (everyday), snacks, and drinks
  • Gym reimbursement
  • Employee referral bonus program
  • Maternity and paternity plans 

Related Jobs

Engineering Manager

Databricks - Toronto, CA

Engineering Manager - Full Stack

Databricks - Amsterdam, NL

Engineering Manager - Next Generation Execution Engine

Databricks - San Francisco, CA, US

Engineering Manager - Platform

Databricks - San Francisco, CA, US

Software Engineer - Backend

Databricks - Amsterdam, NL
Disclaimer: Local Candidates Only
This company does NOT accept candidates from outside recruiting firms. Agency contacts are not welcome.