Software Engineer - Query Optimizer

Dremio

Santa Clara, CA, US
  • Job Type: Full-Time
  • Function: Engineering Software
  • Post Date: 04/03/2021
  • Website: dremio.com
  • Company Address: 883 N Shoreline Boulevard C100, Mountain View, CA, 94043

About Dremio

Dremio is the Data Lake Engine. Created by veterans of open source and big data technologies, and the creators of Apache Arrow, Dremio is a fundamentally new approach to data analytics that helps companies get more value from their data, faster. Dremio makes data engineering teams more productive, and data consumers more self-sufficient. For more information, visit www.dremio.com.

Job Description

Dremio is the Data Lake Engine company. Our mission is to reshape the world of analytics to deliver on the promise of data with a fundamentally new architecture, purpose-built for the exploding trend towards cloud data lake storage such as AWS S3 and Microsoft ADLS. We dramatically reduce and even eliminate the need for the complex and expensive workarounds that have been in use for decades, such as data warehouses (whether on-premise or cloud-native), structural data prep, ETL, cubes, and extracts. We do this by enabling lightning-fast queries directly against data lake storage, combined with full self-service for data users and full governance and control for IT. The results for enterprises are extremely compelling: 100X faster time to insight; 10X greater efficiency; zero data copies; and game-changing simplicity. And equally compelling is the market opportunity for Dremio, as we are well on our way to disrupting a $25BN+ market.

If you, like us, say “bring it on” to exciting challenges that really do change the world (no BS), we have endless opportunities where you can make your mark.


About the Role


System software engineers at Dremio own the development of the infrastructure and services that power Dremio’s Data Lake Engine.


Responsibilities

  • Build and improve Dremio's query optimizer.
  • Own the full cycle of development from inception, design, development, testing, and production.
  • Work on distributed systems for data processing, with efficient protocols and communication,  locking and consensus, schedulers, resource management, low latency access to distributed storage, auto scaling, and self healing.
  • Understand and reason about concurrency and parallelization to deliver scalability and performance in a multithreaded and distributed environment.
  • Use modular design patterns to deliver an architecture that’s rooted in simplicity, that’s easy to iterate on and constantly evolve.

Requirements

  • B.S. or M.S in Computer Science or in a related technical field or equivalent practical experience
  • Fluency in Java and/or C++ with 8+ years of experience developing production level software
  • Strong foundation in data structures, algorithms, multi-threaded and asynchronous patterns and their applications towards developing scalable systems
  • Passion for quality, zero downtime upgrades, availability, resiliency, and uptime of the platform
  • Experience developing scalable distributed systems and deploying, scaling, and managing microservices
  • Experience with  containers and kubernetes for orchestration and container management in private and public clouds (AWS, Azure, Google Cloud) a plus
  • Excellent understanding of distributed file systems like S3 or ADLS or HDFS a plus
  • Excellent communication skills and affinity for collaboration and teamwork
  • Interested in and motivated to be  part of a fast-moving startup with a fun and accomplished team
  • Startup experience a plus

Related Jobs

Site Reliability Engineer

Dremio - Santa Clara, CA, US

Software Engineer - Data Management & Processing

Dremio - Hyderabad, IN

Software Engineer - Dremio SaaS Service

Dremio - Hyderabad, IN

Software Engineer - Query Optimizer

Dremio - Santa Clara, CA, US

Outbound Product Manager

Dremio - Remote
Disclaimer: Local Candidates Only
This company does NOT accept candidates from outside recruiting firms. Agency contacts are not welcome.