Senior Data Engineer

BetterCloud

Remote
  • Job Type: Full-Time
  • Function: Data Science
  • Post Date: 05/05/2021
  • Website: bettercloud.com
  • Company Address: 330 7th Avenue 14th Floor, New York, NY, 10001

About BetterCloud

BetterCloud secures user interactions across your digital workplace.

Job Description

BetterCloud has offices in New York, Atlanta, and San Francisco. We are currently seeking new talent in Salt Lake City, Denver, and Austin.

BetterCloud is the leading SaaS Management Platform (SMP) that enables IT professionals to discover, manage and secure the growing stack of SaaS applications in the digital workplace. With an expanding ecosystem of SaaS integrations, thousands of forward thinking organizations like Zoom, Walmart, and Square now rely on BetterCloud to automate processes and policies across their cloud application portfolio.

A pioneer of the SaaSOps movement, BetterCloud has built a community of more than 45K IT professionals who are embracing the new role of SaaSOps within IT organizations. The company launched the first-ever annual SaasOps-focused conference, Altitude, and publishes annually the definitive market research report, State of SaaSOps, on the market and category.

BetterCloud is headquartered in New York City with offices in San Francisco, CA and Atlanta, GA.  The company's total amount raised to date is $187 million. Investors include Warburg Pincus, Accel, Bain Capital Ventures, Flybridge Capital Partners, and Greycroft Partners.

BetterCloud is the leading SaaSOps platform that enables IT professionals to discover, manage and secure the growing stack of SaaS applications in the digital workplace. With an expanding ecosystem of SaaS integrations, thousands of forward thinking organizations like Zoom, Walmart, and Square now rely on BetterCloud to automate processes and policies across their cloud application portfolio.

A pioneer of the SaaSOps movement, BetterCloud has built a community of more than 45K IT professionals who are embracing the new role of SaaSOps within IT organizations. The company launched the first-ever annual SaasOps-focused conference, Altitude, and publishes annually the definitive market research report, State of SaaSOps, on the market and category.

BetterCloud is headquartered in New York City with offices in San Francisco, CA and Atlanta, GA.  The company's total amount raised to date is $187 million. Investors include Warburg Pincus, Accel, Bain Capital Ventures, Flybridge Capital Partners, and Greycroft Partners.

BetterCloud is seeking an enterprising individual to join the Platform Services team as a Sr Data Engineer. If you are eager to learn, want to accomplish challenging goals, and thrive in a work-hard/play-hard environment then this is the position for you!

Responsibilities

  • Primary responsibility for soundness of database pipeline design against standards for development, security and performance
  • Ownership of setting up process and frameworks to codify best practices -data extraction, transformations, load and data lake modeling and governance.
  • Provide and maintain portal for data analytics, metrics and query big data to help development teams
  • Work with multiple teams like development, product, security and BI to understand data sources and channel them into Data Lake.
  • Maintain Data Lake, Delta Lake, troubleshoot data source pipelines, handle scaling issues and be compliant with GDPR and Security. 
  • Work with API, Streaming systems and Databases to source high volume data and transform efficiently for business requirements. 
  • Create a Machine Learning Model to solve business operations problems like pattern or anomaly detection. And also develop many other models for in app features.
  • Responsible to develop and Maintain ML operations in production.
  • Responsible for anonymizing the data and creating test and training data for Machine Learning. 
  • Create and Maintain visual dashboards for data driven decisions.

Requirements

  • 4+ years experience with data lake design and operations. Working experience on Delta Lake.
  • 4+ years of experience with managing a high performance and highly scalable data pipelines
    • Deep experience with Spark, DataFlow, Flink, Hadoop on Cloud Storage, AirFlow, Presto, Hive, Data Catalog and other ETL tools
  • 3+ years experience Scala, Java, Python 
  • 2+ years of Query experience with technologies like Kafka, MySQL, ElasticSearch, BigTable and BigQuery 
  • 1+ years of experience with Scikit, TensorFlow Machine Learning frameworks
  • 1+ year of experience with data transformation/preparation using apache beam, wrangler or any other open source technologies. 
  • Experience with enterprise cloud offering in Big Data Services, Data Store options and ML/AI offering
  • Colleagues describe you as self-driven, fast-learning, and hardworking

Plus Skills (in order of priority)

  • Google Cloud Platform Services - GCS, DataProc, Data Prep, Composer, AI Platform, BigQuery and Security features like IAM, Secret Manager
  • Familiarity with Tableau or Looker or DataStudio 
  • Interest/awareness with Jenkins or any CI/CD pipelines to maintain Data and ML pipelines.
  • Familiarity with container orchestration Kubernates

Compensation | Benefits

  • Competitive base salary
  • Full benefits package
  • Stock Options
  • Career growth with an industry innovator

BetterCloud is an Equal Opportunity Employer, including disabled and vets.

Related Jobs

Sales Development Representative

BetterCloud - Atlanta, GA, USNew York City, NY, US

Implementation Specialist

BetterCloud - New York City, NY, USAtlanta, GA, USSan Francisco, CA, US

Legal Intern

BetterCloud - New York City, NY, US

Quality Assurance Analyst

BetterCloud - Atlanta, GA, US

Digital Marketing Manager

BetterCloud - Atlanta, GA, USNew York City, NY, USSan Francisco, CA, US
Disclaimer: Local Candidates Only
This company does NOT accept candidates from outside recruiting firms. Agency contacts are not welcome.