Job Board
for underrepresented folks in tech

Back to all jobs
Photo of OctoML

emoji of a pushpinRemote - US emoji of a money bag$110,000 - $175,000
emoji of a woman of coloremoji of a man29 people in techemoji of a woman of coloremoji of a woman 5 women in techemoji of a woman of coloremoji of a person of color 11 people of color in techemoji of a rainbow 2 LGBTQIA+ folks in tech

OctoML applies cutting edge AI to make it easier and faster to put machine learning models into production on any hardware.

From the team that built the Apache TVM deep learning compiler stack, used
in production by top ML and hardware vendors, OctoML is automating the
deployment of machine learning models.


OctoML is an energetic new company changing how developers optimize and deploy machine learning models for their AI needs. We’re a team of machine learning systems leaders focused on making ML more efficient and easier to deploy by… applying machine learning to it!

OctoML was founded by the creators of Apache TVM, a popular open-source compiler that transforms ML models into highly-efficient binary code optimized for the specific hardware and model architecture. We are building the Octomizer, a cloud-based "TVM as a Service" product that enables developers to optimize and package their ML models through a modern web app as well as a rich API surface.

We dream big but execute with focus and believe in creativity, productivity and a balanced life. We value diversity in all dimensions. OctoML is growing fast and looking for infrastructure engineers to join the team!

Location: Onsite (post-pandemic) in Seattle, WA or Remote

As an Infrastructure Engineer, you will:

  • Work on a clean slate, modern development environment on mixed Kubernetes and cloud providers
  • Ensure System Reliability of our SaaS offering
  • Automate as many processes as possible using tools like Terraform
  • Own significant portions of our systems stack including:
  • Publicly available SaaS API endpoints
  • Continuous deployment (CI/CD)
  • Designing and implementing security best practices

Our ideal Infrastructure Engineer will have:

  • 2+ years of experience building and maintaining public-facing products or services
  • Experience working with cloud providers such as AWS, GCP, Azure
  • Experience with infrastructure automation using tools such as Kubernetes, Helm, Vault, Terraform, Docker, Gitlab
  • Knowledge of containerization and microservice architecture
  • Solid Linux knowledge
  • Experience with Rust, Python, Go, Elixir, or Haskell a plus but not required
  • Computer science, electrical engineering degree or related experience desirable but not required
  • Excellent verbal and written communication skills
  • Ability to empathize with co-workers and customers
  • Collaborative working style; able to self manage your time effectively

Our Benefits:

OctoML aims to provide the resources that employees need to be healthy and comfortable.

  • 4 weeks paid personal time off + company paid holidays and company downtime 2x per year
  • 100% employer paid premium (for employee and dependents) with a low-deductible plan
  • Family & Medical Paid Time Off (includes Maternity, Paternity, Adoption, among others)
  • Remote and telework setups for employees (post-COVID)
  • Flexible work hours

OctoML is committed to creating a diverse environment and is proud to be an equal opportunity employer. We hire based on an evaluation of abilities and effectiveness. We don't discriminate against employees on the basis of any other personal characteristic or any classification protected by federal, state or local law. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status.


The interview process starts with an initial phone screen from a senior member of our engineering org and is used primarily for you to engage with a member of the team to make sure the role is a good fit and for you to ask any questions you may have about the role, the org, or the company as a whole. From there, there is a technical take-home that is used to approximate the kind of work you would produce in a real work setting at OctoML. This take-home replaces a traditional "whiteboard coding," interview which most candidates agree is not a good experience, and which we do not believe is the best way to evaluate technical ability. After the take-home the last step is an interview loop with 4-6 Octonauts across the org where we evaluate for technical skill, communication, and role-specific qualifications. The interview loop is primarily dialogue driven, with the technical interviews being more about scenarios and talking through designs, with no whiteboard or live coding problems.


OctoML strives to create a welcoming and supportive workplace, with open and respectful communication, that nurtures opportunities and authenticity so that everyone can do their best work regardless of nation of origin, age, race/ethnicity, culture, belief, sex, gender, gender identity, sexual orientation, disability, veteran status, life experience or social background. We are committed to the following beliefs to guide our growth and success: - We are a better company when our people represent diverse backgrounds and life stories. - We thrive when ideas and contributions from all people are valued and encouraged. - An inclusive and diverse workforce is key to technical excellence, innovation, and market relevance.

Apply Now
When you apply, please mention that you found the posting on Diversify Tech!

Be the first to know!

We'll let you know as soon as a job is posted on our job board.

Subscribe →