Dev Global Jobs
Technology

Backend Software Engineer, ML Inference

Prior LabsBerlin, GermanyFull-timeSalary not listed · Typical pay in GermanyPosted Nov 19, 2026

Prior Labs is hiring for the position of Backend Software Engineer, ML Inference in Berlin, Germany. The listing describes it as a full-time position.

Written by Dev Global Jobs

DGJ summary of this job

Our own short read of this listing, built only from the facts it gives. The employer’s original text follows further down.

Prior Labs is hiring for the position of Backend Software Engineer, ML Inference in Berlin, Germany. The listing describes it as a full-time position.

From the advert, the main requirements are 3+ years of experience.

The advert mentions Python, GCP, Kubernetes, Docker, Terraform, machine learning and PyTorch among the skills and tools for this role.

The employer does not state a salary in this listing; DGJ Insight below shows an official pay benchmark for the place where one exists.

Visa sponsorship is not mentioned. Applicants from outside Germany should check the official work permit route before applying.

Dev Global Jobs found this job on Arbeitnow on Nov 19, 2026.

Employer
Prior Labs
Location
Berlin, Germany
Job type
Full-time
Pay
Not stated by the employer
Experience asked
3+ years
Found
Nov 19, 2026 on Arbeitnow
Employer text
829 words, about 4 min to read
Skills named in the advert
PythonGCPKubernetesDockerTerraformmachine learningPyTorch
Before you apply
  • Apply only on the official page (arbeitnow.com). Dev Global Jobs is not the employer and never asks for a fee.
  • Compare your own experience with the 3+ years the advert asks for, and show it clearly near the top of your CV.
  • Mirror the skills the advert names (Python, GCP, Kubernetes and Docker) in your CV where you really have them; applicant tracking systems look for these words.
  • Read the employer’s full text below (about 4 min) before you apply.
  • Build or check your CV with the free DGJ CV Builder.
Only on Dev Global Jobs

DGJ Insight

Our own data about this role and place, from official statistics and our live job index.

Updated Nov 19, 2026
Pay benchmark
Average wage, Germany
EUR 54,840 average / year

Source: OECD Average annual wages, 2025

Cost of living · Berlin
79.3 vs New York = 100

UN living-cost index for Berlin (ICSC post adjustment 39.2), as of 1 Nov 2026.

Source: ICSC post adjustment classifications (icsc.un.org)

Work permit route
  • EU Blue Card: Recognised degree and a job offer above the salary threshold
  • Skilled worker visa (Fachkräfte): Recognised qualification and a job offer
  • Opportunity Card (Chancenkarte): Points-based job search for up to one year

Official routes: Make it in Germany (Federal Government portal)

Job description

About the role

Full text from the employer, as published on Arbeitnow, arranged into sections. Nothing added or removed.

01Who we are

Foundation models transformed text and images. Structured data - the largest and most consequential data format in the world - stayed untouched, until now. What LLMs did for language, we're doing for tables.

We pioneered tabular foundation models: TabPFN v2 was a Nature cover story, has passed 3.5M+ downloads and 7,500+ GitHub stars, and runs in production from detecting lung disease with Oxford Cancer Analytics to preventing train failures with Hitachi. The hardest problems - millions of rows, real-time inference, entirely new modalities - are still open, and no one else is working on them at this level.

We're a small, highly selective team of 40+ with backgrounds from Google, DeepMind, Meta, Apple, Amazon, Jane Street, and CERN, led by Frank Hutter, Noah Hollmann, and Sauraj Gambhir, and advised by Bernhard Schölkopf and Turing Award winner Yann LeCun.

In July 2026, less than 18 months after our €9M pre-seed, we joined SAP as an independent frontier AI lab - same team, mission, and open-weights models, now backed by more than €1 billion over four years.

About the role

You will have ownership over designing, building, and scaling the core systems that bring Prior Labs' foundation models to the world. This is a unique opportunity to make fundamental architectural decisions, establish engineering best practices from the ground up, and profoundly shape the technical direction for serving state-of-the-art AI.

TabPFN does its learning in the forward pass, and it now handles datasets in the millions of rows. Making that fast, reliable, and affordable is an exciting engineering challenge.

You'll work directly with world-class AI researchers, translating cutting-edge models into scalable production systems. This role offers significant autonomy and impact, with clear paths to specialize in areas you're passionate about (like inference optimization and core backend systems) or grow into a technical leadership position as our team expands. You won't just be implementing features; you'll be building the backbone of our company.

02What you'll work on

  • Own Inference: Own the serving path end-to-end: latency, throughput, batching, memory behavior on large inputs, and cost per prediction. Our models serve through our managed API, inside customer VPCs, and as self-hosted open weights, and you’ll have an impact across the board.

  • Architect & Design: Design robust, scalable, and secure backend systems and production-grade APIs for serving our foundation models.

  • Build & Implement: Develop high-quality, maintainable code for core backend services.

  • Own Infrastructure: Design, deploy, and manage core infrastructure on cloud platforms, focusing on reliability, monitoring, observability, and cost-efficiency.

  • Ensure Compliance & Security: Implement secure, GDPR-compliant systems, including data storage, access control, usage tracking, and quota management.

  • Champion Best Practices: Drive high standards for testing, CI/CD, documentation, and security within the engineering team.

03You may be a good fit if you have

  • 3+ years of professional experience in machine learning and backend engineering, with a proven track record of managing production infrastructure.

  • Proven experience deploying and operating machine learning models in production, with a strong understanding of how models behave and fail under real traffic.

  • Strong, hands-on experience designing and building production-grade APIs and backend services.

  • Significant experience building and operating services on cloud platforms, with GCP preferred.

  • Strong, hands-on experience with Infrastructure as Code (IaC) using tools like Terraform.

  • Significant experience with containerization and orchestration technologies (Docker, Kubernetes).

  • Proficiency in Python.

04What sets you apart

  • Experience building or managing infrastructure specifically for machine learning (MLOps, model serving frameworks, feature stores, data pipelines).

  • Deep experience with inference optimization (quantization, compilation, dynamic batching, caching strategies, interplay with distributed computing).

  • Experience with PyTorch and FastAPI specifically.

  • Contributions to relevant open-source projects.

05Life at Prior Labs

You'll work alongside researchers and builders who hold themselves to a very high bar - in the quality of their work and in how they work with each other. We move fast and still take the time to do things right.

Our teams are based in Berlin, Freiburg, and New York - when you're working on something as hard as TabPFN, being in the same room matters. But great people come from everywhere, and in exceptional cases we're open to remote, which usually means frequent travel to one of our offices. Wherever you're based, the whole company comes together regularly for offsites to build and celebrate together.

06Our Commitments

The best products and teams are built by people with a wide range of perspectives and backgrounds. We welcome applications from all identities and walks of life - especially if you've ever felt discouraged by "not checking every box" - and provide equal opportunities regardless of gender, sexual orientation, origin, disability, or any other trait that makes you who you are.

We care about how your data is handled - see our Recruiting Data Privacy page

Compensation: €100K, €210K • €20K, €280K Equity • Multiple Ranges

  • Europe | Berlin, Freiburg • €100K, €210K • €20K, €280K Equity
  • US | NY • $170K, $355K • $25K, $315K Equity

Find Jobs in Germany on Arbeitnow

CSI

Ask CSI about this job

Answers link to jobs and tools on Dev Global Jobs.

Get jobs like this

The best new matches, once a week. Free, one click to stop.

Community

Review Dev Global Jobs

Used this site to find a job? Tell other job seekers what worked and what did not.

Write a review on TrustpilotIt takes about two minutes↗