Forward Deployed Engineer AI Inference

01The Role

You will own the technical side of our largest and most complex inference deals, from first discovery call to go-live. You're the trusted technical counterpart for our customers' CTOs and ML leads, you design the setups that run their models, and you work hand in hand with our commercial team to get deals closed.

You'll be one of two senior technical owners of our inference deals. Together with our Inference Sales Engineering lead, you'll also turn what we learn in the field into a repeatable playbook and product.

02What You'll Do

• Own the technical side of our largest and most complex inference deals end to end, from discovery to go-live

• Be the senior technical counterpart for customers' CTOs and ML leads on architecture, sizing, SLAs, latency/throughput trade-offs and cost

• Design dedicated inference setups: model choice, GPU type and count, parallelism, quantization, inference engine and configuration

• Lead benchmarks and proofs of concept, and turn the results into clear recommendations

• Scope customer customizations with our engineering team and decide what becomes product

• Build the playbook and tooling for matching workloads to GPUs, and feed our roadmap with what you learn in the field

• Work in tandem with our commercial team on pricing, proposals and the technical parts of contracts

03What We're Looking For

• A degree in computer science, data science or a closely related field

• 4+ years in a customer-facing technical role, e.g. solutions or sales engineer, forward deployed engineer, ML engineer working closely with customers, or technical consultant

• Hands-on experience with LLM inference and model serving (e.g. vLLM, SGLang, TensorRT-LLM, Triton) and GPU sizing

• A track record of owning the technical side of complex B2B deals, ideally with enterprise customers

• You're credible with customer CTOs and engineers alike, and you explain trade-offs clearly

• Entrepreneurial mindset: give you an outcome, and you find a way without getting blocked

• Fluent English

04Bonus Points

• Experience at an inference provider, GPU cloud or AI infrastructure company

• Benchmarking and performance optimization: throughput, latency, cost per token

• Experience with quantization, parallelism strategies, KV-cache and batching

• Startup experience

• German

05Why us?

• Outstanding team: Work with some of the best engineers in the world, coming from hedge funds, big tech, AI startups and top universities

• Once in a lifetime opportunity: Early-stage company in the fastest-growing market in the world

• Ownership: Shape how European AI companies access GPU compute

• European mission: Build sovereign, GDPR-compliant AI infrastructure for the next generation of deep-tech

Find Jobs in Germany on Arbeitnow