Staff Software Engineer, Inference Routing
Polargrid is hiring for the position of Staff Software Engineer, Inference Routing as a remote role open to applicants in Canada. It is listed as a full-time, staff/principal-level position.
DGJ summary of this job
Our own short read of this listing, built only from the facts it gives. The employer’s original text follows further down.
Polargrid is hiring for the position of Staff Software Engineer, Inference Routing as a remote role open to applicants in Canada. It is listed as a full-time, staff/principal-level position.
The advert names Rust as a skill for this role.
The listing gives the pay as C$220,000 - C$265,000 per year.
Dev Global Jobs found this job on Himalayas on Nov 18, 2026; applications close on Jan 17, 2027.
- Employer
- Polargrid
- Location
- Remote (Canada)
- Job type
- Full-time
- Level (from the title)
- staff/principal-level
- Pay
- C$220,000 - C$265,000 per year
- Found
- Nov 18, 2026 on Himalayas
- Closes
- Jan 17, 2027
- Employer text
- 316 words, about 1 min to read
- Apply only on the official page (himalayas.app). Dev Global Jobs is not the employer and never asks for a fee.
- Mirror the skills the advert names (Rust) in your CV where you really have them; applicant tracking systems look for these words.
- Plan to apply before Jan 17, 2027.
- Read the employer’s full text below (about 1 min) before you apply.
- Build or check your CV with the free DGJ CV Builder.
DGJ Insight
Our own data about this role and place, from official statistics and our live job index.
Source: OECD Average annual wages, 2025
About the role
Full text from the employer, as published on Himalayas, arranged into sections. Nothing added or removed.
01About PolarGrid
PolarGrid is an early-stage Canadian company that runs managed AI inference. Customers bring their own models, and we run them as fast, reliable production endpoints on GPU servers across many sites. We are a small team of about five engineers.
02The role
You will own the routing layer: the service that decides which GPU serves each request. You will build it, run it in production and set its technical direction.
This is a hands-on staff role. Most of your time goes to designing and writing the router and the placement logic behind it. You will work closely with the engineers who run our network and our GPU sites, and you will help hire the engineers who join you.
03The work
Every request has to land on a GPU that is healthy, has room and is close enough to be fast. The hard part is that capacity and health change constantly across many sites, and the router has to make good decisions quickly with information that is always slightly out of date. It also has to fail safely: when a site or server goes down, traffic moves without customers noticing.
04What you bring
Deep knowledge of how networks, proxies and load balancers work underneath, from building or running production systems.
Strong distributed systems fundamentals: consistency, failure handling, retries and backpressure.
You write production code in a systems language such as Go or Rust.
You measure latency at the tail, not just the average, and know how to find where it comes from.
You have been on call for what you built.
You have set technical direction that other engineers built on.
05You write clearly
You use AI tools well and check their work.
You do not need GPU or ML experience. What matters is that you understand the systems underneath deeply and want to build a new one from the start.
Originally posted on Himalayas
Ask CSI about this job
Answers link to jobs and tools on Dev Global Jobs.
Review Dev Global Jobs
Used this site to find a job? Tell other job seekers what worked and what did not.