Member of Technical Staff – AI Inference platform
Lyceum · Zürich
What this role requires
2 requirements, read out of the advert rather than guessed from the job title:
Also mentioned, not required: Prometheus, Grafana, OpenTelemetry, Kubernetes. Worth having, but their absence is not what gets a CV filtered out.
See how often each of these is required across open backend roles in Europe.
Free, no card. Tells you which of them your CV evidences and which it only implies.
Job description
Your mission
You will make Lyceum's AI inference platform reliable, secure, and scalable - ensuring it performs under pressure as we grow to thousands of concurrent users. While others on the team expand what the platform can do, your job is to make sure it keeps working, fails gracefully, and gets faster over time.
Your focus
Scalability: Architect and implement the systems that allow our inference platform to scale to thousands of concurrent users. This includes request routing, load balancing, autoscaling, and resource scheduling across GPU clusters.
Reliability and observability: Build robust monitoring, alerting, and incident response tooling. Design for graceful degradation, automatic recovery, and minimal downtime.
Performance engineering: Profile and optimise the full inference path from request ingestion through model execution to response delivery. Identify and eliminate bottlenecks at every layer.
Read the full description (27 more sections)Show less
Infrastructure evolution: Evaluate and integrate open-source inference frameworks and tooling (Dynamo, vLLM, Triton, etc.) where they improve throughput, latency, or stability of the serving stack.
Your KPIs
Platform uptime and availability (SLA adherence)
P50/P95/P99 latency and throughput under load
Time-to-detection and time-to-resolution for incidents
Scalability milestones (concurrent users, requests per second, GPU utilisation)
Your profile
We consider candidates from diverse backgrounds, with a deep love for technical challenges and the desire to take on ownership beyond what's reasonably expected.
Requirements
3+ years of experience in backend, infrastructure, or systems engineering
Strong proficiency in Go and Python
Experience building or operating a model serving platform or ML platform
Solid understanding of systems performance - profiling, benchmarking, and optimising latency and throughput
Familiarity with observability tooling (Prometheus, Grafana, OpenTelemetry, or similar)
Understanding of security fundamentals - network isolation, authentication, encryption, multi-tenancy
Nice to have
Experience with NVIDIA Dynamo or similar inference orchestration/routing frameworks
Hands-on experience with GPU serving infrastructure (vLLM, Triton, TensorRT-LLM)
Experience with Kubernetes in a production environment (deployment, networking, resource management)
Experience operating at scale (10k+ RPS, multi-region, multi-cluster)
Comfortable working on-call or in incident response when things break
Why us?
Outstanding team: Work with some of the best engineers in the world, coming from hedge funds, big tech, AI startups and top universities
Once in a lifetime opportunity: Early-stage company in the fastest-growing market in the world
Ownership: Shape how European AI companies access GPU compute
European mission: Build sovereign, GDPR-compliant AI infrastructure for the next generation of deep-tech
Find more English Speaking Jobs in Switzerland on Arbeitnow
You will apply. Then you will hear nothing.
And no one will tell you what was wrong. See it before you send: your ATS score, every weak line, and the fix for each.
- 1
Drop in your CV
One PDF, thirty seconds. No card.
- 2
See what is wrong with it
Every weak passage, quoted from your own CV, with the line to replace it.
- 3
Apply where you fit
Every European role ranked against what your CV actually says.
- Free, no card
- Your CV file is deleted after parsing
- Or skip the upload — build your profile by hand
- Refreshed every 6 hours