We are looking for a Senior AI Platform Engineer to build and own our company-wide AI platform from the ground up – a reliable, secure, and cost-transparent foundation that empowers every team to leverage LLMs and delegate work to autonomous AI agents. In this role, you will take full ownership of the platform’s core architecture and drive internal adoption across the entire company. You will lead the delivery of our internal LLM gateway as the single entry point for all model providers – complete with team quotas, cost tracking, and automated failovers – while establishing an observable shared platform with monitoring and alerting. In parallel, you will ship native internal SDKs for our primary tech stacks, deploy an Agent Control Plane enabling teams to orchestrate and track autonomous workflows, and partner directly with internal squads to turn high-impact business use cases into production-grade solutions.
Responsibilities
Architect, build, and operate the internal LLM Gateway, including routing, rate limiting, quotas, cost tracking, and automated fallbacks.
Design and build the agent control plane, covering agent creation, context management, task execution, and state tracking.
Build and maintain internal SDKs to simplify LLM integration across teams.
Implement platform observability, monitoring, alerting, tracing, and evaluation of LLM and agent workflows, including latency, token usage, costs, and failovers.
Implement security and governance for LLM usage and AI agents.
Collaborate with internal teams to translate business needs into working AI solutions and drive AI adoption.
Evaluate build-vs-buy options and integrate relevant open-source tools where appropriate.
Requirements
5+ years of experience in backend development.
Strong proficiency in Python or another modern backend language (Go, TypeScript, Rust), with a willingness to work with Python as our primary platform language.
Deep understanding of distributed systems (async queues, rate limiting, retries, circuit breakers, failover mechanics).
At least 1 year of hands-on experience working with AI/LLM-based solutions.
Practical experience with LLM APIs (OpenAI, Anthropic, Gemini): streaming, tool calling, context management, and rate limits.
Hands-on experience building AI agents or agentic workflows.
Solid knowledge of observability (metrics, logs, tracing),
Experience with Docker, Kubernetes, and Cloud (AWS or GCP).
Strong logical thinking, high ownership, initiative, and product mindset.
English – Intermediate or higher.
Ukrainian – Advanced.
Will be a plus
Experience building developer platforms, internal tooling, API Gateways, or SDKs.
Hands-on experience with MCP (Model Context Protocol), RAG pipelines, or vector databases.
Experience with LLM observability and evals tools (Langfuse, LangSmith, OpenTelemetry).
Active personal AI adoption (demonstrated use of AI tools/agents to automate own workflows).
Degree in Computer Science, Software Engineering, or a related field.
We offer
20 paid vacation days per year
10 paid sick leave days per year
Public holidays as per the company’s approved Public holiday list
Medical insurance
Opportunity to work remotely
Professional education budget
Language learning budget
Wellness budget (gym membership, sports gear and related expenses)
... faster, smarter outcomes. SentinelOne is building a new AI Platform team whose mission is to accelerate AI feature delivery across the company while ensuring every AI feature meets our security, cost, and quality standards. We are looking for a Principal AI Platform Engineer / Principal Software Engineer focusing on AI/ML, to ...
Merck seeks a Senior AI/ML Platform Engineer to own cloud infrastructure, CI/CD, and platform tooling for generative AI and NLP applications supporting drug discovery and development. The role combines infrastructure design, operational excellence, and cross-functional collaboration with data scientists and engineers in ...
... O pozici / o projektu Původní popisek. Stabil hátterű, nemzetközi technológiai partnerünk csapatába keresünk új kollégát Budapestre Senior Python Software Engineer – AI/ML Platform & Infrastructure pozícióba. Szívesen dolgoznál egy komplex, nagyvállalati AI/ML szoftverplatform fejlesztésén? Olyan tapasztalt Python szoftverfejlesztőt ...
... Engineer to join Form3 on a contract basis as part of our AI Resilience & Security Enhancements programme. This is a hands-on role working closely with our engineering, platform and security teams. The main focus will be building security controls into our engineering platform and developer workflows. You’ll work across ...
... fulfillment centers, up to 100,000 orders a day in peak season. The platform is built in Prague. We are starting an AI domain inside our Data team, and we want an engineer who builds AI-first and knows that good AI needs good data. You will look across HR, Sales, Marketing and Operations for places where AI can save time or money. ...
... developing an AI-powered platform for automating data workflows and managing data across cloud and on-premises environments. The role combines Python development, AI/LLM integration, data engineering, and cloud technologies. Responsibilities: - Develop and maintain Python-based applications and REST APIs. - Integrate AI/LLM ...
... organizacji staje: od repozytoriów kodu i CI/CD, przez repozytorium artefaktów i analizę jakości kodu, prywatne maszyny deweloperskie w chmurze, centralne logi, platformę testów end-to-end, aż po narzędzia AI wspierające development i bramę dostępu do modeli LLM. Pracujemy w AWS, z GitHub i GitHub Actions, Terraformem i Pythonem; ...
... skills; able to align diverse stakeholders. - Leadership & mentorship - Proven ability to influence without authority, set technical direction, and raise the engineering bar. - Experience mentoring senior engineers and shaping technical culture. - AI‑curious / AI‑pragmatic - Experience or strong interest in using AI/LLMs ...
... wytwarzania oprogramowania, - wsparcie migracji repozytoriów pomiędzy platformami Source Code Management / CI/CD, - tworzenie automatyzacji, również z wykorzystaniem AI, wspierających migrację repozytoriów, - współpracę z zespołem Platform Engineering oraz innymi zespołami developerskimi przy automatycznych i manualnych migracjach, ...
... it. As the senior engineer you own the SDK: the client library that application developers use and the platform side contracts behind it. You also set the engineering bar for every application the team ships. The team is deliberately small, so you build as well design. Detail pracovní nabídky - Ihned - Placená dovolená: ...