Senior AI Platform Engineer

BH-49514
  • $150,000-$250,000 per annum
  • Boston, United States
  • Permanent
Senior AI Platform Engineer

A leading financial services organisation is building a firm-wide AI Engineering capability to enable productivity and advanced agentic solutions for developers, business teams, and end users. This role focuses on designing and delivering a secure, scalable, and compliant AI platform that supports enterprise-wide adoption of AI technologies.

Responsibilities
  • Design, build, and operate the core AI platform, including managed LLM inference services such as Amazon Bedrock
  • Manage model access, versioning, and intelligent routing across foundation models
  • Develop and maintain shared integration layers including MCP servers, registries, gateways, and authorization services
  • Build AI data pipelines and dashboards to track usage, adoption, and cost efficiency
  • Design infrastructure supporting AI-assisted developer environments, office productivity tools such as Microsoft 365 and Excel, and agentic AI frameworks
  • Develop reusable AI components including RAG pipelines, vector databases, and model integration patterns
  • Deliver scalable, production-grade platforms that are easy for engineering teams to adopt
  • Embed security controls across the full AI lifecycle in partnership with Security Engineering
  • Implement safeguards to prevent unsafe or destructive agent behaviour, including IAM policies, sandboxing, and network restrictions
  • Enforce a default-deny security model with strict access controls and human approval workflows for sensitive actions
  • Build pre-execution guardrails using policy engines and validation hooks
  • Ensure secure infrastructure boundaries using VPC endpoints and PrivateLink with no public internet egress
  • Maintain full auditability, traceability, and regulatory compliance across AI systems
  • Enable self-service onboarding for teams with role-based access controls
  • Implement cost management frameworks including quota management, usage tracking, and chargeback models
  • Operate centrally managed AI services across the organisation
  • Define and promote reference architectures and best practices
  • Support consistent and scalable adoption of AI across the firm
Qualifications and Experience
  • 10+ years of experience in platform, infrastructure, or systems engineering
  • Proven experience building and operating enterprise-scale platforms across AWS and on-prem environments
  • Hands-on experience running LLM-based workloads in production
  • Strong expertise in Amazon Bedrock and Azure OpenAI
  • Experience designing MCP servers, registries, gateways, and authorization flows
  • Experience building agentic AI systems including tool use, function calling, RAG, and human-in-the-loop workflows
  • Proven ability to build developer-facing platforms with a focus on usability, reliability, and standardisation
  • Strong background implementing AI security controls in regulated or high-security environments
  • Excellent communication and stakeholder management skills
  • Ability to collaborate across security, application, and infrastructure teams
Mikhil Dodhia Senior Consultant

Apply for this role

Take your career up a notch