AI/ML Platform Engineer – Containers & GPU Infrastructure - Canada
A hands-on AI/ML Platform Engineer to build and run the infrastructure behind enterprise AI/ML services at a large financial services organization.
- Toronto, Ontario, Canada
- Contract
- Hybrid
- Posted Nov 4, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise SoftwareCloud & DevOps
Responsibilities
- Build, harden and maintain container images for AI/ML workloads including GPU-enabled images with NVIDIA drivers and CUDA
- Manage images in registries with versioning, vulnerability scanning and lifecycle controls
- Deploy, scale and support containerized AI/ML services on enterprise Kubernetes clusters
- Allocate GPU resources across containers and clusters
- Troubleshoot container runtime, networking, storage, performance and orchestration issues
- Automate container provisioning, configuration and lifecycle management
- Partner with application and platform teams to deploy containerized AI/ML services
- Support bare-metal GPU servers used for training, inference and production workloads
- Install, configure and troubleshoot NVIDIA GPU drivers, CUDA and NVIDIA AI Enterprise software
- Monitor GPU utilization, availability, performance and allocation
- Integrate GPU infrastructure with enterprise AI/ML platforms
- Design, build and maintain AI/ML platform services on Azure
- Build MLOps/AIOps pipelines for training and production models
- Support provisioning, administration, interoperability, disaster recovery and business continuity
- Troubleshoot Azure infrastructure, DNS, connectivity, NSGs and routing
- Build platform automation with Python, Terraform, GitHub Actions, Azure CLI and the Azure Python SDK
- Maintain Infrastructure as Code using Terraform and ARM templates
- Build and maintain CI/CD pipelines for infrastructure, container images and AI/ML services
- Develop and consume APIs, SDKs and webhooks to connect orchestration platforms with enterprise systems
- Work with cloud, network, cybersecurity and risk teams to deliver secure AI/ML solutions
- Keep cloud and container infrastructure compliant with internal policy and regulatory requirements
- Apply Azure security controls: authentication, RBAC and data protection
- Support PKI and certificate management for cloud services and applications
Requirements
- Experience in a Financial Services
Nice to have: Financial services organization experience, GPU scheduling, Utilization monitoring, Performance tuning, Azure AI services, Enterprise security, Regulatory compliance, Agile/Scrum, DevOps
Skills
Cloud platform engineeringAI/ML platform engineeringDockerKubernetesGPU infrastructureNVIDIA driversCUDANVIDIA AI EnterpriseMicrosoft AzurePythonTerraformIaCCI/CDGitHub ActionsNetworkingDNSRoutingCloud securityMLOpsModel deploymentKubernetesNVIDIA GPUAzurePythonTerraformGitHub ActionsDockerARM templatesCUDA
Full description
IT Accel, Inc
Company details are for members
Sign up for a free job alert to see IT Accel, Inc's profile, website and LinkedIn, and the same for every employer on Referso Jobs.