Manager, AI Platform Observability & Monitoring
At IMCO, our talent is among the best! IMCO offers a uniquely stimulating and rewarding environment where you can help build and drive organizational transformation, all while seeking to challenge yourself, learn, and grow your career.
Our culture is built on collaboration and passion, with a shared commitment to delivering lasting value to the clients we serve. Located in downtown Toronto, our vision is to be the partner of choice for Ontario’s public sector funds and to build a high-performing, value-driven asset management firm.
This job posting is for an existing vacancy. If you are ready to deliver best-in-class service and join a collaborative, motivated and fun team of professionals, IMCO offers the opportunity to do impactful work and broaden your expertise.
If you’re looking to use your expertise to drive strategic outcomes, we’d love to hear from you.
The Manager, AI Platform Observability & Monitoring owns the operational management and health of IMCO’s enterprise AI platforms, with a focus on observability, reliability, performance, usage and cost. The role establishes the monitoring, operational controls and support practices needed to run AI services effectively in production and provides visibility into agent and model behavior, platform performance and emerging operational risks. The role works closely with Architecture, Cybersecurity, AI Governance and technology teams to ensure AI platforms operate within established enterprise standards and guardrails.
Responsibilities:
AI Platform Operations & Observability
- Establish and manage enterprise observability and monitoring capabilities across Microsoft Copilot, Copilot Studio, Agent 365, Power Platform AI services, and future AI platforms.
- Establish and continuously improve monitoring and observability across AI platforms, models and agents, including performance, reliability, agent activity, usage and operational risks.
- Develop dashboards, alerts and KPIs that provide visibility into platform health, adoption, usage, capacity and cost.
- Identify and coordinate resolution of platform incidents and production issues, maintaining appropriate runbooks, support procedures and service expectations.
Platform Management & Controls
- Establish and maintain platform standards covering environments, connectors, capacity, solution management and enterprise use of Copilot Studio and Power Platform.
- Implement and operate platform controls and guardrails aligned with Architecture, Cybersecurity, AI Governance, Privacy and Technology Risk requirements.
- Maintain appropriate access, environment and platform management practices to support secure and scalable use.
- Partner with Architecture, Cybersecurity, Data Governance and AI Governance to ensure the platforms remain aligned with enterprise standards.
Solution Lifecycle and Operational Readiness
- Establish lifecycle and operational practices for AI and Power Platform solutions, including development, testing, deployment, release and production support.
- Maintain appropriate ALM, source control and deployment practices, including Azure DevOps integration where applicable.
- Lead operational-readiness assessments for solutions entering production, ensuring monitoring, support, recovery and ownership are in place.
- Manage platform releases, upgrades and changes and support the transition of new solutions into ongoing operations.
Service Management & Operational Insights
- Maintain visibility into AI consumption, licensing, platform capacity, costs, reliability and operational effectiveness.
- Provide management reporting and operational insights to support technology, governance and risk decisions.
- Manage operational relationships and service escalations with Microsoft and other relevant platform vendors.
- Evaluate emerging platform-management and observability capabilities that can improve the reliability and operation of IMCO’s AI environment.
What you need to succeed:
- 7+ years of experience in enterprise platform operations, cloud services, application operations or digital workplace technologies.
- Strong experience with the Microsoft ecosystem, including Microsoft 365, Azure, Power Platform and enterprise cloud services.
- Hands-on experience with Copilot Studio, Power Platform, enterprise AI platforms, conversational AI or agent-based solutions.
- Demonstrated experience with monitoring, observability, telemetry, incident management and operational reporting for enterprise platforms or applications.
- Experience with Application Lifecycle Management (ALM), DevOps, release management and production support practices.
- Experience establishing and operating platform controls, environment management, support models and operational standards.
- Strong understanding of service health, reliability, capacity, usage and cost management for cloud-based platforms.
- Demonstrated ability to work across Architecture, Cybersecurity, AI Governance, Risk and business teams.
- Strong problem-solving, stakeholder management and communication skills, with the ability to translate operational data into actionable insights.
Education & Certifications
- Bachelor’s degree in Computer Science, Information Technology, Engineering, Information Systems or a related discipline; equivalent relevant experience may also be considered.
- Relevant Microsoft certifications across Power Platform, Azure, Microsoft 365, Copilot Studio or AI are considered assets.
The base salary range for this position is CAD $105,000.00 - $138,000.00. The placement within the range is determined by the range of market pay for the specific position, as well as the candidate's knowledge, skillset and experience relative to the requirements of the position and to internal peers. In addition to base salary, this position is eligible to participate in IMCO's annual incentive plan. As a candidate, you are encouraged to ask compensation related questions and have an open dialogue with your recruiter who can provide you with the specific details for this position, as well as the total rewards offering at IMCO including our comprehensive benefits package and defined benefit pension plan.
We thank all applicants for their interest. Only those selected for an interview will be contacted.
Our hybrid work model prioritizes an office-first approach, encouraging employees to make the most of our collaborative workspace at 16 York Street, Suite 2400, Toronto, ON M5J 0E6. This welcoming environment fosters teamwork, connection, and professional growth. While flexibility remains a key component of our model, we believe that regular in-office engagement enhances productivity and strengthens our culture. Our approach supports a fulfilling lifestyle that balances professional ambition with personal wellbeing.
IMCO is committed to providing accommodation for people with disabilities throughout the recruitment process. If you require support, please let us know and we will work with you to meet your needs. Artificial intelligence (AI) tools may be used to support parts of our recruitment process, such as screening and assessments. However, all hiring decisions are made by our recruitment team. Candidates being considered for this position will be required to undergo background screening.
Required Skills
Required Languages
🇬🇧 English