AI/ML Lead

About ISACAISACA® (www. isaca. org) champions the global workforce advancing trust in technology.

About ISACA ISACA ® (www. isaca. org) champions the global workforce advancing trust in technology.

For more than 55 years, ISACA has empowered its community of 195,000+ members with the knowledge, credentials, training and network they need to thrive in fields like information security, governance, assurance, risk management, data privacy and emerging tech.

With a presence in more than 195 countries and with more than 230 chapters worldwide, ISACA offers resources tailored to every stage of members’ careers—helping them to thrive in a rapidly changing digital landscape, drive trusted innovation and ensure a more secure digital world.

Through the ISACA Foundation, ISACA also expands IT and education career pathways, fostering opportunities to grow the next generation of technology professionals.

Overview The AI/ML Lead is a senior, hands-on engineer and the first member of ISACA 's AI implementation team, a new internal capability that will take on AI engineering work currently delivered by external vendors.

Reporting to the VP, Application Engineering, and working within the platform architecture, standards, and governance set by the Senior Director, AI Architecture, Platforms & Agentic Systems, this role builds and hardens the AI solutions that serve ISACA 's members and business, both those in delivery today and those that emerge as ISACA 's AI portfolio grows.

The initial focus is ISACA 's personalized member experience, a production RAG and knowledge graph-based recommendation system that integrates ISACA 's Body of Knowledge, certification details, workforce skills data, and member profile information.

The majority of the role is spent implementing: writing production code, building data and retrieval pipelines, and operationalizing the engineering practices that keep AI systems reliable.

Success is measured by production stability, the share of AI engineering work brought in-house, and the implementation team's growing ability to deliver ISACA 's current and future AI needs without vendor dependency.

Responsibilities AI Platform Technical Contribution Provide hands-on engineering for the development, integration, and production delivery of ISACA 's AI solutions, beginning with the AI-driven member experience, working within the platform architecture and standards set by the Senior Director, AI Architecture.

Build and maintain core AI components, including knowledge graph ontology and configuration (Graphwise or a comparable enterprise knowledge graph platform), embedding and retrieval pipelines, recommendation logic, and LLM-powered and agentic application components.

Implement the APIs and service contracts that connect AI capabilities to ISACA 's digital experiences and business systems. Ensure all components are built for reuse, long-term internal ownership, and maintainability.

AI Vendor Oversight & Insourcing Serve as the key internal technical counterpart to external AI development vendors and contractors.

Participate in vendor architecture reviews and review vendor code and pull requests, evaluating AI solution designs, including RAG pipelines, knowledge graph implementation, and LLM integration, against ISACA 's technical requirements and the engineering standards set by the Senior Director, AI Architecture.

Define and maintain acceptance criteria for vendor deliverables, support production readiness validation, and surface technical risk or delivery misalignment to the Senior Director, AI Architecture, and IT leadership.

Lead knowledge transfer so that vendor-built components move to internal ownership on a planned timeline, progressively reducing vendor dependency.

AI Engineering Practices & Operations Implement and operate MLOps and LLMOps practices in line with the platform standards set by the Senior Director, AI Architecture, including CI/CD for ML and LLM pipelines, model and prompt versioning, evaluation, monitoring, drift detection, and token cost tracking.

Establish team-level engineering pra