Where the LLM can come from
Training and model files
Templates in s3://kmai1km-templates
InferenceServices on instdb2 (11)
Storage and models
Tenant (aiservice-inst-user)
AI Service (aiservice-inst)
MAS Core + Manage
Who asks
tools/call
MCP
REST as key user
AI broker
training export
templates
reads template
deploys
-gpt configs
holds
pipeline.yaml
writes model
loads
5 need it for every answer
3 for training only
today
model swap
same API, on-cluster
not supported
lab patch
APP Maximo Assistantchat in Manage
APP Role-based appssimilar WOs, classification
CLIENT MCP clientsControl Room, IDE agents
CR AiCfgsuite AI config
POD ALM agentplans multi-step asks
POD MCP serverinst-mcp, McpiCfg
APP ManageAI configurations,mxe.int.aibroker props
SETTING Training dataqueries + filters
POD AI broker APItenantid + apikey
POD km-controllerbuilds models
POD km-storetemplate catalog
POD km-watcher
SECRET wx-secretwatsonx key, URL, project
CR KServe predictorsone per AI configuration
CR almwatsonx predictorLLM proxy
STORAGE Object storagekm-s3-secret: templates,training data, logs
EXTERNAL watsonx.aifoundation models
EXTERNAL IBM entitled registrypredictor images
CR TICKETSIMILARITY[email protected]● runs locally
CR WOSIMILARITY[email protected]● runs locally
CR WOPROBLEMCODE[email protected]◐ watsonx for training
CR RSSTRATEGYASSISTANT[email protected]○ needs watsonx
CR MREF_LEASE_ABSTRACT[email protected]○ needs watsonx
CR IBMDOCS[email protected]○ needs watsonx
CR PLUSGINCTYPE[email protected]◐ watsonx for training
CR PLUSGINCIDENTGROUP[email protected]◐ watsonx for training
CR INSIGHT[email protected]○ needs watsonx
CR ASSISTANT[email protected]○ needs watsonx
CONFIG docsearch 1.0.5data/data.parquet.zip + manifest.json · 20 args
CONFIG fieldextractor 1.0.2manifest.json · 8 args
CONFIG fmea 1.3.2-gptmanifest.json · 30 args
CONFIG insightsgenerator 1.3.2-gptmanifest.json · 15 args
CONFIG mcc 1.7.1-gptmanifest.json + pipeline.yaml · 22 args
CONFIG nl2oslc 1.4.2-gptmanifest.json · 36 args
CONFIG pcc 1.8.2-gptmanifest.json + pipeline.yaml · 17 args
CONFIG similarity 1.1.1manifest.json + pipeline.yaml · 11 args
POD TICKETSIMILARITY trainingpipeline pod
STORAGE s3://kmai1170a6fe0ba8611fmodel files
POD WOSIMILARITY trainingpipeline pod
STORAGE s3://kmai11e421fb0ba8611fmodel files
POD WOPROBLEMCODE trainingpipeline pod
STORAGE s3://kmai1899753a0ba9711fmodel files
STORAGE s3://kmai193828120ba8b11fmodel files
STORAGE s3://kmai1c7d9db80ba8b11fmodel files
STORAGE s3://kmai1c8eb99a0ba8b11fmodel files
POD PLUSGINCTYPE trainingpipeline pod
STORAGE s3://kmai1d8d5d870ba9611fmodel files
POD PLUSGINCIDENTGROUP trainingpipeline pod
STORAGE s3://kmai1dd3f2600ba9611fmodel files
STORAGE s3://kmai1f958f320ba8c11fmodel files
STORAGE s3://kmai1fe613fd0ba8c11fmodel files
EXTERNAL watsonx.ai SaaSIBM Cloud · todaysupported
EXTERNAL Other watsonx modelsLlama · Mistral · Granitemodel swap
EXTERNAL watsonx.ai softwareon your cluster · Hugging Face modelssupported · data stays
EXTERNAL Claude / ChatGPTAnthropic · OpenAI APIsnot supported
EXTERNAL Local open modelOllama / vLLMlab only