Building Local AI Using Ollama and Spring AI
Build local AI applications with Ollama and Spring AI, from model setup and prompts to tools, streaming, and multimodal features.
- Difficulty
- Intermediate
- Duration
- ~22 hours
- Modules
- 10 modules
- Lessons
- 40 lessons
What You'll Learn
- Explain how local inference works and run models with Ollama.
- Build Spring AI applications with prompts, structured output, and conversation memory.
- Generate embeddings and build vector-search and retrieval-augmented generation workflows.
- Connect AI models to application capabilities using tool and function calling.
- Develop advanced, streaming, and multimodal AI application patterns.
- Evaluate model selection, resource requirements, and application trade-offs.
Prerequisites
- Basic Java programming and familiarity with Spring Boot, including application structure and dependency injection; the examples use Java 25 and Maven.
- Basic understanding of REST, HTTP, and JSON.
- Ability to use a command-line terminal.
- A computer on which Ollama and the course models can be installed; requirements vary by model and machine.
Course Curriculum
Module 1: Introduction to Local AI and Ollama
FREE preview
3 lessons
Module 2: Getting Started with Spring AI
PRO
2 lessons
Module 3: Prompt Engineering and Structured Output
PRO
3 lessons
Module 4: Conversation and Memory
PRO
4 lessons
Module 5: Embeddings and Vector Search
PRO
6 lessons
- 1Understand Embeddings and Embedding ModelsSign in to access
- 2Generate Embeddings with Spring AISign in to access
- 3Compare Vectors and Interpret SimilaritySign in to access
- 4Understand Vector Search and Storage ChoicesSign in to access
- 5Use Spring AI Document and VectorStoreSign in to access
- 6Build Semantic Search with SimpleVectorStoreSign in to access
Module 6: Building RAG Applications
PRO
7 lessons
- 1RAG Ingestion and Spring AI DocumentsSign in to access
- 2Ingest and Search a Knowledge FileSign in to access
- 3Chunk Documents with TokenTextSplitterSign in to access
- 4Choose Chunk Boundaries and Preprocess ContentSign in to access
- 5Tune Search and Filter MetadataSign in to access
- 6Build Manual RAG and Diagnose FailuresSign in to access
- 7Use QuestionAnswerAdvisorSign in to access
Module 7: AI Tool and Function Calling
PRO
4 lessons
Module 8: Building Advanced AI Applications
PRO
4 lessons
Module 9: Streaming AI Responses
PRO
4 lessons
Module 10: Multimodal AI and Model Selection
PRO
3 lessons