Ollama in Action: Building Safe, Private AI with LLMs, Function Calling and Agents

Preface

1. About the Author
2. Requests from the Author
3. Why Should We Care About Privacy?

Setting Up Your Computing Environment for Using Ollama and Using Book Example Programs

1. Python Build Tools

Using Ollama From the Command Line

1. Using JSON Format
2. Analysis of Images
3. Analysis of Source Code Files

Short Examples

1. Using The Ollama Python SDK with Image and Text Prompts
2. Using the OpenAI Compatibility APIs with Local Models Running on Ollama

LLM Tool Calling with Ollama

1. Example Showing the Use of Tools Developed Later in this Chapter
2. Tool for Reading and Writing File Contents
3. Tool for Getting File Directory Contents
4. Tool for Accessing SQLite Databases Using Natural Language Queries
5. Tool for Summarizing Text
6. Tool for Web Search and Fetching Web Pages
7. Tools Wrap Up

Automatic Evaluation of LLM Results: More Tool Examples

1. Tool For Judging LLM Results
2. Evaluating LLM Responses Given a Chat History
3. A Tool for Detecting Hallucinations
4. Wrap Up

Prompt Caching

1. Caching is Implicit with Ollama
2. Example Code to Show Caching Effectiveness
3. Wrap Up for Prompt Caching

Building Agents with Ollama and the Hugging Face Smolagents Library

1. Choosing Specific LLMs for Writing Agents
2. Installation notes
3. Overview of the Hugging Face Smolagents Library
4. Overview for LLM Agents (optional section)
5. Let’s Write Some Code
6. Output from Third Example: “Read the text in the file ‘data/economics.txt’ file and then summarize this text.”
7. Agents Wrap Up

Using AG2 Open-Source AgentOS LLM-Based Agent Framework for Generating and Executing Python Code

1. Example Implementation
2. Example Output
3. Wrap Up for Using AG2’s Agent Framework for Generating and Executing Python Code

Using the Unsloth Library on Google Colab to FineTune Models for Ollama

1. Colab Notebook 1: A Quick Test of Fine Tuning and Deployment to Ollama on a Laptop
2. Fine Tuning Using a Fun Things To Do in Arizona Data Set
3. Third Colab Notebook That Fine Tunes a Larger Model
4. Fine Tuning Wrap Up

Reasoning with Large Language Models

1. A Simple Example
2. Key Features of Marco-o1
3. A More Complex Example: City Traffic Planning

Using Property Graph Database with Ollama

1. Overview of Property Graphs
2. Example Using Ollama, LangChain, and the Kuzu Property Graph Database
3. Using LLMs to Create Graph Databases from Text Data

Using the Open Codex Command Line Interface Coding Agent

1. Example Use Cases
2. Open Codex Wrap Up

Long Term Persistence Using Mem0 and Chroma

1. Code Example Using Mem0 and Chroma
2. Example Output

Using Ollama Cloud Services

1. Ollama Cloud Services: Power and Knowledge on Demand
2. Augmenting Models with the Web Search API
3. Wrap-Up: A Unified Local and Cloud Strategy

Semantic Navigator App Using Gradio

1. Overview or Semantic Web and Linked Data
2. Design Goals for the Semantic Navigator App
3. Implementation of the Semantic Navigator App Using Gradio

Book Wrap Up