GenAI L11 - Ollama Installation & Setup (OpenSource and Local)

Duration: 12 min

This video lesson is available to enrolled students.

Return to /learn/CDAC-C-CAT-COMPLETE-PREPARATION/section-b-ai-big-data-basics/ai-ml-by-arun-sir/ollama/asset-genai-l11-ollama-installation-setup-opensource-and-local after enrolling

Inside: a video lesson and guided study material.

Module outline

  1. Section A | English: Vocabulary, Comprehension / Reading Comprehension / Unseen Passages (Critical Reasoning) (Paragraph Questions), Preposition, Sentence Correction (Error Correction), Sentence Completion (Fill in the blanks), Articles, Sentence Re-arrangements (Para Jumbles) (Narrative Sequencing), Verbal Analogy (Word Based Analogy)
  2. Section A | Quant Aptitude: Ratio and Proportion (Ratios), Mixture and Alligation, Permutation and Combination, Number System, HCF LCM, Sequence and Series (Series), Speed Time and Distance, Arithmetic, Algebra, Powers and Exponents (Surds and Indices), Average, Age Problems, Percentage, Profit and Loss, Partnership, Time and Work, Simple Interest and Compound Interest, Mensuration and Geometry, Probability, Pipe and Cistern
  3. Section A | Reasoning: Series (Number and Letter Series) (Numerical Relations and Reasoning), Coding Decoding, Data Sufficiency, Calendar, Clock, Blood Relations, Directions (Direction Test), Seating Arrangements, Ranking, Order and Sequence, Puzzle Solving (Puzzles)
  4. Section B | C Programming: C Programming by Yash Sir, Coding Questions by Yash Sir
  5. Section B | Data Structures: Algorithm Analysis, Greedy Algorithms, Time Complexity Analysis, Sorting Algorithms, Introduction to DS, Array, Stack, Queue, Linked List, Tree, Graphs
  6. Section B | OOP (C++): Object Oriented Programming (OOPS), Programming in C++
  7. Section B | OS: Introduction to OS, Process Management, CPU Scheduling, Process Synchronization, Threads & Process Creation, Deadlock, Memory Management, Virtual Memory, Disc Scheduling, File Management, Windows OS
  8. Section B | Networking: Introduction to CN, Data Communication, DLL: Access Control, DLL: Flow Control, DLL: Error Control, DLL: Framing, Data Link Layer - Ethernet, Net Layer: IPv4 & Proto, Net Layer: IP Addressing, Net Layer:Routing Protocol, Transport Layer Services, TL: Congestion & UDP, Application Layer, Hardware basics
  9. Section B | AI & Big Data Basics: AI & ML by Arun Sir, Big Data Systems
  10. Section C | Digital Electronics: Digital Systems & Boolean Basics, Logic Gates & Hardware, Boolean Expression, Boolean Minimization, Combinational Circuit, Sequential Circuits, Number System, Number Representation, Analog-Digital Conversion
  11. Section A, C | Comp. Fundamentals, COA: Basics of COA, Floating Point Rep, Cache Memory Organization, Input Output Organisation, Pipelining, Instr Formats & Modes, Control Unit Design, Register Transfer and Microoperations, Multiprocessors, Programming the Basic Computer
  12. MOCK TEST:
AI summary & chapters

AI Summary

An AI-generated summary of this video lecture.

This lecture introduces students to Ollama, an open-source tool for running large language models locally on personal computers. The session begins by guiding viewers to the official Ollama website via a Google search, emphasizing the importance of selecting the correct download source for their operating system. The instructor demonstrates the installation process on a Windows machine, walking through the setup wizard and handling necessary dependencies like the Microsoft Visual C++ Redistributable. After installation, students learn to verify their setup using PowerShell commands and proceed to download a specific model, gemma2:2b. The tutorial culminates in running the model via command-line interface to generate text about machine learning, showcasing how local AI tools can be integrated into development workflows without relying on cloud-based APIs.

Chapters

  1. 0:00 – 2:00 00:00-02:00

    The video opens with a Google search for 'ollama', directing students to the official website at https://ollama.com/. The instructor highlights download options for macOS, Linux, and Windows, specifically focusing on the 'Download for Windows' link. On-screen text confirms the requirement of Windows 10 or later, and the cursor navigates to initiate the download. This segment establishes the foundational step of acquiring the software from a trusted source before proceeding to installation.

  2. 2:00 – 5:00 02:00-05:00

    The installation phase begins with the user locating 'OllamaSetup.exe' in Chrome's download history. The setup wizard for version 0.15.1 launches, displaying a welcome screen that reads 'Let's get you up and running with your own large language models.' The process involves extracting files to the directory 'C:\Users\Arun\AppData\Local\Programs\Ollama' and automatically triggering the Microsoft Visual C++ 2015-2022 Redistributable installer. The instructor clicks 'Install' to complete the setup, ensuring all dependencies are resolved before the application is ready for use.

  3. 5:00 – 10:00 05:00-10:00

    Post-installation verification occurs via PowerShell, where the command 'ollama version' confirms the installed version as 0.15.1. The instructor then pulls a local model using 'ollama pull gemma2:2b', showing the download progress in the terminal. Once downloaded, 'ollama list' verifies the model's presence, and 'ollama run gemma2:2b' initiates an interactive session. The model responds to the prompt 'what is machine learning' with a definition about teaching computers without explicit programming, demonstrating the successful execution of a local LLM.

  4. 10:00 – 11:49 10:00-11:49

    The session concludes with further interaction using the Gemma2 model, including a query about 'gpt ai'. The terminal output displays educational content on machine learning applications such as image recognition and supervised learning. The instructor navigates to the Ollama library webpage for gemma2 to show model details like size (1.6 GB). Finally, the user types '/bye' to exit the Ollama session and returns to the standard PowerShell prompt, completing the tutorial on local model deployment.

The lecture effectively bridges theoretical concepts of open-source AI with practical implementation skills. By focusing on Ollama, the instructor provides a tangible method for students to experiment with Large Language Models without incurring cloud costs. The step-by-step progression from searching for software to verifying installation and running a model ensures that learners can replicate the process independently. Key technical takeaways include understanding command-line interactions for AI, managing local dependencies like CUDA libraries and Visual C++ redistributables, and utilizing the Ollama library for model discovery. The use of gemma2:2b as a demonstration model highlights the accessibility of smaller, efficient models for local testing. This foundational knowledge prepares students to explore more complex AI architectures and integrate them into their own projects using local hardware.

Loading lesson…