05 Huggingface and Transformer

-

 Huggingface

While GPT models are accessed via OpenAI’s API, another popular option is Hugging Face.

·       Named after the popular emoji, Hugging Face was founded in 2016 as an open-source organization focused on natural language processing (NLP) and deep learning.

·       They provide tools and libraries that make it easier for researchers and developers to work with state-of-the-art NLP models.

o   This includes pre-trained models and tools for training your own models.

·       The most well-known package from Hugging Face is the Transformers library, which is widely used for working with large language models in Python.

o   The Transformers library provides a variety of pre-trained NLP models, including BERT, GPT-2, RoBERTa, and many others.

o   It offers a simple API to:

      • Load pre-trained models
      • Tokenize text
      • Make predictions or generate text

o   All of this can be done in just a few lines of code. You can also fine-tune pre-trained models on your own data for specific tasks such as:

      • Sentiment analysis
      • Named entity recognition
      • Text classification

·       Hugging Face provides tools and examples to guide you through this process. They also have a vibrant community of developers and researchers contributing to projects, along with extensive documentation and tutorials for getting started with different models.

·       Additionally, the Transformers library integrates seamlessly with popular deep learning frameworks like PyTorch and TensorFlow, making it accessible to a wide range of developers.

 

In short, the Transformers library simplifies working with large language models.

 


Comments

Post a Comment

Popular posts from this blog

19 Google ADK Tutorial

-
Image
  Google ADK Tutorial 1️ ⃣ What is Google ADK? Simple explanation: Google ADK (Agent Development Kit) is a framework to build smart AI agents that can: Work together (multi-agent systems) Call tools or APIs (like databases, web services) Evaluate their own outputs Be deployed into production easily Why use it: Easier to scale complex tasks Modular: break jobs into smaller specialized agents Built-in evaluation avoids hallucinations           2️ ⃣ Core Concepts Concept Simple Explanation Agent A single AI “worker” that can perform a task Multi-Agent System Multiple agents working together on one problem Orchestrator Brain that tells agents when to act and in what order Tools / MCP External functions your agent can call (like a skill database or API) Evaluation Bu...
Read more

15 Agent AI vs Agentic AI

-
Image
 Agent AI vs Agentic AI The difference between Agent AI and Agentic AI is subtle but important—it’s mostly about capabilities, autonomy, and how they interact with goals . Let’s break it down clearly: 1. Agent AI Definition: An AI system designed to perform tasks or act in an environment based on instructions or pre-programmed rules. Characteristics: Usually goal-directed but limited in autonomy. Operates within a constrained environment . Often relies on human input to decide what actions to take next. Examples: A chatbot that answers FAQs. A recommendation engine that suggests movies based on user history. A robot vacuum following pre-set rules to clean rooms. Key Point: It’s “an agent” in the sense that it can take actions, but it doesn’t really plan or self-direct beyond its instructions .   2. Agentic AI Definition: An AI system that demonstrates agency , ...
Read more

16 Build a Free Chat App on Google Colab using RAG

-
 16 Build a Free Chat App on Google Colab using RAG Note: This code has been corrected and the model used is not the best model. The model selection will depend on colab GPU and that can be explored and changed but this is a good starting point nonetheless to understand how things really work.  🔹 Step 1: Install Dependencies 👉 Paste this in a Colab cell: ! pip install - q transformers accelerate sentence - transformers faiss - cpu gradio pypdf 🔹 Step 2: Import Libraries from transformers import AutoTokenizer , AutoModelForCausalLM , pipeline from sentence_transformers import SentenceTransformer import faiss import numpy as np import gradio as gr from pypdf import PdfReader 🔹 Step 3: Load Free LLM (Lightweight) model_name = "google/flan-t5-base" tokenizer = AutoTokenizer . from_pretrained( model_name ) model = AutoModelForCausalLM . from_pretrained( model_name ) generator = pipeline ( "text2text-generation" , model = mode...
Read more