RAG-LLM Evaluation & Test Automation for Beginners

Understand, Evaluate & Test RAG - LLM's (AI based Systems) from Scratch using RAGAS-Python-Pytest Framework
4.63 (228 reviews)
Udemy
platform
English
language
Other
category
instructor
RAG-LLM Evaluation & Test Automation for Beginners
2,987
students
8.5 hours
content
Apr 2025
last update
$84.99
regular price

What you will learn

How Custom Large Language Models (LLM) are designed using Retrieval Augmented Generation (RAG) Architecture

Common Benchmarks/Metrics used in Evaluating RAG based LLM’s

Introduction to RAGAS Evaluation framework for evaluating/test LLM’s

Practical Scripts generation to automate and assert the Metrics Score of LLM’s.

Automate Scenarios such as Single turn interactions and Multi turn interactions with LLM’s using RAGAS Framework

Generate Test Data for evaluating the Metrics of LLM using RAGAS Framework.

Create RAGAS Pytest Evaluation Framework to assert the Metrics of RAG- (Custom) LLM’s

Screenshots

RAG-LLM Evaluation & Test Automation for Beginners - Screenshot_01RAG-LLM Evaluation & Test Automation for Beginners - Screenshot_02RAG-LLM Evaluation & Test Automation for Beginners - Screenshot_03RAG-LLM Evaluation & Test Automation for Beginners - Screenshot_04
6367439
udemy ID
12/30/2024
course created date
2/7/2025
course indexed date
Bot
course submited by