Hello everyone.
In today's video, I will cover haystack.
The reason haystack is important in the guardrails is because I'm running a lot of matrix based guardrails
on haystack framework.
You can choose any other framework that you wish.
Conceptually, it's just a framework.
It's an orchestration layer that will help you run underlining models and give you some prompts that
are pre-built, but conceptually, they all work very similarly in different frameworks.
Another very popular framework is Lang Chain.
I chose to do this in haystack.
So now let's go quickly understand what is haystack?
Haystack is an open source framework by deep set for building production ready applications, retrieval,
augmented generative pipelines, and state of the art search systems that work intelligently over large
document collection.
What are the features that haystack offers?
It's technology agnostic allow users the flexibility to decide what vendor or technology that they want,
and make it easy to switch out any component for another.
Haystack allows you to use and compare models available from OpenAI.
Cohere.
Hugging face as well as your own local models or models hosted on Azure, bedrock and SageMaker.
It is very flexible.
Haystack provides all tooling in one place.
It always acts as file conversions, cleaning, splitting, training, inference, and more.
And whenever custom behavior is desirable, it's easy to create custom components.
It's very extensible, provides a uniform and easy way for community and third parties to build their
own components and foster an open ecosystem around haystack.
So let's run all the evaluators and matrix in this section on the haystack framework.
I will go through how you can install haystack, and then we'll quickly run different metrics on the
haystack framework.
Thank you.
And I'll see you in the next video.