Hello everyone and welcome.
In this video we will install Garrick and go over the CLI interface that Garrick offers.
Learn how to use Garrick, and also go over a couple of models that we will use in this section, where
we will run Garrick and find the vulnerabilities on those models.
So the very first thing that we would want to do is install Garrick on the CLI.
So for that I have opened a PyCharm and I have a terminal window open with windows PowerShell.
I have created a directory called Garrick.
And in here I'll go ahead and do pip install Garrick.
So if you notice it went through all the installation very quickly because I already ran this before.
However, if you run it for the first time, it will take at least 5 to 10 minutes for you to run on
your machine.
Very first command that I would run is Garrick List probe.
So in this scenario I'll have to put two hyphens.
Looks like I did something wrong.
So the command that I have to type is Garrick hyphen underscore probes.
This will list all the different probes that are offered for testing vulnerability on.
So let's come up a little bit.
And here okay.
So here you have all the different vulnerabilities like Dan checking spam encoding not answer file formats.
Latent injection leak reply malware.
So many of them prompt inject toxic prompts snowball and suffix topics XSS.
These are all inbuilt and the list keeps on growing.
So now we will use a couple of prompt probes here and see how we can use it for our use case.
Now before that, let me go ahead and open the model card for the model that we want to test these probes
on.
So one of the models that we want to test here is OpenAI's GPT two, which was the predecessor of GPT
three.
And it's available on Huggingface and it's freely available.
You don't have to pay for it.
If you notice here, it has all the details about the model.
And what I want to highlight here is the fact that this model is trained on public data, and it has
all the different vulnerabilities that you may not know.
This model has been released.
There's it's known a lot of out filter content from the internet, which is far from neutral.
So we would run our probes against this model and learn how we can expose the vulnerability here.
And we'll also go ahead and use the ChatGPT 3.5 and 4.0 models, where we can test the vulnerability
on those models.
Thank you.
And I will see you in the next video.