1
00:00:05,200 --> 00:00:13,060
In this lesson, we are going to talk about some advanced concepts around the rack technique.

2
00:00:18,840 --> 00:00:27,030
So the most important thing we want to share you a share with you at this point is that the rack technique

3
00:00:27,030 --> 00:00:31,890
has different levels of, uh, optimization.

4
00:00:32,159 --> 00:00:41,040
You have the basic technique, the basic, uh, steps, which as you saw, are very simple.

5
00:00:41,040 --> 00:00:48,150
And then you have some advanced techniques in order to optimize each of these steps.

6
00:00:48,150 --> 00:00:57,810
So you will see in the attached materials that we include a document with an introduction around some

7
00:00:57,810 --> 00:01:02,460
of these advanced, uh, techniques around rack.

8
00:01:02,460 --> 00:01:03,090
Okay.

9
00:01:03,090 --> 00:01:09,870
So you will see that initially we talk about some advanced techniques around splitters.

10
00:01:10,350 --> 00:01:19,380
And we will tell you that you can use different techniques in order to create the chunks of text from

11
00:01:19,380 --> 00:01:21,090
the main private document.

12
00:01:21,090 --> 00:01:21,480
Right.

13
00:01:21,480 --> 00:01:30,000
You can use a technique like the character text splitter that uses a criterion to split the text into

14
00:01:30,000 --> 00:01:30,810
fragments.

15
00:01:30,810 --> 00:01:32,010
Just one criterion.

16
00:01:32,010 --> 00:01:35,460
For example, a new line character.

17
00:01:35,790 --> 00:01:36,510
Uh uh.

18
00:01:36,510 --> 00:01:44,250
Or you can use more advanced techniques, like for example, the recursive character text splitter,

19
00:01:44,250 --> 00:01:52,440
and in this case, uh, it uses one or several criteria to split the text into fragments.

20
00:01:52,440 --> 00:01:57,360
For example, we can use paragraph break and line break.

21
00:01:58,040 --> 00:02:06,050
This means it will first separate the fragments following the paragraph break criterion, and then if

22
00:02:06,050 --> 00:02:13,640
any of the fragments is larger than the established size limit, it will separate the fragments exceeding

23
00:02:13,640 --> 00:02:18,650
the maximum size using the second criterion, meaning the line break.

24
00:02:18,650 --> 00:02:26,840
Okay, so don't worry about this just to tell you that there are some advanced techniques around the

25
00:02:26,840 --> 00:02:28,040
splitters.

26
00:02:28,040 --> 00:02:29,300
Uh, area.

27
00:02:29,300 --> 00:02:32,810
Second area, the retrieval area.

28
00:02:33,670 --> 00:02:41,410
In this area, you will see that there are different techniques that can help you, uh, with the performance

29
00:02:41,410 --> 00:02:42,790
of this area.

30
00:02:42,790 --> 00:02:50,380
I'm not going into detail because it's too early for you, but whenever you start using the rack technique

31
00:02:50,380 --> 00:02:56,590
in a professional stage, you are going to appreciate some of the tips we give you here.

32
00:02:57,100 --> 00:03:00,400
Third area vector databases.

33
00:03:00,490 --> 00:03:09,250
You are going to see here that creating a database associated with a private document each time is not

34
00:03:09,400 --> 00:03:10,690
the best way to work.

35
00:03:10,690 --> 00:03:20,950
So uh, you have here different approaches in order to create the vector database once and update this

36
00:03:20,950 --> 00:03:23,050
database every time you have a change.

37
00:03:23,050 --> 00:03:28,960
So you will have some comments, interesting comments in the, uh, attached materials around that.

38
00:03:28,960 --> 00:03:39,490
And finally you will have also an interesting note about how to use a technique, a long chain technique,

39
00:03:39,490 --> 00:03:44,350
in order to debug your applications in a clear way.

40
00:03:44,350 --> 00:03:52,750
So the purpose of this lesson is just to tell you that apart from the basic approach, uh, in the rack

41
00:03:52,750 --> 00:03:57,820
technique, you have some advanced, advanced, uh, approaches.

42
00:03:57,820 --> 00:03:58,150
Right.

43
00:03:58,150 --> 00:04:05,950
So in all the different areas of the rack technique, you can use the basic approach or the most, uh,

44
00:04:05,950 --> 00:04:07,630
advanced approach.

45
00:04:08,530 --> 00:04:11,290
When are you going to use each of them?

46
00:04:11,290 --> 00:04:18,519
Where in the proof of concept stage, you usually are going to use the basic approaches.

47
00:04:18,519 --> 00:04:26,170
And when you go into production stage is where you start, uh, you know, using the optimizing, uh,

48
00:04:26,170 --> 00:04:27,220
techniques.

49
00:04:29,600 --> 00:04:37,190
And in the next lesson, we are going to talk about some of the challenges that you will see with the

50
00:04:37,190 --> 00:04:38,180
rake technique.

