1
00:00:05,260 --> 00:00:12,490
In this lesson, we are going to talk about the selection of orchestration frameworks.

2
00:00:19,420 --> 00:00:28,150
So as you know, right now the main orchestration frameworks are long chain and lambda index.

3
00:00:28,990 --> 00:00:32,710
Lansing is an open source framework.

4
00:00:32,740 --> 00:00:40,690
It facilitates the interaction interaction with one or more LMS at and.

5
00:00:40,690 --> 00:00:49,270
It has multitude of features from the simplest to the most sophisticated, such as load balancing,

6
00:00:49,270 --> 00:00:52,750
fault tolerance or security.

7
00:00:53,780 --> 00:00:57,530
Llama index is also an open source framework.

8
00:00:57,800 --> 00:01:07,220
It also has many functionalities similar to long chain and it has some exclusive functionalities like

9
00:01:07,220 --> 00:01:15,020
for example, the ability to interact with LMS in a distributed manner or the ability to interact with

10
00:01:15,020 --> 00:01:20,630
a broad ecosystem of tools including LAN chain, flask or Docker.

11
00:01:20,870 --> 00:01:26,330
This facilitates the deployment and scaling of applications.

12
00:01:26,420 --> 00:01:30,050
Why do we need orchestration frameworks?

13
00:01:30,860 --> 00:01:38,600
They allow the use of foundational arms in countless applications and with external data.

14
00:01:38,930 --> 00:01:43,310
They avoid the alternative of retraining them.

15
00:01:43,880 --> 00:01:51,410
They eliminate the limits of the context window with what we call the rag technique.

16
00:01:51,410 --> 00:01:53,660
We will see more about that later.

17
00:01:53,660 --> 00:02:03,350
They provide countless connectors for databases, cloud storage, and numerous external APIs, and they

18
00:02:03,350 --> 00:02:12,740
provide many pre-designed tools for frequent tasks like data extraction, transformation, and loading.

19
00:02:14,380 --> 00:02:16,540
What are the criteria?

20
00:02:16,720 --> 00:02:21,610
Uh, the main criteria for choosing the right orchestration framework.

21
00:02:23,580 --> 00:02:35,400
Easy, too easy of use, flexibility, scalability, reliability, and the existence of a support community.

22
00:02:35,520 --> 00:02:37,620
This is very important.

23
00:02:37,620 --> 00:02:41,400
The last one, the existence of a support community.

24
00:02:41,400 --> 00:02:50,100
Because as long as you have a big support community, you have a lot of projects available for you.

25
00:02:50,100 --> 00:02:59,220
You have a lot of people that can help you solve questions, excuse me, or doubts or problems, etc.

26
00:02:59,220 --> 00:03:08,760
so I repeat, the criteria for choosing the right orchestration framework would be ease of use, flexibility,

27
00:03:08,760 --> 00:03:14,190
scalability, reliability, and existence of a support community.

28
00:03:14,730 --> 00:03:25,320
We are going to give you our honest opinion of a long chain llama index, and also the alternative of

29
00:03:25,320 --> 00:03:30,750
OpenAI API in a in a in a next lesson.

30
00:03:30,750 --> 00:03:40,020
So we will apply our own judgment and we will give you our advice, uh, regarding the orchestration

31
00:03:40,020 --> 00:03:40,950
frameworks.

32
00:03:42,330 --> 00:03:46,110
So one last note.

33
00:03:46,790 --> 00:03:56,180
Apart from luncheon and a llama index, you have some alternative orchestration frameworks less popular

34
00:03:56,180 --> 00:04:02,600
right now, like prefect airflow, airflow, Luigi or Daxter.

35
00:04:02,750 --> 00:04:06,170
In our opinion, they are right now.

36
00:04:07,730 --> 00:04:09,740
Not very significant.

37
00:04:09,740 --> 00:04:19,130
And we will well, we we are going to focus our attention in launching Lambda Index and OpenAI.

38
00:04:19,160 --> 00:04:21,350
The API of OpenAI.

39
00:04:21,470 --> 00:04:30,080
But we wanted to tell you that there are other alternative alternatives in the market that right now

40
00:04:30,080 --> 00:04:33,140
are just for a minority.

41
00:04:33,140 --> 00:04:38,150
But in the next months or years, this situation can change.

42
00:04:38,150 --> 00:04:42,080
So it's interesting for you to understand that there are alternatives.

43
00:04:42,080 --> 00:04:49,340
Take a look at them and maybe try some of them for your experimental projects.

44
00:04:49,580 --> 00:04:59,480
So in this lesson we have talked a little bit about a the most important criteria in order to select

45
00:04:59,480 --> 00:05:01,970
your orchestration framework.

46
00:05:02,210 --> 00:05:10,160
In one next lesson, we are going to give you our honest opinion and recommendation about that.

47
00:05:10,940 --> 00:05:18,890
So before doing that in the next lesson, we are going to talk about some other interesting notes regarding

48
00:05:18,890 --> 00:05:23,120
the advanced architecture of LM applications.