1
00:00:05,620 --> 00:00:13,390
In this lesson, we are going to talk about the problem of lack of reproducibility and the evaluation

2
00:00:13,390 --> 00:00:15,280
of LM applications.

3
00:00:21,430 --> 00:00:29,080
This is a problem that we have been talking about a in several occasions during this program.

4
00:00:29,080 --> 00:00:34,060
So I am not going to spend a lot of time with it now.

5
00:00:35,100 --> 00:00:44,100
So it is due to the problem of lack of reproducibility that evaluation LM applications is complicated.

6
00:00:44,190 --> 00:00:45,780
What is the problem?

7
00:00:46,320 --> 00:00:54,030
The problem is like is that unlike traditional applications, an LM application does not always provide

8
00:00:54,030 --> 00:01:02,130
the same output for the same input, and for this reason, traditional tests are not suitable for evaluating

9
00:01:02,130 --> 00:01:05,040
the quality of an LM application.

10
00:01:05,129 --> 00:01:13,740
So you will see that the testing solution for LM applications are very different from the testing solutions

11
00:01:13,740 --> 00:01:18,510
that you may know for conventional software applications.

12
00:01:18,510 --> 00:01:21,090
We will see more about that later.

13
00:01:22,360 --> 00:01:31,000
So let's talk now in the next lesson about the life cycle management, which is a terme that you probably

14
00:01:31,000 --> 00:01:37,600
are going to find often when you are shopping around LM ops solutions.