WEBVTT 1 00:00:00.000 --> 00:00:01.620 So now with that, 2 00:00:01.620 --> 00:00:03.990 we're almost ready to get started 3 00:00:03.990 --> 00:00:06.630 downloading and running models on our system. 4 00:00:06.630 --> 00:00:07.890 But before we do that 5 00:00:07.890 --> 00:00:09.480 and before we take a closer look 6 00:00:09.480 --> 00:00:12.720 at the hardware requirements you have to meet, 7 00:00:12.720 --> 00:00:15.330 it's important to talk about licenses 8 00:00:15.330 --> 00:00:17.130 because I mentioned earlier 9 00:00:17.130 --> 00:00:19.800 that when using open Large Language Models, 10 00:00:19.800 --> 00:00:21.180 when running them locally, 11 00:00:21.180 --> 00:00:24.150 especially when using them commercially though, 12 00:00:24.150 --> 00:00:27.390 you must make sure that you respect the license 13 00:00:27.390 --> 00:00:29.610 of the creator, of the provider 14 00:00:29.610 --> 00:00:31.050 of that Large Language Model. 15 00:00:31.050 --> 00:00:35.370 So the license created by Google for their Gemma models 16 00:00:35.370 --> 00:00:38.790 or Meta for their Llama models, for example. 17 00:00:38.790 --> 00:00:40.620 And you can find out 18 00:00:40.620 --> 00:00:43.410 which license applies to a certain model, 19 00:00:43.410 --> 00:00:45.510 for example, on Hugging Face, 20 00:00:45.510 --> 00:00:47.160 by going to the model card 21 00:00:47.160 --> 00:00:49.620 of the model you are interested in. 22 00:00:49.620 --> 00:00:51.210 And there at the top, 23 00:00:51.210 --> 00:00:55.863 you'll typically find this license badge here, 24 00:00:56.760 --> 00:00:59.520 which tells you which license applies to this model. 25 00:00:59.520 --> 00:01:01.920 In this case, for this Gemma-3 model, 26 00:01:01.920 --> 00:01:03.600 I opened as an example here, 27 00:01:03.600 --> 00:01:05.103 it's the Gemma license. 28 00:01:06.000 --> 00:01:07.980 And you can then click on this batch 29 00:01:07.980 --> 00:01:11.340 to view the underlying license file, 30 00:01:11.340 --> 00:01:14.610 which in this case leads us to Google's page here 31 00:01:14.610 --> 00:01:17.340 where you can go through that license 32 00:01:17.340 --> 00:01:22.140 to understand how you may and may not use this model. 33 00:01:22.140 --> 00:01:25.380 And of course there are many different licenses out there, 34 00:01:25.380 --> 00:01:28.980 but amongst the most important ones to be aware of 35 00:01:28.980 --> 00:01:33.060 are, for example, the MIT and Apache 2.0 licenses, 36 00:01:33.060 --> 00:01:36.720 which would be very permissive licenses. 37 00:01:36.720 --> 00:01:40.620 And for example, DeepSeek-R1 would be one open model 38 00:01:40.620 --> 00:01:43.800 that does use the MIT license. 39 00:01:43.800 --> 00:01:46.860 Now, the MIT license like the Apache 2.0 license 40 00:01:46.860 --> 00:01:48.330 is very permissive. 41 00:01:48.330 --> 00:01:51.240 Commercial use is no problem there. 42 00:01:51.240 --> 00:01:54.791 You just may need to provide some attribution 43 00:01:54.791 --> 00:01:59.580 or extra information to the users of your service. 44 00:01:59.580 --> 00:02:01.800 Now, many open models however, 45 00:02:01.800 --> 00:02:04.980 do not use such permissive licenses. 46 00:02:04.980 --> 00:02:08.160 For example, another important license to be aware of 47 00:02:08.160 --> 00:02:11.280 is Meta's Llama license. 48 00:02:11.280 --> 00:02:13.710 This is a somewhat permissive license. 49 00:02:13.710 --> 00:02:16.650 It does allow you to run Llama on your system, 50 00:02:16.650 --> 00:02:17.730 on your servers, 51 00:02:17.730 --> 00:02:19.620 and it does allow commercial use, 52 00:02:19.620 --> 00:02:22.290 but with certain limitations. 53 00:02:22.290 --> 00:02:26.130 For example, for this Llama 4 license, 54 00:02:26.130 --> 00:02:29.160 when commercially using this model, 55 00:02:29.160 --> 00:02:32.040 if you have more than 700 million 56 00:02:32.040 --> 00:02:34.590 monthly active users, 57 00:02:34.590 --> 00:02:37.680 at the point of time where this model version is released, 58 00:02:37.680 --> 00:02:39.330 if I read this correctly, 59 00:02:39.330 --> 00:02:41.737 you must request an extra license from Meta, 60 00:02:41.737 --> 00:02:44.024 which they of course may or may not grant you, 61 00:02:44.024 --> 00:02:48.180 and for which they of course may or may not charge money. 62 00:02:48.180 --> 00:02:50.280 In addition, attribution is required 63 00:02:50.280 --> 00:02:54.690 and certain kinds of use are prohibited. 64 00:02:54.690 --> 00:02:55.953 Illegal use, for example, 65 00:02:55.953 --> 00:02:58.560 but maybe also some other scenarios. 66 00:02:58.560 --> 00:03:01.800 So you definitely need to check the license agreements 67 00:03:01.800 --> 00:03:06.660 to find out how you may and may not use the Llama models. 68 00:03:06.660 --> 00:03:08.460 The same is true for the Gemma models. 69 00:03:08.460 --> 00:03:09.870 Google has their own license, 70 00:03:09.870 --> 00:03:11.760 which is also somewhat permissive, 71 00:03:11.760 --> 00:03:15.120 which does allow private and commercial use, 72 00:03:15.120 --> 00:03:18.180 and which has no limitations like Meta, 73 00:03:18.180 --> 00:03:20.760 at least at the point of time where I'm recording this. 74 00:03:20.760 --> 00:03:22.894 You don't need to get a different license 75 00:03:22.894 --> 00:03:25.350 once you have a certain amount of users, 76 00:03:25.350 --> 00:03:27.960 but there still are special requirements 77 00:03:27.960 --> 00:03:31.020 regarding attribution, for example, 78 00:03:31.020 --> 00:03:34.500 or that certain use cases are prohibited. 79 00:03:34.500 --> 00:03:37.200 In general, whenever using an open model, 80 00:03:37.200 --> 00:03:39.360 especially when using it commercially, 81 00:03:39.360 --> 00:03:41.520 of course you should check the terms 82 00:03:41.520 --> 00:03:43.290 and the license of that model 83 00:03:43.290 --> 00:03:47.190 to find out whether you may use the model 84 00:03:47.190 --> 00:03:49.290 the way you want to. 85 00:03:49.290 --> 00:03:51.840 In general, those open models 86 00:03:51.840 --> 00:03:54.510 do have quite permissive licenses, 87 00:03:54.510 --> 00:03:55.800 but as explained here, 88 00:03:55.800 --> 00:03:57.960 you should definitely take a closer look, 89 00:03:57.960 --> 00:03:59.550 especially once you plan 90 00:03:59.550 --> 00:04:02.043 to use these open models commercially.