Welcome back to the course.
In this video I'm going to show you step by step how to build a system to create voice narrated stories.
And for that, we'll be using GPT for Image Generation Runway to generate the videos and even 11 labs
to generate the audio.
So now, real quick, let me show you what we have so how it looks like after we create it in a Tokyo
alley at twilight, vibrant lanterns flicker against softly falling cherry blossom petals.
Rain soaked pavement glistens, reflecting a kaleidoscope of neon lights.
A couple stands, as you can see, it's pretty nice.
All right, so we'll set it up step by step.
I will show you each aspect of this automation, and additionally you will have the file to download
that contains all of the resources you need.
So prompts here explanation of how to set up specific specific fields.
So with all that being said let's get started.
So let me go over here And now let's go over to Nathan.
Now let's get started.
So right away I've got my new workflow.
And we would like to trigger this automation whenever we've got a new chat message you can use for an
example, let's say form submission.
So here you will just submit your idea.
Either it can be with the chat or even with the form or other app if you wish.
It can be for example, Google Sheets.
However, let's stick with the chat.
And here right away let's go over to OpenAI.
So there we want to use the model to generate prompts.
Uh, we can select message a model and then pick a model which is um let's pick uh for oh maybe let's
pick for.
Oh.
And here we've got the prompt.
You can go over to the file that you could download in the resources.
And there you've got the prompt.
So here you've got the task.
You're highly skilled a designer designed to transform a short theme emotion or a story concept into
a visually stunning, high quality anime style cinematic scene.
You've got the prompt format, you've got all of the sample outputs, so just simply copy and paste
that.
Also in the resources of this material, you've got the template to download, so you can just download
this entire template and import that inside Nadine and right away use it.
Nevertheless.
For now let's copy this prompt.
So again we've got here everything sample outputs user input even we've got here the JSON input.
Um so let's paste it.
We can paste it.
Um however before all right let's see how it looks like.
Yeah.
Now what we can do, we can go over here and firstly provide the message to baseline.
And let's type something like Crowded City.
Um, um, in the middle, in the middle of the day, let's say we've got here a lot of people.
um, greenery.
And for an example, let's say cozy atmosphere.
Atmosphere.
All right, so something for the beginning.
All right.
Let's actually run it.
Provide it here.
We've got here the model.
So now we can use the data.
As you can see we've got the chat input right there.
Additionally we can click on output content as JSON.
And that's really it.
We can rename it as Generate Prompt.
Let's now click on rename.
And that's cool.
All right.
Let's go over ahead.
And there um even let me go over to my project and copy the sticky notes.
So we know what we what we do step by step.
Um, let me paste it here.
Um, yeah.
And put it into nice form.
All right.
So we've got our first part created.
So generate prompt then what we do.
We need to have a, um, a application to generate for us.
Image.
Um, so we'll be using, um, GPT for image generation.
And there inside the file, um, you've got first the method which is post.
However inside the file you've got everything explained.
So here generate image method post URL send headers enabled header name.
And even you know you've got um yeah.
How to set up your API key.
So let's go over here and choose the post, provide the URL, enable send headers, and then go over
to our file and pick the header name which is the authorization.
There we can provide the value.
So provide the bearer and here API key right there.
And now what we can do we can go over to OpenAI and create our new secret key.
So the choice is yours.
Actually you can go over here and create a new API key, or use an API key you created in the past.
For now, I can go over right there and take my API key.
So let me do it in a while so I can just copy that and paste it here.
That's cool.
Um, all right.
We've got everything.
And there even we can send the body.
So inside the body, what we need to have we've got first parameter.
So we've got the name which is the model.
We can just copy that.
And here the value um we've got gt mh one.
So we specify that we use the model to generate um here, you know, to generate here um the image.
Next we've got the prompt and inside the value we would need to provide the data from Generate Prompt
and our node.
So here just this JSON message content also we can copy that in general from this file.
So we've got also here um, yeah.
The entire code snippet.
Um, and now what we can do, we can add another parameter which is the size.
So here we would like to specify the size, which is 1024 by 1536.
And there even when you go for an example here to ChatGPT image generation API, you've got a lot of
all of the data and you've got all of the documentation here.
Documentation.
So there, um, you can just read it or right here we've got the post request what you need to exactly
paste.
Um, of course I prepared everything for you inside this file.
So you've got all of the data.
Nevertheless, if you have further problems, you can go over here.
Even there, you've got, um, you know, like, um, yeah, the sizes of the image you can create.
So there, um, the specific values, however, it's still, still very valuable to go over here sometimes
if you have some problems.
Um, let's go back to our project.
And now let's name it as generate image.
Generate image.
Um, we've got pretty everything.
Let's go over and test, um, this step.
So let's see if that works.
Hopefully.
Yes.
Um, so it's executing the note after some time it's finished.
So we've got this entire code and that's nice.
We've got two parts um created.
Let's go over to image to video with runway.
What we can do, we can add another http, http request.
Um, and the method which is post there just and we need to take the URL, um, and here also we can
find the URL inside the runway documentation.
Nevertheless I prepared everything for you.
So here generate video URL.
All right there we've got the authentication.
So just choose generic credential type custom authentication.
And there you need to connect your runway with Nadine.
Let me show you that very quickly.
So you click on Create New credential.
And there you've got yeah you've got the JSON format.
You need to go over to this file.
And there I prepared for you.
Yeah.
The code you need to copy and paste.
So you've got this code um go over here and there.
You need to provide your API key, go over your head to runway run API, API reference.
And there you've got API reference.
Um, actually no dev portal.
And here you should be able to create your API key.
Um, yeah.
You've got your API key.
You can click on new API key.
And right there, just name it and create your API key.
I've done it.
So there I don't need to provide it.
However here to connect that just provide your API key.
Um, so let me actually close this.
I've got my runway account and there let's click on send buddy.
We need to specify JSON, specify body using JSON.
And there we need to provide um the code.
Let's go over here.
Um all right.
Let's copy this plain text.
Um let me close this and paste it here.
Even before let's change it to.
All right.
Yeah, we've got it.
And now let's see what we have inside and prompt image.
So yeah, we've got the entire prompt we want to provide.
We've got the model will be using.
So Gen three Ma turbo and prompt.
So the prompt we created duration ratio.
All right.
And duration ratio and watermark.
Watermark.
so it should work.
Let's click on actually before let's rename it.
So generate a video.
Generate uh generate a video.
Let's rename it and click on actually test step.
Um yeah.
Let's see if that works.
Hopefully I didn't forget about something.
Um yeah.
Yeah.
All right.
So we've got our video generated video after that.
Let's organize it.
Uh, we need to provide a note, um, which is wait, we want to wait.
90s.
So, um, so let's wait for 90s.
Uh, rename, provide the value, which is 90s.
So we need to wait until, um, our video is generated.
Then we want to get the video so it prevents from the crash because otherwise if we don't have this,
um, this note.
It continues with the entire with the other notes.
Um, so it it won't to get the video.
However, the video is not created yet.
So yeah.
You know and now with the http, http request let's name it as Get video.
Um, yeah.
Let's click on rename.
And for the matter actually of this, um, for this case of this case, let's set the wait for five
seconds.
And now even let's don't run it because maybe the video is not created yet.
However, later I will need to run it because I want to have the data inside get video.
Uh, however, for now go over to the file and there just take the URL.
So we are using JSON id to indicate which one.
Um, yeah, actually two.
And provide the variable for the video.
So which one video we are taking here what you need to do.
All right.
What you need to do you need to enable the headers and provide this value.
So we are specifying the version we are using.
Let's click on send headers, then copy the name and the date and the date.
And now what we can do.
We can go over back to canvas.
And there just try to run it.
Let's see if we already have the video generated or not.
So let's click here.
All right.
No API key was provided.
Yeah.
So I forgot about providing an API key.
So let's click on authentication.
Let's click on generate credential type here custom authentication.
And if you connected your runway and you can just take your credential.
Now let's test a step.
Now it should work.
And we've got it.
All right.
We've got our link.
Let's preview the video.
We have um let's see.
Nice.
We've got the video generated, so they are staying under the umbrella on rainy day.
Nice.
It's.
It's so cool.
Yeah.
So we've got our step.
So for now we have our three parts created.
So generate prompt generate image with GPT for image generation and image to video with runway.
And now is the time to generate audio.
We just provide HTTP request and we use let's move it here we use 11 laps.
So we provide generate audio audio.
And there we change the method actually rename it.
We change the method method to post URL.
Uh we can copy the URL from here.
All right.
From here let's just copy that.
Um yes.
Authentication.
So you just choose the generate credential type.
Here we've got header authentication and I and I have the 11 labs.
If you haven't connected 11 labs to an ident to Na then so far we've got the separated video about it
in the course.
Just visit that video and see how how you can do this.
For now, I don't want to waste your time.
Um, let's click on Send Headers.
And there inside the file we need to provide some some headers.
So here the name content type.
Um so here we've got a name and there the application JSON everything actually you've got in the documentation
of um 11 labs.
So they're even what we need to do.
Uh, we need to provide actually we need to enable the body and to send the body.
And here, um, we need to specify the JSON and provide this piece of the text.
Um, let's go over send the body.
Pick the specify body, which is JSON, and provide the text.
And this piece of the content that actually clean cleans our content we provide.
So here a prompt, um, we just put and it removes um, quotation.
Um, yeah.
Quotation marks in case if we have some to avoid some specific, you know, um, to avoid um, like
errors.
Let's test it so we can test the step.
And yes, I think it works.
So let's wait a while a few seconds more and afterwards, after it generated, we've got the audio for
our video.
We are very close to the end.
Let's move forward to Google Drive.
We want to upload that to Google Drive.
So here upload file I see that I chose the operation which is update instead of upload.
So let's change it.
And there inside the file name let's provide the id.
So here change it to expression and provide the ID for the audio.
We've got the ID let's provide the drive.
And here the folder I've got the folder which is upload sound runway.
Yeah I've got it.
Let's test the step.
So we want to upload this file right here.
So afterwards I can have the link to upload inside Google Sheets.
So at the end we save the data inside Google Sheets Google sheets append row and sheet and all right
now let me show you actually the template I provided for you.
So here in general there are only two fields.
So we've got the video and audio.
And actually you can copy this entire template from the resources of this material.
So click here on file and make a copy.
And after you can use it let's go over there and pick my document.
So here story videos generator sheet.
So we've got sheet one.
And there we need to map our video.
So there.
Um let's go over to video.
We need to provide this entire URL.
So from the video.
Here and there the audio from Google Drive.
So right there pick a web view link.
And right now we can test it.
So let's see if we get the content here.
Nice.
We've got a content.
Let's check it.
We've got the video and there we've got our audio.
So our voiceover let's see.
Um.
In the heart of a bustling city, a couple huddles under a vibrant red umbrella as rain pours relentlessly.
It's so nice so that we have it.
We created the entire automation, um, that actually creates for us images, videos and audio.
And there is very important fact in this video.
We haven't created actually the automation that combines these elements together.
So remember like to create for an example video I showed you at the beginning we need to do some stuff.
And there even I can say this is the this is the advantage of this automation because sometimes trust
me we can do some things manually.
So instead of just automating everything and we can do it manually with less time and less costs because
let me show you something.
This is the automation.
Actually.
Let me show you the automation.
And we created in this course.
So we've got both YouTube videos probably.
And here we've got actually more sophisticated project.
And there we merge everything together.
So here the sound video and there even the titles there we use external application that takes additional
actually, um, you know, um, additional credits.
And there even it's just words rather than we created automatically.
Um, no.
I'm sorry.
No.
Automatically.
However, manually.
Because what you can do, I use DaVinci resolve to actually combine the the clips because I have two
clips and the audio together.
And now look, it's very simple.
You can do this in 20s.
Nevertheless for now actually you can ask alright, but from where do you have another clip and where
are the captions?
Let me explain.
In general you can use this project.
So this project, um, and you can provide the Free steps framework.
And let me show you how you can do this.
You can open ChatGPT and ask for, um, creating the prompts for free scenes and they will be consistent.
You can run firstly the first scene.
So let's say we go over here, we run the first scene, we create there, the video, the audio for
that.
And all right we've got our one video and one audio.
Then what you do you disable the generate audio and here Google Drive and you go ahead with the second
scene.
And so what it does afterwards it only creates for you the video not the audio, because you have the
audio already that you will be using for for example for these three clips.
So there you've got two videos and one audio.
And at the end you take the scene three, and at the end you create a third video.
And at the end you've got three videos.
You can combine them together, you can provide the audio and even the transitions that are much better
than external applications.
And again, you don't need to spend a lot of time, a lot of credits.
We've done it actually.
We've done this entire project workflow in this course.
You can check it out.
So here are a lot of further steps in this project.
All right.
So there we merge the notes.
It's also fine if you want to automate everything.
However in this case I think it's better, actually.
I would rather to go over to external tool, edit that, even add captions.
So let me show you something.
I just exported this video from DaVinci resolve.
I went over to the application which is kapwing, and there I created nice captions in a Tokyo alley
like Twilight vibrant lanterns.
It's so, so nice.
A couple stands, a couple stands close together.
They're warm.
And for me, it's just better.
Um, yeah.
And I can say that for now.
We've got it.
We created this entire project.
Of course.
Remember, you can download the template in the resources of this material along with Google Sheets
template and there.
Yeah, all of the instructions.
I hope you enjoyed it.
Remember to leave us an honest review or even the rating of the course.
We appreciate it is important for us and to know if you like the materials, automations even you can
give us give us some ideas for the next project.
So please do this if you have 30s for now.
Thank you for watching again and I will see you in the next material.