Post

Conversation

What if Studio Ghibli directed Lord of the Rings? I spent $250 in Kling credits and 9 hours re-editing the Fellowship trailer to bring that vision to life—and I’ll show you exactly how I did it 👇🏼
David Watson 🥑
Post your reply

In Sora, I used prompts like: "Recreate this in the style of Studio Ghibli, intricately detailed. Make sure the composition, colors and vibe is similar. The scene pictured shows black cloaked figures on black horses riding away from a massive wave of water on a riverbed that is
Image
Image
I didn't have the time to lip sync them, so in Kling and Luma I just used prompts like: "a man yells, fearful" "a woman talks, concerned, brows furrowed" I used about half Kling and half Luma. When one didn't work how I wanted it to, I used the other.
If you remember, a few months ago, I went viral for doing the opposite of this. I took a Studio Ghibli film and turned it into live action.
Quote
PJ Ace
@PJaccetturo
After 22 million views and thousands of death threats, I felt like I needed to take this post down for my own mental health. This trailer was an EXPERIMENT to show my 300 friends on X how far we've coming in 16 months. I'm putting it back up to keep the conversation going. 🧵
I have also done other Lord of the Rings anime videos before:
Quote
PJ Ace
@PJaccetturo
If Lord of the Rings and Dark Souls had a baby it would be this anime 👇🏼 I made this in 2 hours for $45 in credits. I wish I had these tools a year ago when we spent millions on our animated series.
Show more
0:36
I'm an AI filmmaker and do fun projects like this between bigger projects like this recent anime music video we made for
Quote
PJ Ace
@PJaccetturo
We just created a music video for Timbaland! This was SO FUN to work on. This took us less than TWO WEEKS from start to finish. Tim and his team were amazing to work with and we’re excited to do more of these with him!
Show more
Parts of it looks good 👍 Most of it looks comical especially the balrog, moria and the orcs 💀😂 Good effort though 👏 Buy live action is better for stuff like LOTR and to an extent HarryPotter ( sorry Rohirrim, you were OK but Jacksons films are better )🤷‍♂️
lmaoooooo so true, that was the weakest shot for sure. I blew like $20 on generations and just ran with the best one I could find
Alright ... it's got the sauce. But I gotta say. You should definitely check out Luma's Ray 2 sometime. I found that in terms of "anime" styled aimation or img to vid it's one of the stronger ones out there.
I used Luma Ray 2 on this. Sometimes when it wasn't doing the shots right, I used Kling but it's about 50/50
"Studio Ghibli Presents..." okay this is just getting ridiculous they did not present this.
How dare you even write "Studio Ghibli Presents"? I can't express how disrespectful this is toward this studio. I guess AI bros have no shame after all.
I knew someone would do this for sure as soon as openAI announced its 4o update, and here we are. Great work PJ.👏
Thanks Sid, I was surprised someone didn't do it sooner. It's not complicated--but Sora/Chatgpt's servers are cooked right now, I don't know if other people can do it right now, haha
All I can see is the lack of exaggeration and energy that makes master animators so coveted. Turning a shot-for-shot live-action to animation simply demonstrates how lifeless it can be without animation principles.
Very impressive, but it's a long, long way from Studio Ghibli quality. A true Miyazaki LoTR would have jaw-droppingly beautiful hand-painted backgrounds, instead of these rather standard animated landscapes. Also, the characters, while distinct, seem a little generic.
This basically already exists and was done in 1978, for anyone who wants to see it (Amazon has it to stream).
Image
Image
Image
Image
This is the Reese's Peanut Butter Cup theory of creativity. Take one thing that's good and combine it with another thing that's good. The combination of these two great things is better than the originals, right??? No, it's hollow and distorts the original brilliance of the work
Great example of the duality of the moment. This project required hundreds of dollars and hours of work from a devoted fan familiar with animation techniques and both sources of material. People will look at it and say "It's easy to make things like this now" which is right in
You ruined a lot by doing this. Congratulations. This looks terrible. And would be terrible if made by AI. You spent $250 to steal two distinct things and do very little work. It’s called laziness, create your own stuff instead of stealing.
(Every step, I'm rounding up) 250$ for 112 seconds... 268$ for 2 minutes. Let's add 9 hours of editor salary @~100k per year: that's another $450, so ~$720 for 2 minutes. $21,600 per hour of video $245,520 for 682 minutes of the extended cut of the original trilogy. Double it to
if you paid an artist, in 9 hours they'd charge you $250 and have completed 5 frames maybe This is why it's not about competition with artists but about entirely new kinds of productions that simply would never exist without ai.
I’m predicting this process is gonna be automated very soon. Imagine rewatching any movie in any style of choice to create an entirely new experience.
The funny irony here is that many of the people that ended up becoming the early creation of Studio Ghibli, were many of the same people who worked on the animated version of The Hobbit and The Return of the what’s King. So it absolutely would be very fitting.
It's funny because even though the mouth movements don't match the dialogue, an excuse can be made that it's just dubbed from the original Japanese
Wow! This is absolutely magical! Studio Ghibli’s whimsical, emotional style blended with the epic fantasy of Lord of the Rings = pure creativity at work! 👏✨
It’s a stunning re-creation. This will have a massive economic impact (positive) for big and small creators. A wild a diversity of content for tiered production-value levels.
Some questions, 1. Did you have to put efforts in ensuring all characters look same if they are casted in multiple scenes? 2. Did you have to do the same with objects, like the ring? 3. Say a character's clothes remain the same across the trailer - did you have to describe the
Isn't the trend to take animated movies and make them live-action? Honestly, I find these figures extremely generic and dull. If we didn't have the live-action, then it could be a decent stand-in until we did.
I loved it, great work. But I would have liked to see a "pre-Peter Jackson" version, based on Tolkien's descriptions (and why not, Alan Lee's illustrations) instead of the faces of the actors from the movies
So many haters in the comments here, but this is amazing! AI is not stealing anything. It is a tool that any artist should be using to improve their work the same as anyone using Adobe Creative Suite and similar tools. If you lose your job, it's because you're either not good
In a couple yrs it will be free to watch all favourite movies in any cartoon format An just killed the jobs of thousands of animators
“With that power I should have power too great and terrible. And over me the Ring would gain a power still greater and more deadly.” - Gandalf the Grey … it really will be one AI generation software to rule them all (artists).