Conversation
My process was:
Screenshot all 102 shots in the trailer
Remix them to Ghibli style in 's Sora
Animate in and
Re-edit in sync with trailer.
In Sora, I used prompts like:
"Recreate this in the style of Studio Ghibli, intricately detailed. Make sure the composition, colors and vibe is similar. The scene pictured shows black cloaked figures on black horses riding away from a massive wave of water on a riverbed that is
I didn't have the time to lip sync them, so in Kling and Luma I just used prompts like:
"a man yells, fearful"
"a woman talks, concerned, brows furrowed"
I used about half Kling and half Luma. When one didn't work how I wanted it to, I used the other.
If you remember, a few months ago, I went viral for doing the opposite of this. I took a Studio Ghibli film and turned it into live action.
Quote
PJ Ace
@PJaccetturo
After 22 million views and thousands of death threats, I felt like I needed to take this post down for my own mental health.
This trailer was an EXPERIMENT to show my 300 friends on X how far we've coming in 16 months.
I'm putting it back up to keep the conversation going. 
I have also done other Lord of the Rings anime videos before:
Quote
PJ Ace
@PJaccetturo
If Lord of the Rings and Dark Souls had a baby it would be this anime
I made this in 2 hours for $45 in credits.
I wish I had these tools a year ago when we spent millions on our animated series.
Show more
0:36
I'm an AI filmmaker and do fun projects like this between bigger projects like this recent anime music video we made for
Quote
PJ Ace
@PJaccetturo
We just created a music video for Timbaland!
This was SO FUN to work on. This took us less than TWO WEEKS from start to finish.
Tim and his team were amazing to work with and we’re excited to do more of these with him!
Show more
Follow for more AI content! I'm here to help teach others these amazing tools!
Parts of it looks good
Most of it looks comical especially the balrog, moria and the orcs 
Good effort though
Buy live action is better for stuff like LOTR and to an extent HarryPotter ( sorry Rohirrim, you were OK but Jacksons films are better )
lmaoooooo so true, that was the weakest shot for sure. I blew like $20 on generations and just ran with the best one I could find
Alright ... it's got the sauce. But I gotta say. You should definitely check out Luma's Ray 2 sometime.
I found that in terms of "anime" styled aimation or img to vid it's one of the stronger ones out there.
I used Luma Ray 2 on this. Sometimes when it wasn't doing the shots right, I used Kling but it's about 50/50
Funny enough, the studio that worked on the 1977 “Hobbit” animated film went on to form Studio Ghibli
How dare you even write "Studio Ghibli Presents"? I can't express how disrespectful this is toward this studio. I guess AI bros have no shame after all.
Incidentally, the studio that later became Studio Ghibli DID make the animated Hobbit, back in the 70s.
I think i have only commented once before in my life on twitter but this deserves serious recognition. This is phenomenal work.
Where creativity meets opportunity—watch your ideas work for you.
Try Squibler for free and start turning dreams into results today! 
Thanks Sid, I was surprised someone didn't do it sooner. It's not complicated--but Sora/Chatgpt's servers are cooked right now, I don't know if other people can do it right now, haha
All I can see is the lack of exaggeration and energy that makes master animators so coveted. Turning a shot-for-shot live-action to animation simply demonstrates how lifeless it can be without animation principles.
Ready for an interstellar adventure?
Take off with Star Trek: The Next Generation, only available at Chumba Casino! 
I cannot believe you put Hayao Miyazaki's name in it. Shocking scenes. Bleak.
This basically already exists and was done in 1978, for anyone who wants to see it (Amazon has it to stream).
More people would watch this rather than that
Amazon spent 1 BILLION dollars on to create.
This is the Reese's Peanut Butter Cup theory of creativity. Take one thing that's good and combine it with another thing that's good. The combination of these two great things is better than the originals, right???
No, it's hollow and distorts the original brilliance of the work
Bro it already exists why did you waste your time and money?
Great example of the duality of the moment. This project required hundreds of dollars and hours of work from a devoted fan familiar with animation techniques and both sources of material.
People will look at it and say "It's easy to make things like this now" which is right in
You ruined a lot by doing this. Congratulations. This looks terrible. And would be terrible if made by AI. You spent $250 to steal two distinct things and do very little work. It’s called laziness, create your own stuff instead of stealing.
This Alternate 'Revenge Of The Sith' Opening Scene is 10X BETTER
General Grievous Kidnaps the Chancellor
(Original SWAnimation)
(Every step, I'm rounding up)
250$ for 112 seconds...
268$ for 2 minutes.
Let's add 9 hours of editor salary @~100k per year: that's another $450, so ~$720 for 2 minutes.
$21,600 per hour of video
$245,520 for 682 minutes of the extended cut of the original trilogy.
Double it to
if you paid an artist, in 9 hours they'd charge you $250 and have completed 5 frames maybe
This is why it's not about competition with artists but about entirely new kinds of productions that simply would never exist without ai.
They just did an anime version of the Lord of the Rings.
Ghibli may have done it better. That's a talented studio for sure.
The funny irony here is that many of the people that ended up becoming the early creation of Studio Ghibli, were many of the same people who worked on the animated version of The Hobbit and The Return of the what’s King. So it absolutely would be very fitting.
It's funny because even though the mouth movements don't match the dialogue, an excuse can be made that it's just dubbed from the original Japanese
Wow! This is absolutely magical! Studio Ghibli’s whimsical, emotional style blended with the epic fantasy of Lord of the Rings = pure creativity at work! 

It’s a stunning re-creation. This will have a massive economic impact (positive) for big and small creators. A wild a diversity of content for tiered production-value levels.
Some questions,
1. Did you have to put efforts in ensuring all characters look same if they are casted in multiple scenes?
2. Did you have to do the same with objects, like the ring?
3. Say a character's clothes remain the same across the trailer - did you have to describe the
Can you mold your identity to accommodate the lessons of worldly wisdom?
Can you be a (noble) thief one day, and a general another? A sales person? An Engineer?
Subscribe to the 'Ether' newsletter to download the ebook: "The 10 Labors of Worldly Wisdom"
Wait till people find out the animation studio Topcraft, who work on Rankin & Bass's The Hobbit (1977) and Return of the King (1980), became Studio Ghibli.
Pretty cool. I’d love to see this entire film redone by hand-drawing like they did in the Disney days before CGI ruined everything.
Isn't the trend to take animated movies and make them live-action? Honestly, I find these figures extremely generic and dull.
If we didn't have the live-action, then it could be a decent stand-in until we did.
I loved it, great work. But I would have liked to see a "pre-Peter Jackson" version, based on Tolkien's descriptions (and why not, Alan Lee's illustrations) instead of the faces of the actors from the movies
So many haters in the comments here, but this is amazing!
AI is not stealing anything. It is a tool that any artist should be using to improve their work the same as anyone using Adobe Creative Suite and similar tools.
If you lose your job, it's because you're either not good
“With that power I should have power too great and terrible. And over me the Ring would gain a power still greater and more deadly.”
- Gandalf the Grey
… it really will be one AI generation software to rule them all (artists).