High Definition Standard Definition Theater
Video id : B57TG5pA5PE
ImmersiveAmbientModecolor: #e3cdbc (color 2)
Video Format : 22 (720p) openh264 ( https://github.com/cisco/openh264) mp4a.40.2 | 44100Hz
Audio Format: Opus - Normalized audio
PokeTubeEncryptID: f8eca9d93c31284c4e46854e919c8091b034d2a1229a2422eb72aa1ba84a7b4210abe5b7e44ed9315607718571625555
Proxy : eu-proxy.poketube.fun - refresh the page to change the proxy location
Date : 1716354517273 - unknown on Apple WebKit
Mystery text : QjU3VEc1cEE1UEUgaSAgbG92ICB1IGV1LXByb3h5LnBva2V0dWJlLmZ1bg==
143 : true
Google's AI Video Generator Beat Runway in Side-by-Side Test!
Jump to Connections
51,966 Views • Dec 20, 2023 • Click to toggle off description
Join Our Newsletter for the Latest AI Filmmaking News: curiousrefuge.com/
Our AI Filmmaking Starts Soon: curiousrefuge.com/ai-filmmaking

Time Codes:
00:00 Intro
00:16 Control Emotion in Video Portraits
01:33 Google's AI Video Generator
03:48 WALT vs Runway
04:20 Runway's TTS Tool
05:58 Runway vs Elevenlabs
07:16 Runway's Clean Audio
09:20 Runway's Transcript Tool
10:01 Runway's Subtitle Tool
10:53 Runway's Silence Remover Tool
11:53 Chat GPT 4.5
12:29 Stability AI's Text to 3D Asset
13:23 Plaque Reveal
14:31 Midjourney Alpha
15:37 Midjourney v6
16:31 Meta's AI Audio Generator
17:48 Google's AI Music Generator
20:08 Curious Refuge with Tim Simmons
20:31 Winners of the AI Holiday Film Competition
21:38 Pika 1.0 Waitlist
21:51 Pika Retry and Reprompt
22:27 MoveAI
23:09 AI Deep Video Stabilizer
24:00 Animatable Photorealistic Gaussian Splats
24:56 Diffusion Light
26:30 Gaussian Splats in Real Time
27:45 Tesla's AI Robot
28:17 AI Films of the Week
28:20 KK Holiday
28:47 Land of the Lost
29:17 KFC Philippines
29:53 One Plus USA
30:17 Santa's Break
30:45 Outro


Helpful Links:
Control Emotion in Video Portraits: bob35buaa.github.io/GMTalker
Google's AI Video Generator: walt-video-diffusion.github.io/?ref=aiartweekly
Runway's New Audio Tools: runwayml.com/
Chat GPT 4.5: twitter.com/daniel_nguyenx/status/1735260556892967…
Stability AI's Text to 3D Asset: stability.ai/news/stable-zero123-3d-generation
Midjourney Alpha: twitter.com/nickfloats/status/1734706803097710667
Midjourney v6: twitter.com/saana_ai/status/1735042925812158634
Meta's AI Audio Generator: twitter.com/AIatMeta/status/1734257634008531453
Google's AI Music Generator: venturebeat.com/ai/googles-new-ai-tool-musicfx-com…
Curious Refuge with Tim Simmons:    • The Future of Filmmaking with Tim at ...  
Winners of the AI Holiday Film Competition:    • Top 8 AI Holiday Films Revealed!  
Pika 1.0 Waitlist: twitter.com/pika_labs/status/1734311655771673040
Pika Retry and Reprompt: twitter.com/pika_labs/status/1735045639128433027
MoveAI: twitter.com/MoveAI_/status/1736096150535454807
AI Deep Video Stabilizer: tianxingwu.github.io/pages/FreeInit
Animatable Photorealistic Gaussian Splats: vcai.mpi-inf.mpg.de/projects/ash/
Diffusion Light: vcai.mpi-inf.mpg.de/projects/ash/
Gaussian Splats in Real Time: smerf-3d.github.io//
Tesla's AI Robot: twitter.com/Tesla_Optimus/status/17347561501372255…

AI Films of the Week:

KK Holiday: curiousrefuge.com/ai-film-gallery/kk-holiday
Land of the Lost: curiousrefuge.com/ai-film-gallery/land-of-the-lost
KFC Philippines: curiousrefuge.com/ai-film-gallery/kfc-cats
One Plus USA: curiousrefuge.com/ai-film-gallery/one-plus
Santa's Break: curiousrefuge.com/ai-film-gallery/santas-break
Metadata And Engagement

Views : 51,966
Genre: Entertainment
Date of upload: Dec 20, 2023 ^^


Rating : 4.774 (75/1,251 LTDR)
RYD date created : 2024-04-01T11:11:20.590357Z
See in json
Tags
Connections

YouTube Comments - 136 Comments

Top Comments of this video!! :3

@KittyBoom360

5 months ago

Just a kindly inserted FYI, when you were talking about transcripts, you really meant captions, and there is a meaningful distinction between the two. Transcripts are for audio-only files without syncing to the original file. Captions are for files that are then synced with the video. I know this well because one of my gig jobs is captioning, and our platform also has a separate job list for transcripts. Basically, think of transcripts as like a court room audio being transcribed for others to read or for someone talking into an audio recorder who wants to read their audio, while captions are something you'd read along with a video file where the two are in sync as you watch. Like on YouTube, you're reading captions, not transcripts. Hope that helps going forward!

18 |

@AllanGildea

5 months ago

Thanks for the typically excellent and comprehensive round up of AI mayhem. Moving so fast!

12 |

@TradeRealm

5 months ago

Last time I was this early we were generating paragraphs with prompts... Damn its moving too fast.

5 |

@Mrim86

5 months ago

That Pika waitlist is killing me :(

5 |

@christopherpoet458

5 months ago

8:00 - Is it just me or does anyone else feel like the OG audio was just fine? The background noise was easy to ignore and I could hear and focus on the dialogue. The Runway version sounded horrible like it attempted to clean up the surround sound and instead left spikes of it that meddled with the dialogue audio. Maybe I just don't have a trained ear for this but I am failing to see how that was a good example.

3 |

@starfox300

5 months ago

AI is gonna supercharge the advancement of technology. I cannot fathom how the world will look in 10 years

6 |

@lomotil3370

5 months ago

🎯 Key Takeaways for quick navigation: 00:00 🎬 Revolutionizing AI Filmmaking: - Google introduces groundbreaking AI filmmaking tools, reshaping the future of film production. - New tools like GM Talker enable emotion manipulation in subjects, allowing for nuanced emotional adjustments. 01:48 🤖🎥 Google's AI Video Model "Walt": - Google unveils AI video model named "Walt" with impressive text-to-video and image-to-video capabilities. - Demonstrates early-stage realistic results, excelling in visual effects and introducing a unique feature—rotation around subjects. 04:29 🎵🔊 Runway's New Audio Features: - Runway introduces new audio features, including text-to-speech, audio cleaning, and sound effects generation. - Users can generate AI-based voices, clean audio in-browser, and create unique sound effects using prompts. 09:32 📜💬 Runway's Subtitle and Transcript Tools: - Runway adds subtitle and transcript tools for easy integration of text into videos. - Users can edit transcripts, generate subtitles, and remove silence, streamlining the video editing process. 13:32 🌐🎶 AI Advances Beyond Film: - AI developments extend beyond film with innovations in music generation and 3D asset creation. - Google's AI music tool and ChatGPT 4.5 rumors hint at the expanding role of AI in diverse creative fields. 23:41 🔄 AI video stabilization tool released on GitHub, allowing users to enhance footage quality significantly. 24:07 🌐 Researchers developed a technology combining gaussian splats and motion-tracked animation to create semi-photorealistic animated versions of people, raising concerns about the future of background actors in films. 25:00 🎥 Google introduces Diffusion Light, a tool that automatically generates reflection maps (Chrome ball) from uploaded reference footage, simplifying the compositing process for 3D elements in scenes. 26:10 💡 Advancements in AI-powered diffusion face relighting technology promise to revolutionize scene lighting in video editing, offering more impressive capabilities compared to existing tools. 27:06 🌐 Google showcases a technology allowing real-time exploration of gaussian splats, hinting at future applications in creating photorealistic virtual worlds and enhancing storytelling experiences. Mad

4 |

@john_blues

4 months ago

Just saw the Paper on Google's AI video generator. It looks insane. But I've tempered my expectations after the Gemeni debacle though. Can't wait to see it in action, and see the ideas behind it hit open source as well.

2 |

@klausgrabler1965

5 months ago

v 6.0 is already out. You just missed it man!

3 |

@GroRoomHomeStudio-hi8je

5 months ago

It is so intense learning, and really amazing, ofc one generator-site cant make full animated video by just one quick prompt script, i may have expected waaay to much of AI, but Yeah it goes mentally fast so thnx for keeping us noobs updated to get insights 🙏🙏🙏

3 |

@drnabs872

5 months ago

Not surprised, I’ve been using runway since the released gen-1 but honestly for now it’s overrated thanks for the share

4 |

@david_arthur_brown

4 months ago

The little man made of "blocks" is in fact Bertie Bassett, the liquorice allsorts man. just FYI. 🙂 The channel is superb, btw. Very inspiring and useful.

2 |

@Artyficial.Intelligens

5 months ago

The two song clips sound like generated by AI. But if really only one was AI, it was the first one. The second clip sounds more real.

2 |

@theyshouldhavenevergivenme5439

4 months ago

What's really amazing here is how AI it all still looks... They are CLEARLY not there yet despite all the hype. Those horse legs really need to be looked at man ;;)

1 |

@optimoos

5 months ago

superb. I'd like to participate in the next competition please. when would it be? thanks

1 |

@TheJereld

5 months ago

Congrats on the 100K subs and this channel is one of my fav AI news sources!!!

6 |

@demonhogo

4 months ago

i wonder how soon these will get good enough to use besides just comparison tests

1 |

@ydvisual5530

4 months ago

I am a Runway ML pro user - but I didn't even know about the text to audio - haha ; thanks for the update!

1 |

@jacobwest7

5 months ago

Movie studios can still employ vfx artists and filmakers and everyone else and for those of us who could never afford to make a film we can use a.i, everyone's happy

1 |

@zellionnn3310

5 months ago

When does walt come out ?

1 |

Go To Top