High Definition Standard Definition Theater
Video id : Dw3BZ6O_8LY
ImmersiveAmbientModecolor: #cdc29f (color 1)
Video Format : 22 (720p) openh264 ( https://github.com/cisco/openh264) mp4a.40.2 | 44100Hz
Audio Format: Opus - Normalized audio
PokeTubeEncryptID: e3ba7ca34221f089f0e9000e119ee73d2877198b4da30eb970f4349c7ed14cbcee92b757cb918304d8afc3504da89f08
Proxy : eu-proxy.poketube.fun - refresh the page to change the proxy location
Date : 1714725095399 - unknown on Apple WebKit
Mystery text : RHczQlo2T184TFkgaSAgbG92ICB1IGV1LXByb3h5LnBva2V0dWJlLmZ1bg==
143 : true
Training an unbeatable AI in Trackmania
Jump to Connections
12,198,931 Views ā€¢ Sep 30, 2023 ā€¢ Click to toggle off description
I trained an AI in Trackmania with reinforcement learning, until I couldn't beat it.

I just opened a Patreon page, where you can support this YouTube channel with a donation (link below). Between research, programming and editing, these videos take a long time to produce. Any support will help me to spend more time on that in the futureĀ ! This one in particular took up most of my time over the last six months. I hope you like the result, and I'm open to any feedback to improve the quality of these videos :) I'll post more details on the Patreon page to explain what I plan to do next.
ā€¢ PatreonĀ : www.patreon.com/Yoshtm

If you want to try these maps, you first need to have both Trackmania Nations Forever (TMNF) and TMInfinity installed. Then, you can download the maps on Trackmania Exchange (TMX). Everything is free, and you can use the links below.
ā€¢ TMNFĀ : files.trackmaniaforever.com/tmnationsforever_setupā€¦
ā€¢ TMInfinity: unlimiter.net/download
ā€¢ Download the maps on TMX : tmnf.exchange/tracksearch?query=author%3a+yoshtm

Contact
ā€¢ DiscordĀ : yosh_tm
ā€¢ Twitter : twitter.com/yoshtm1

Special thanks to Donadigo, for TMInterface !
Metadata And Engagement

Views : 12,198,931
Genre: Gaming
Date of upload: Sep 30, 2023 ^^


Rating : 4.951 (2,984/241,358 LTDR)
RYD date created : 2024-05-03T08:17:37.602041Z
See in json
Tags
Connections

YouTube Comments - 5,583 Comments

Top Comments of this video!! :3

@culleng.1653

7 months ago

Showing the AI's multiple training runs simultaneously and color coded is one of the most gorgeous and elegant depictions of machine learning I've ever seen. Thank you for this video!!

27K |

@One_Stale_Donut

7 months ago

Insane production value, the editing that went into this, and the time it must have taken.

13K |

@florrex4136

5 months ago

That drift-overtraining and then training off the excess is a really interesting approach to let the Ai discover new mechanicsšŸ‘šŸ»

3.1K |

@rafaelnubile

5 months ago

Now we want a race between programmers to see who makes the fastest AI!

2.2K |

@PaulOsbornesChannel

7 months ago

The way you taught it to drift, then taught it to use drifting to go faster was brilliant

492 |

@darkranger116

7 months ago

I always love these training AI videos. Its like the "wizard knows his apprentice will be more powerful than him one day, but only if he is guided there" vibe

853 |

@adkh2112

5 months ago

As a an AI engineer who played lots of trackmania growing up i thoroughly enjoyed this video. Great editting too and great to follow your journey and thought process!

311 |

@kootenpv

5 months ago

The main problem with the final test is that this part of the map was still contained in the training data, and for that it means it likely doesn't generalize and instead was over fit at least slightly

587 |

@Bassalicious

7 months ago

This is nuts. The sheer amount of work involved boggles the mind. Such a well paced and chill presentation too, love it!

818 |

@plebiain

7 months ago

I would unironically watch hours of you facing off against this AI on different maps to see what it does, please make more!

1.4K |

@JeffreyBoles

5 months ago

This is the third Trackmania documentary I've watched on YouTube. I have never played Trackmania. I do not play racing games at all. Yet these docs are incredible!

88 |

@LetsbeHonestOfficial

4 months ago

For the AI to be able to reintroduce its new isolated drift skill to its arsenal after the reward was removed is so cool to me. I feel like that is such a massive way to teach AI new skills. Doesn't that imply that you could isolate a thousand different skills, and then have the AI incorporate it all into something massive?

123 |

@johnbrooks6243

7 months ago

Watching your own creation grown and outperform you has such a paternal feeling its amazing.

500 |

@benslater4997

6 months ago

16:19 I love how the Ai found a way to abuse the crap out of the reward system šŸ˜‚

506 |

@InTehFace1

5 months ago

Really great work, and guys like you are going to be talked about in 10 years as the pioneers of training AI in various applications. Very inspiring

38 |

@Jb-db5kj

4 months ago

This is absolutely incredible I canā€™t even imagine the work and frustration that went j to this.

5 |

@RacetasClub

7 months ago

What a magnificent video and what an incredible journey. This got me excited all over again. You sir took quality to a whole new level, you & the AI should both be very proud :)

827 |

@apocalypselemon2209

6 months ago

I absolutely love the part where it becomes the drift king for optimal rewards. Just styling by doing micro drifts constantly.

372 |

@IAteYourDingoBaby

4 months ago

Thats so awesome. I remember watching these videos years ago, and being blown away by what you were doing - even with having never played the game. Now... You've taken it to an entirely other level. Its cool to see you're still at it. When someone puts that much passion into a game so old, it only means one thing - and thats the immense embracement of the time they've shared with the game, good and bad. It takes a rare breed to really bunker down and commit to something for so long, looking past all other options, and even the cons you will inevitably find over time, really just focusing on what it has brought you and all the time you have shared with it. Props my friend. Keep at it, and keep enjoying!

|

@lidef6888

3 days ago

Now the content farms will be ai

18 |

Go To Top