Search Results
6/24/2025, 3:44:35 AM
>>105685728
>Wouldn't it make more sense to just encode all the different kinds of tiles as a sprite sheet and just pass the index to the model or something?
It would if the goal was just to make the model beat the game. I think the GPT4 imitation has an entire suite of tools to assist it with that, full area minimaps with pathfinding, pointers for all interactable objects, etc. The Gemini one was outright getting walked through things by the guy running it.
The Claude stream's idea was to just throw the game at it to see how well it does, and the answer is mostly not well. It's too blind to tell one tree from another, doesn't have the spatial awareness to navigate beyond its vision range, doesn't have the context length to memorize what failed in the past and needs to be avoided. It "sees" passages that aren't there, tries to bump through impassible walls all the time (and telling it not to do that would be worse because Pokemon does require you to bump into solid walls to enter the north/side doors of buildings, only south-facing ones get a visible sprite). That it got as far as it has is a miracle, and one day it might blunder through the spinner maze it's been stuck in since getting through rock tunnel.
In Vermilion City in that image you posted, it spent multiple days stuck on the small peninsula with the house there because it was trying to get to the end of the pier, knew the target was far south, and it couldn't figure out that it needed to go northeast to ultimately get to the goal further south. Just going around an obstacle wider than the screen width is beyond its ability. It even tried (and failed) to make an ASCII map at one point for that purpose.
>Wouldn't it make more sense to just encode all the different kinds of tiles as a sprite sheet and just pass the index to the model or something?
It would if the goal was just to make the model beat the game. I think the GPT4 imitation has an entire suite of tools to assist it with that, full area minimaps with pathfinding, pointers for all interactable objects, etc. The Gemini one was outright getting walked through things by the guy running it.
The Claude stream's idea was to just throw the game at it to see how well it does, and the answer is mostly not well. It's too blind to tell one tree from another, doesn't have the spatial awareness to navigate beyond its vision range, doesn't have the context length to memorize what failed in the past and needs to be avoided. It "sees" passages that aren't there, tries to bump through impassible walls all the time (and telling it not to do that would be worse because Pokemon does require you to bump into solid walls to enter the north/side doors of buildings, only south-facing ones get a visible sprite). That it got as far as it has is a miracle, and one day it might blunder through the spinner maze it's been stuck in since getting through rock tunnel.
In Vermilion City in that image you posted, it spent multiple days stuck on the small peninsula with the house there because it was trying to get to the end of the pier, knew the target was far south, and it couldn't figure out that it needed to go northeast to ultimately get to the goal further south. Just going around an obstacle wider than the screen width is beyond its ability. It even tried (and failed) to make an ASCII map at one point for that purpose.
Page 1