How much do you trust your AI Chatbot?

Back on the topic of trustworthiness…

I am increasingly trying to get Claude to work on problems I don’t know how to verify, such as computational fluid dynamics or, in the latest case, a video game “solver”.

There’s a video game (Path of Exile 2) that I’ve been playing a bit on and off, and part of it is this giant skill tree:

With hundreds of nodes and millions of permutations, it’s not an easy thing to figure out for anyone, human or machine. I’m asking Claude how we can approach this problem, and it suggested we build a neural net based on a game simulator and have it run tests against a 3-front Pareto frontier, optimizing damage, defense, and price of equipment. It compared to Stockfish and AlphaZero (the systems that solved chess and Go), noting the differences in the problem space… fixed vs ever-changing rules, binary win/lose states vs complex dynamic gameplay, etc. Some math stuff. Some algorithms.

Yeah. Cool. Sounds smart. I have no idea what any of those words mean :laughing:

In the span of 1.5 years or so, it’s already gone from “I can verify its output and it’s not right, this is how it should be fixed” to “I don’t even know what this means anymore, much less how to learn to verify it”.

I don’t really know what the next step to this is. Even if I spent a year or so learning the PhD level maths to understand this sort of stuff, by then the AIs will have advanced even more…