I was home schooled from childhood through highschool. I got a GED before I joined the military, then used the GI bill to go to university and took placement tests for everything, which put me at the same level as everyone else except for trigonometry, which I had to take a remedial class in.
I attended a federal contracting conference a few months ago, and they had one of these things (or a variant) walking around the lobby.
From talking to the guy who was babysitting it, they can operate autonomously in units or be controlled in a general way (think higher level unit deployment and firing policies rather than individual remote control) given a satellite connection. In a panel at the same conference, they were discussing AI safety, and I asked:
(Paraphrasing, obviously, but this is close)
The panel members looked at each other, looked at me, smiled, shrugged, and didn’t say anything. The moderator asked them explicitly if they would like to respond, and they all declined.
I think we’re at the point where an AI could be used to create strategies, and I would be very surprised if no one were trying to do this. We already have autonomous weapons, and it’s only a matter of time before someone starts putting them together. Yeah, they will generally act reasonably, because they’ll be trained on human tactics in a variety of scenarios, but that will be cold comfort to dead civilians who happened to get in the way of a hallucinating strategic model.
EDIT: I know I’m not actually addressing anything you said, but you seem to have thought about this a bit, and I was curious about what you thought of this scenario.