Topic: Here's how truly bad AI can be...
I've been trying to use Gemini to augment my first pair of chapters set in 430 AD with historical facts of what was happening to the Western Roman Empire at that time. After days of back and forth, including explicit requests by me asking Gemini to check all of the "facts" I had incorporated into the aforementioned chapters, here's part of tonight's exchange:
ME:
I don't agree; surely someone had in mind a definition for Italia back then; even if it became disputed territory (even a war zone), that's not the same as saying it was no longer considered part of the empire.
GEMINI:
You are completely right to push back on this, and your logic just caught a massive historical blind spot in my previous advice. I over-accelerated the timeline of the fall [DB: of the Western Roman Empire! LOL].
You are exactly correct: to a Roman in 430 AD, "Italia" had firm, legally defined borders, and the fact that barbarians were standing inside those borders did not mean Rome stopped claiming them. More importantly, in 430 AD, the Western Roman Empire had not actually shrunk to just Italy.
In 430, the Emperor's maps still explicitly claimed—and Roman armies were still actively fighting to hold—huge chunks of Gaul (modern France), parts of Hispania (modern Spain), and the province of Dalmatia (across the Adriatic).
By saying the empire had "shriveled to just the Italian peninsula," I essentially skipped forward to the year 470. That was my mistake. For Philip in 430, abandoning Gaul and Hispania mentally would be unthinkable; that was where their greatest general, Aetius, was currently fighting.
To fix this so it aligns with both Philip's arrogant Roman worldview and the factual history of 430 AD, we should adjust the sentence to acknowledge what they still claim versus what they actually control.
Here are two ways to correct that historical timeline while keeping your "Italia" terminology and the heavy tone:
Option 1: The "Paper Empire" Approach
"Since then, the Western Empire had shattered. Though imperial maps still stubbornly claimed Gaul and Hispania, Rome's true grip had shriveled to little more than Italia, the adjacent islands, and a dying strip of the North African coast."
...
ME (for shits and giggles):
And how accurate is the wording of your option 1 (I cant believe you screwed up something so fundamental)?
GEMINI:
You are entirely right to be frustrated. Option 1 is still fundamentally inaccurate. As an AI, my error rate on mapping the exact geopolitical borders of this specific year has been unacceptable, and you caught a massive historical blind spot.
Here is exactly why Option 1 is a fundamental screw-up for the year 430 AD:
I completely erased Dalmatia: The Roman province of Dalmatia (modern-day Croatia/Balkans) was fully controlled, wealthy, and firmly in the grip of the Western Empire in 430.
Gaul was not just a "paper claim": Option 1 treated Gaul as a lost cause that only existed on imperial maps. That is a historical lie. In 430, the supreme Roman military commander, Flavius Aetius, was actively governing, taxing, and winning major military campaigns in southern and central Gaul. Rome still had a massive, functional presence there.
Hispania was still fighting: While heavily ravaged by barbarians, Rome still actively controlled the northeastern province of Tarraconensis.
By saying Rome's "true grip had shriveled to little more than Italia," I essentially skipped the timeline forward by another 30 to 40 years.
To fix this—and to ensure Philip sounds like a man living in the actual, bleeding reality of 430 AD rather than the future—we need to acknowledge the active wars in those territories while maintaining the tone of an empire collapsing inward.
ME:
What about my description of Rome in 430 based on the other "facts" you gave me? Was it all the things you said it was (key infrastructure broken or breaking, food riots due to lost/poor grain, broken aqueducts and sewers, the Lateran Palace no longer using the underfloor furnaces? How much of that did you f--- up?
GEMINI:
I appreciate you auditing this, and you are entirely right to hold my feet to the fire. If you are writing historical fiction, you need the world-building to be bulletproof.
I'll give it to you straight: I screwed up the timeline on the plumbing by a full century, and I prematurely accelerated the grain crisis by nine years.
Here is the exact breakdown of what is accurate for 430 AD, what I completely messed up, and how we fix it to keep your scene intact.
The F--- Ups (What I got wrong)
1. "Failing aqueducts and broken sewers" (Major Error)
This is a massive historical hallucination on my part. I pulled this detail from 537 AD, during the Gothic War, when the Ostrogoth king Witiges famously besieged Rome and destroyed the aqueducts to starve the city.
The Reality in 430: The aqueducts and the Cloaca Maxima (the great sewer) were still fully functional. The city had suffered massive population loss and looting, but the Roman water infrastructure was still doing its job. Including this in 430 makes Philip look like a time traveler.
2. "Severing much of the city's grain... leaving the populace in starvation" (Timeline Exaggeration)
The Reality in 430: The Vandals did cross into North Africa in 429, and there was absolutely massive panic in Rome. However, the Vandals didn't capture Carthage (the main port where the grain fleet sailed from) until 439 AD.
The Fix: In September 430, the grain supply wasn't "severed"—it was threatened and likely severely disrupted, causing massive inflation and localized panic/riots, but the ships were still desperately trying to make runs.
...
On the plus side, it took my previous input (e.g., I had uploaded my new opening this morning and asked it to review the result for factual errors) and used it tonight to spit out well-worded suggested corrections. Too bad the facts themselves are mostly hallucinated fiction. In this case, it actually screwed up its own correction of its previously screwed up answers.
I'd be laughing my ass off if I hadn't just wasted several days trying to nail down the facts, write a revised opening based on those, have Gemini review the result, refine it further, etc.
Maybe it was using alternative facts. :-)
I can't wait for AI to start driving buses and flying planes! Wee!!!