《A Hardness of Minds》Chapter 7 Earth. Erosion
Advertisement
Dalton worked through the evening into the night. The possibility conquered his imagination. What if one could generate adversarial data so well, it would force the lander’s AI into making a poor decision—a fatal one? The only problem for him was the environment. The spacecraft was bathed in belts of Jovian radiation. Bad data, lost signals, it was all expected. One couldn’t just drop 3% of the data and expect the software to crash. The embedded algorithm had a concept of physics. Its mind was hardened with an expectation of bad data weighted against a consensus of correct data. It had millions of simulated orbits and landing. Dalton couldn’t fake fifty percent of data, the probe would still have a strong chance of success. Initially, the badness had to be subtle. The lying data needed to be correlated with reality but deviated at the tail. The fraudulent information smoothed down a slippery slope until a point of no return. To a point where no amount of correct data could save the lander, it had too small of a thruster to get back into a stable orbit. Once the small Ion thruster detached, it would land or crash. Bathed in bands of radiation from Jupiter, no parking orbit was safe for machine (or man).
He mixed positive examples with bad approaches. But there were still sharp discontinuities the AI might detect.
A gentile landing with 0.25 m/s vertical speed doesn’t just become a 100 m/s impact in a split second by setting the value to 100. The AI was too smart for that. They had trained it on millions of runs before leaving Earth. It would eject that bad data, reboot the radar, estimate vertical speed from its cameras or accelerometers or signal strength to the Europa Clipper. Anything and everything run instantly.
Nor could Dalton just invert the reward function: give it maximum reward for crashing instead of landing. It had a complex idea of ‘success’ saved in a large matrix that was not easily perturbed. Averages, convolutions, non-random noise. He had to confound it slowly over several generations. Tug the AI into a local minima where it thought it was secure. Until it felt the slam of cold ice onto the steel hull. Too late then.
Advertisement
But this was still purely theoretical to Dalton. Instead of using a generative adversarial network (or GAN), to develop the algorithm into a better one, he used a second hidden adversary to generate the bad data to feed into the good system to minimize the reward.
Dalton thought out loud (possibly to the sleeping cat, but mostly to himself). “Imagine: a forger makes fake money, and the Secret Service discovers the fake money. Then forger gets arrested, he doesn’t improve his con. The money’s good.”
The cat made no movement.“Now imagine Mr. Forger gets away without being caught. Eventually, the forger gets so good that the forgery is identical to the real thing. And caught only half the time, because the Service is purely guessing: Real or Fake.”
“What if the counterfeiter broke into the Secret Service’s office and swapped the real money, the trusted ground truth, with fake money?” Dalton put his hands on his head. “Well now, the agents would notice immediately. The initial counterfeit would look like a kid scribbling a paper dollar in green crayon. They’re trained.”
“But…” Dalton wagged his finger in the air. “Imagine the counterfeiter had someone on the inside who slowly slipped in remarkably good fakes into the training stack of money that the Secret Service compared to? Why, the counterfeiter could erode the sharp eyes of the detectives.”
So Dalton stood up a third algorithm whose overall maximal goal was the ‘long con.’ He let out a big hoot. The startled cat on the couch looked up. “Dalton H. Chatsworth, you are a genius.” He looked over at the two-tone cat, who had already laid its head back on the sofa.
He compiled the LanderAI Model on his machine and tested it on more realistic data. The first landing one was a failure (well, a success, depending how you looked at it). A few more runs, and tweaks of the hyper-parameters led him to a success. The simulated lander impacted at fifty meters a second and littered its digital pieces on a false Europa. The large horizontal speed spread them far.
Advertisement
“Ha Jim—and the Trillionaire—you’re only as good as my bad data!” He pointed his index finger at the screen. He was never serious about uploading it. Sure, he toyed with the idea. Even if he sent it, the AI wasn’t scheduled to be updated any more. A change freeze was in effect, but Dalton didn’t know the date exactly. But since they would make all the software public after the landing, he never was serious. Still, it could do something nasty, and this was already an amazingly difficult landing. Perhaps another minor tweak… and roll this change into the one CCS ordered me to make…
He opened up GitHub and saw his changes refresh but did not commit. There in the computer window, he irreverently mocked Jim, the one who has given him a break by selecting him as his undergraduate assistant. He also mocked the Trillionaire, who would certainly be remembered in the history books. More fame and likes unequally distributed to those who already had it.
Sure, Dalton worked hard and studied, and had earned his dues. But he was morally weak and information obese. Not a bad human, just a very average one. He might scorn the hand that fed him, but never would scar it. To top it all off, he was still something of a scientist and this was the top mission at the moment. Dalton had zero intention of committing it. This was hardly even a flirt with disaster! It was a car driving thirty miles per hour to a cliff a mile away.
He left his computer open and on the commit screen. He was thrilled and slightly success crazed. “Mr. Waffles, I’m going out tonight.”
Back in his bedroom, he got dressed. The only other thing he had that approached a hobby to others was gambling—well looking for exploits. He didn’t consider it gambling, if he could alter his luck.
In the living room with a suit and nice shoes, he spoke again to the disinterested cat. “I’m off to the casino to earn us some tuna.” Dalton slammed the door, and the neighbors heard him double-descending the stairs steps. Whump, whump, whump.
The cat looked around, got up and proceeded towards the useless electric box that commanded his owner’s attention.
He jumped up onto the table and looked at the keyboard. looks like a nice button to press, thought Mr. Waffles. Well, not really. Mr. Waffles was just a cat.
What the cat saw was a package of cat treats on the other side of the desk. Dalton did not fully shut the plastic zip enclosure, and the cat caught the scent of the treats. As Mr. Waffles walked over to knock over the bag, his paw hit the large button, committing the venomous code to review for all to see.
Dalton had always wanted to be known to the scientific community. The cat would make him infamous.
Europa, attempt no landings there.
Advertisement
- In Serial11 Chapters
Wilbor
Rory Wilbor receives word that his grandfather, General 'Mad Boar' Wilbor, has passed away. The ensuing power struggle for succession of the barony leaves him exiled and penniless. Injured in an accident that leaves him unable to wield Aura, Rory struggles to survive in an empire ravaged by political turmoil, famine, and war. Meanwhile, Rory begins to dream of a world with cities that glow as bright as day during the night, with buildings of steel and glass that tower into the sky ...
8 135 - In Serial6 Chapters
Jacob's Travels
When Jacob, along with his friends, fell in a world so utterly different from ours, one filled with life so weird, only the maddest of people could even dream them, physics so convoluted that they're more like guidelines than any law, and all manner of intelligent beings morphing the world to their whim, he decided to do the logical thing. He panicked.
8 209 - In Serial124 Chapters
Let's Play: Chronicles of Zurefgar
"Fight on, live on...."Those were the words of the mysterious girl that had saved Pras from his downfall after his tragic dispute and betrayal on the hands of his e-sport teammates. Three years had passed since then. Now, to fulfill his promise and break the chains of his past, Pras helped his current friends to achieve the maximum level in a VRMMORPG titled Chronicles of Zurefgar in order to enable them to enter a multi game PvP event named The Clashing Realms.Conflicts and meetings that Pras had with people from his past in the game had opened up old wounds. Yet, he received a helping hand from a person he would never have imagined. Slowly, he learned that it was not only about him helping others, but it was him that was being saved.Note: New episode every Tuesday, Thursday, and Saturday (12 PM UTC +00) cover by Konnyapon
8 72 - In Serial11 Chapters
Unprotected Sects
When freshly-graduated Dr. Selva Imroth accepted a short job from her former doktormutter, she had expected to interview a few PhD washouts and write a report to the Dean. Unfortunately for Selva, everything in her life has to be an ordeal. Updates every weekday, but not on the weekend. I hadn't planned on doing NaNoWriMo, but then on Halloween night I was sharing an old plot bunny with a new friend and realized, "oh shit I can actually use this." So, here we are. Thanks, friend. In true NaNoWriMo fashion, I will not be using my typical editing process here, and will instead simply vomit words onto your screen as quickly as possible, trying valiantly to avoid asking myself "oh my god who CARES" because tangents are important to wordcount. [Participant in the Royal Road Writathon challenge]
8 105 - In Serial11 Chapters
Chloé x Jean-Jacques
What's up, dudes? Me writing more vnc ship fics? It's more likely than you think. I probably won't update this as often as my vanoé one but please understand I love these 2 dearly.
8 91 - In Serial56 Chapters
Lost Fantasy-Life After Reincarnation (Arc 1)
"I am not the hero."That is the conclusion that Loganel Ainzloft came up. He was originally a young man who woke up one day in a fantasy world in the body of a child. However, as time went by, he slowly lost his memories of his previous life and slowly became Loganel Ainzloft. However, one day, as another boy is teleported to this world to defeat the Demon King, Loganel began to remember."I should've been the hero..."#72 in Fantasy 02/14/18
8 175

