# Your company/division pivots and starts working on weapons of war - what is right and why? **URL:** \ **Category:** Great Debates\ **Created:** [May 15, 2018, 2:27pm UTC](https://boards.straightdope.com/t/your-company-division-pivots-and-starts-working-on-weapons-of-war-what-is-right-and-why/814215 "2018-05-15T14:27:14Z")\ **Posts on this page:** 20\ **Page:** 1
**Author:** ![Textual\_Innuendo](https://avatars.discourse-cdn.com/v4/letter/t/898d66/32.png) [@Textual\_Innuendo](https://boards.straightdope.com/u/Textual_Innuendo)\ **Post date:** [May 15, 2018, 2:27pm UTC](https://boards.straightdope.com/t/your-company-division-pivots-and-starts-working-on-weapons-of-war-what-is-right-and-why/814215/1 "2018-05-15T14:27:14Z")
Inspired by the stories about Google working on war drone image recognition AI, and 12 affected employees leaving the company for ethical reasons. Is Google wrong to do this? Are the employees wrong to leave? On the one side, artificial intelligence is going to become a part of various war machines and processes no matter what, and if we don’t do it, China/Russia/Bigscary-stan is going to try. And if you decide to leave rather than work on it, you’re just unpatriotic libtards/commies who want to have your (national defense) cake without paying for it. On the other hand, if you signed up to work for a commercial company with mostly benign goals, why should you have to suddenly be responsible for blowing people up in impoverished developing countries? People, they might add, who have done nothing to us and are likely _incapable_ of doing anything to us. On the gripping hand, surely NOTHING could go wrong by continuing down this path, ending when AI’s are directly responsible for killing people with no human taking part in the decision. Or even if things COULD go wrong, we don’t really have the luxury of worrying about that…after all, that’s just the speed of war in the future - if you waited for a human to decide, all your expensive kit/military installments are going to get blown up and you lose by default! So dopers, what are your thoughts? How do we best balance the competing needs of national defense, individual liberty, and not-being-slaughtered-by-rogue-AI’s? ---
**Author:** ![Procrustus](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/procrustus/32/2994_2.png) [@Procrustus](https://boards.straightdope.com/u/Procrustus)\ **Post date:** [May 15, 2018, 2:32pm UTC](https://boards.straightdope.com/t/your-company-division-pivots-and-starts-working-on-weapons-of-war-what-is-right-and-why/814215/2 "2018-05-15T14:32:06Z")
Google is free to do it. Employees are free to leave. That seems to “balance the competing needs of national defense, individual liberty, and not-being-slaughtered-by-rogue-AI’s.” Maybe I’m missing something. ---
**Author:** ![Textual\_Innuendo](https://avatars.discourse-cdn.com/v4/letter/t/898d66/32.png) [@Textual\_Innuendo](https://boards.straightdope.com/u/Textual_Innuendo)\ **Post date:** [May 15, 2018, 2:56pm UTC](https://boards.straightdope.com/t/your-company-division-pivots-and-starts-working-on-weapons-of-war-what-is-right-and-why/814215/3 "2018-05-15T14:56:05Z")
I’m not sure it does balance those, at a minimum it tips us too far in the “everyone slaughtered” direction. Google has arguably the highest concentrations of high-skilled talent in the world, from data scientists to robotics engineers to software / EE / other engineers, staggering boatloads of money, and the managers to successfully tackle large and complex projects marshaling all those resources. I personally wish that the best and brightest among us **weren’t** working on creating death-dealing AI systems that increasingly take humans out of the loop when deciding whom to kill, and that these problems were left to the third-stringers in various government agencies, who will likely do a much poorer job of it. But that may be just me. ---
**Author:** ![Tom\_Tildrum](https://avatars.discourse-cdn.com/v4/letter/t/e95f7d/32.png) [@Tom\_Tildrum](https://boards.straightdope.com/u/Tom_Tildrum)\ **Post date:** [May 15, 2018, 3:11pm UTC](https://boards.straightdope.com/t/your-company-division-pivots-and-starts-working-on-weapons-of-war-what-is-right-and-why/814215/4 "2018-05-15T15:11:59Z")
> [@Textual\_Innuendo](#): > > I personally wish that the best and brightest among us **weren’t** working on creating death-dealing AI systems that increasingly take humans out of the loop when deciding whom to kill, and that these problems were left to the third-stringers in various government agencies, who will likely do a much poorer job of it. But that may be just me. If you think of it as “deciding whom to kill while seeking to avoid killing innocent people nearby,” it is perhaps easier to see why we might want the best talent possible. Whether that comes from Google, the government, or the traditional defense firms is a different question. ---
**Author:** ![txjim](https://avatars.discourse-cdn.com/v4/letter/t/f07891/32.png) [@txjim](https://boards.straightdope.com/u/txjim)\ **Post date:** [May 15, 2018, 3:16pm UTC](https://boards.straightdope.com/t/your-company-division-pivots-and-starts-working-on-weapons-of-war-what-is-right-and-why/814215/5 "2018-05-15T15:16:18Z")
> [@Textual\_Innuendo](#): > > I’m not sure it does balance those, at a minimum it tips us too far in the “everyone slaughtered” direction. > > Google has arguably the highest concentrations of high-skilled talent in the world, from data scientists to robotics engineers to software / EE / other engineers, staggering boatloads of money, and the managers to successfully tackle large and complex projects marshaling all those resources. > > I personally wish that the best and brightest among us **weren’t** working on creating death-dealing AI systems that increasingly take humans out of the loop when deciding whom to kill, and that these problems were left to the third-stringers in various government agencies, who will likely do a much poorer job of it. But that may be just me. I’m sure Google has top-rate talent but they are by no means exclusive in that area. Some pretty amazing things are done by defense contractors, they are just not discussed openly. Having Google work the AI issue is most likely a cost reduction over awarding contracts to someone else but don’t think that if Google opts out the work won’t continue elsewhere. By some pretty bright engineers and scientists. ---
**Author:** ![Velocity](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/velocity/32/18006_2.png) [@Velocity](https://boards.straightdope.com/u/Velocity)\ **Post date:** [May 15, 2018, 3:36pm UTC](https://boards.straightdope.com/t/your-company-division-pivots-and-starts-working-on-weapons-of-war-what-is-right-and-why/814215/6 "2018-05-15T15:36:24Z")
I have no qualms about working for what is essentially a defense contractor. But what the OP is describing is essentially the conscientious-objector situation. In that situation, there doesn’t seem to be any solution except for the disquieted employees to voluntarily leave, unless the employing company is willing to drop its participation in the arms industry if, say, enough employees sign a petition or whatnot. ---
**Author:** ![DavidwithanR](https://avatars.discourse-cdn.com/v4/letter/d/3bc359/32.png) [@DavidwithanR](https://boards.straightdope.com/u/DavidwithanR)\ **Post date:** [May 15, 2018, 5:17pm UTC](https://boards.straightdope.com/t/your-company-division-pivots-and-starts-working-on-weapons-of-war-what-is-right-and-why/814215/7 "2018-05-15T17:17:48Z")
OP: I don’t think your concluding question is fair or right. I don’t think what you listed are competing needs. You are far too willing to assume that the military items are needed, as opposed to desired by someone. And when framed as some individuals wishing, compared to killing people, the question becomes more sensible. ---
**Author:** ![Ravenman](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/ravenman/32/2929_2.png) [@Ravenman](https://boards.straightdope.com/u/Ravenman)\ **Post date:** [May 15, 2018, 5:34pm UTC](https://boards.straightdope.com/t/your-company-division-pivots-and-starts-working-on-weapons-of-war-what-is-right-and-why/814215/8 "2018-05-15T17:34:21Z")
Nobody is proposing to spend a lot of money to develop AI to kill innocent people. That can be done adequately with humans today. I think it’s a pretty good idea to research AI so as to lessen the risk of military operations to innocent people. If some people don’t want anything to do with killing people, or be even loosely affiliated with people who are, I think that’s a perfectly defensible moral position. I don’t agree with it, in this case, but I respect it. But let’s also get some perspective on what is being researched here. Google isn’t building a terminator death drone to rain hellfire on orphanages and especially members of protected classes. Google is working on an algorithm to go through video collected from drones to point people to suspicious activity. So, to the best of my understanding, if there are sensors that can see a truck arriving at a warehouse in a city after visiting a fertilizer plant, and then another truck arrives at the same building after visiting a diesel fuel depot, then the AI would tell an intelligence analyst: “Whoa, they may be building a truck bomb in this warehouse!” If that’s too military-oriented for some of Google’s workers, well, okay. But it is a long way from killbots, too, and I don’t really have a problem with this kind of research. ---
**Author:** ![Textual\_Innuendo](https://avatars.discourse-cdn.com/v4/letter/t/898d66/32.png) [@Textual\_Innuendo](https://boards.straightdope.com/u/Textual_Innuendo)\ **Post date:** [May 15, 2018, 5:46pm UTC](https://boards.straightdope.com/t/your-company-division-pivots-and-starts-working-on-weapons-of-war-what-is-right-and-why/814215/9 "2018-05-15T17:46:10Z")
> [@Tom\_Tildrum](#): > > If you think of it as “deciding whom to kill while seeking to avoid killing innocent people nearby,” it is perhaps easier to see why we might want the best talent possible. It would be nice if this were true, but I don’t think it is for two reasons. First - what are the results if there IS a better AI built, that does twice as good a job at not killing innocents. Great news for everyone, right? But in reality, that means this system will be deployed and used a lot more. If it’s deployed more than twice as much as often as current human-piloted drone-killings, then the net effect is MORE innocent people killed. And it almost certainly will be deployed more, both because it’s “better” in the sense of killing fewer innocent people, and cheaper and faster in the sense of needing much less human input. Then there is the fact that this is a step further along the more pernicious slope of creating successively “better” killing systems that need less and less human input, eventually ending in fully autonomous killing machines. The best and brightest among us would hopefully realize that both of the consequences above are net undesirable, and refrain from working on things that facilitate more innocents killed and greater risk of rogue autonomous killing machines and systems. ---
**Author:** ![Velocity](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/velocity/32/18006_2.png) [@Velocity](https://boards.straightdope.com/u/Velocity)\ **Post date:** [May 15, 2018, 5:53pm UTC](https://boards.straightdope.com/t/your-company-division-pivots-and-starts-working-on-weapons-of-war-what-is-right-and-why/814215/10 "2018-05-15T17:53:43Z")
There are a great many companies in America that contribute towards the defense industry in some way directly or indirectly. If a pacifist cannot stomach working for such an employer, he or she would be greatly limiting their career opportunities. Someone like an engineer might end up working for Texas Instruments or Honeywell or something and then…wait… ---
**Author:** ![DavidwithanR](https://avatars.discourse-cdn.com/v4/letter/d/3bc359/32.png) [@DavidwithanR](https://boards.straightdope.com/u/DavidwithanR)\ **Post date:** [May 15, 2018, 5:54pm UTC](https://boards.straightdope.com/t/your-company-division-pivots-and-starts-working-on-weapons-of-war-what-is-right-and-why/814215/11 "2018-05-15T17:54:43Z")
The humans in the armies are already a rogue autonomous killing system. ---
**Author:** ![DavidwithanR](https://avatars.discourse-cdn.com/v4/letter/d/3bc359/32.png) [@DavidwithanR](https://boards.straightdope.com/u/DavidwithanR)\ **Post date:** [May 15, 2018, 5:55pm UTC](https://boards.straightdope.com/t/your-company-division-pivots-and-starts-working-on-weapons-of-war-what-is-right-and-why/814215/12 "2018-05-15T17:55:56Z")
The United States is lucky enough never to have had a defense industry. It’s been an offense industry from day 1. ---
**Author:** ![Ravenman](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/ravenman/32/2929_2.png) [@Ravenman](https://boards.straightdope.com/u/Ravenman)\ **Post date:** [May 15, 2018, 6:28pm UTC](https://boards.straightdope.com/t/your-company-division-pivots-and-starts-working-on-weapons-of-war-what-is-right-and-why/814215/13 "2018-05-15T18:28:37Z")
Such clever one-liners – let’s go for three in a row! ---
**Author:** ![Procrustus](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/procrustus/32/2994_2.png) [@Procrustus](https://boards.straightdope.com/u/Procrustus)\ **Post date:** [May 16, 2018, 3:02pm UTC](https://boards.straightdope.com/t/your-company-division-pivots-and-starts-working-on-weapons-of-war-what-is-right-and-why/814215/14 "2018-05-16T15:02:31Z")
> [@Velocity](#): > > There are a great many companies in America that contribute towards the defense industry in some way directly or indirectly. If a pacifist cannot stomach working for such an employer, he or she would be greatly limiting their career opportunities. So does a PhD in Roman Literature. We all make choices. It’s not that hard to avoid jobs you don’t want. ---
**Author:** ![Jasmine](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/jasmine/32/2964_2.png) [@Jasmine](https://boards.straightdope.com/u/Jasmine)\ **Post date:** [May 16, 2018, 3:14pm UTC](https://boards.straightdope.com/t/your-company-division-pivots-and-starts-working-on-weapons-of-war-what-is-right-and-why/814215/15 "2018-05-16T15:14:53Z")
> [@Procrustus](#): > > We all make choices. It’s not that hard to avoid jobs you don’t want. +1 ---
**Author:** ![Ashtura](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/ashtura/32/2963_2.png) [@Ashtura](https://boards.straightdope.com/u/Ashtura)\ **Post date:** [May 16, 2018, 4:35pm UTC](https://boards.straightdope.com/t/your-company-division-pivots-and-starts-working-on-weapons-of-war-what-is-right-and-why/814215/16 "2018-05-16T16:35:51Z")
Is it wrong for a company to start doing military contracts? No. If I were working for google, I simply wouldn’t work on the project If I were uncomfortable with the project. Let’s say they were working on a pornography algorithm (which I’m sure they have). If I didn’t like pornography, I wouldn’t work on that. I probably wouldn’t quit unless they forced me to work on a project I objected to. OTOH, I also would never work for google with the assumption that they have “mostly benign goals”. ---
**Author:** ![Bryan\_Ekers](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/bryan_ekers/32/183_2.png) [@Bryan\_Ekers](https://boards.straightdope.com/u/Bryan_Ekers)\ **Post date:** [May 16, 2018, 4:36pm UTC](https://boards.straightdope.com/t/your-company-division-pivots-and-starts-working-on-weapons-of-war-what-is-right-and-why/814215/17 "2018-05-16T16:36:21Z")
> [@Ravenman](#): > > Such clever one-liners – let’s go for three in a row! Killing civilians should never be left to an “I’m feeling lucky” decision! ---
**Author:** ![Flyer](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/flyer/32/7298_2.png) [@Flyer](https://boards.straightdope.com/u/Flyer)\ **Post date:** [May 16, 2018, 4:45pm UTC](https://boards.straightdope.com/t/your-company-division-pivots-and-starts-working-on-weapons-of-war-what-is-right-and-why/814215/18 "2018-05-16T16:45:29Z")
> [@DavidwithanR](#): > > The United States is lucky enough never to have had a defense industry. It’s been an offense industry from day 1. I somehow missed the history lesson where George Washington invaded England. ---
**Author:** ![Ravenman](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/ravenman/32/2929_2.png) [@Ravenman](https://boards.straightdope.com/u/Ravenman)\ **Post date:** [May 16, 2018, 4:56pm UTC](https://boards.straightdope.com/t/your-company-division-pivots-and-starts-working-on-weapons-of-war-what-is-right-and-why/814215/19 "2018-05-16T16:56:05Z")
> [@Bryan\_Ekers](#): > > Killing civilians should never be left to an “I’m feeling lucky” decision! You make it sound like it should be done more deliberately. ---
**Author:** ![Procrustus](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/procrustus/32/2994_2.png) [@Procrustus](https://boards.straightdope.com/u/Procrustus)\ **Post date:** [May 16, 2018, 4:58pm UTC](https://boards.straightdope.com/t/your-company-division-pivots-and-starts-working-on-weapons-of-war-what-is-right-and-why/814215/20 "2018-05-16T16:58:16Z")
> [@Flyer](#): > > I somehow missed the history lesson where George Washington invaded England. Well, you could say we (the U.S.) declared war on England in the Declaration of Independence. [Next page](https://boards.straightdope.com/t/your-company-division-pivots-and-starts-working-on-weapons-of-war-what-is-right-and-why/814215.md?page=2)