# How does Zoom (video-conferencing software) insert virtual backgrounds so well?

**URL:** <https://boards.straightdope.com/t/how-does-zoom-video-conferencing-software-insert-virtual-backgrounds-so-well/850808>\
**Category:** Factual Questions\
**Created:** [April 1, 2020, 3:34pm UTC](https://boards.straightdope.com/t/how-does-zoom-video-conferencing-software-insert-virtual-backgrounds-so-well/850808 "2020-04-01T15:34:58Z")\
**Posts on this page:** 8\
**Page:** 2

<div class="post-metadata">

**Author:** ![si\_blakely](https://avatars.discourse-cdn.com/v4/letter/s/d9b06d/32.png) [@si\_blakely](https://boards.straightdope.com/u/si_blakely)\
**Post date:** [April 22, 2020, 9:54am UTC](https://boards.straightdope.com/t/how-does-zoom-video-conferencing-software-insert-virtual-backgrounds-so-well/850808/21 "2020-04-22T09:54:49Z")

</div>

> [@Mangetout](#):
>
> It doesn’t ask you to take a shot of the room without you in frame?  
> (because that would be a really easy way to do it without green screen - the foreground is anything that’s different from the reference image

I just assumed that it filtered the background by identifying pixels in frame that don’t change over time (without requiring an initial image). You can use image analysis methods to build an invariant background around the edges of the less invariant face. It’s similar to digital image stabilization. If there isn’t enough lighting/resolution to create contrast so the camera catches detectable variation of the foreground face, you can get the background bleeding into the face.

That’s how I’d approach it, anyhow (maybe with some face recognition to set focus areas).

---

<div class="post-metadata">

**Author:** ![si\_blakely](https://avatars.discourse-cdn.com/v4/letter/s/d9b06d/32.png) [@si\_blakely](https://boards.straightdope.com/u/si_blakely)\
**Post date:** [April 22, 2020, 10:11am UTC](https://boards.straightdope.com/t/how-does-zoom-video-conferencing-software-insert-virtual-backgrounds-so-well/850808/22 "2020-04-22T10:11:03Z")

</div>

> [@Fiendish\_Astronaut](#):
>
> Has Zoom solved it’s security problems yet?
> 
> [‘Zoom is malware’: why experts worry about the video conferencing platform | Zoom | The Guardian](https://www.theguardian.com/technology/2020/apr/02/zoom-technology-security-coronavirus-video-conferencing)

Well, I joined a corporate Zoom meeting today - the meeting ID has more digits (11 from 9), as does the participant ID (6 or 8 maybe, from 3). This increases the attack space to identify meetings. My corporate account also mandates passwords and waiting rooms now. It’s a bit of a pain to remember to allow customers into the Zoom meetings for support calls.

---

<div class="post-metadata">

**Author:** ![Machine\_Elf](https://avatars.discourse-cdn.com/v4/letter/m/82dd89/32.png) [@Machine\_Elf](https://boards.straightdope.com/u/Machine_Elf)\
**Post date:** [April 22, 2020, 10:56am UTC](https://boards.straightdope.com/t/how-does-zoom-video-conferencing-software-insert-virtual-backgrounds-so-well/850808/23 "2020-04-22T10:56:06Z")

</div>

> [@si\_blakely](#):
>
> I just assumed that it filtered the background by identifying pixels in frame that don’t change over time (without requiring an initial image). You can use image analysis methods to build an invariant background around the edges of the less invariant face. It’s similar to digital image stabilization. If there isn’t enough lighting/resolution to create contrast so the camera catches detectable variation of the foreground face, you can get the background bleeding into the face.
> 
> That’s how I’d approach it, anyhow (maybe with some face recognition to set focus areas).

It’s more sophisticated than that. I can sit absolutely still, and yet the system doesn’t paint the background over me. My wife can walk by behind me, and the system is smart enough to continue painting the background over her.

---

<div class="post-metadata">

**Author:** ![Cheesesteak](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/cheesesteak/32/3694_2.png) [@Cheesesteak](https://boards.straightdope.com/u/Cheesesteak)\
**Post date:** [April 22, 2020, 11:36am UTC](https://boards.straightdope.com/t/how-does-zoom-video-conferencing-software-insert-virtual-backgrounds-so-well/850808/24 "2020-04-22T11:36:12Z")

</div>

On the one hand, it’s pretty amazing, on the other hand it wouldn’t pass muster in an Ed Wood production.

It’s identifying your face, which is pretty typical for technology these days, then uses contrast and pattern recognition to retain your hair and body from the camera feed. It works, and we’re fine with it messing up our hair or shoulders from time to time because it’s a Zoom meeting, not a Hollywood Blockbuster.

---

<div class="post-metadata">

**Author:** ![Mops](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/mops/32/16494_2.png) [@Mops](https://boards.straightdope.com/u/Mops)\
**Post date:** [April 22, 2020, 1:14pm UTC](https://boards.straightdope.com/t/how-does-zoom-video-conferencing-software-insert-virtual-backgrounds-so-well/850808/25 "2020-04-22T13:14:19Z")

</div>

Some observations from using Microsoft Teams (a different software that uses a similar feature):

[ul]  
[li]it is reasonably good with heads with hair on top, but when confronted with male pattern baldness it tends to take a bite out of a bald pate[/li][li]it can be fooled by draping a blanket over one’s shoulders (a colleague called it a Harry Potter effect)[/li][li]when my wife walks behind me she is part of the background, but when she looks over my shoulder she suddenly is part of the foreground.[/li][/ul]

---

<div class="post-metadata">

**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\
**Post date:** [April 22, 2020, 1:29pm UTC](https://boards.straightdope.com/t/how-does-zoom-video-conferencing-software-insert-virtual-backgrounds-so-well/850808/26 "2020-04-22T13:29:06Z")

</div>

[Apparently Zoom lets you change your appearance, too](https://soranews24.com/2020/04/10/japanese-twitter-users-plan-to-open-virtual-beautiful-hostess-bar-hits-major-snag%E3%80%90video%E3%80%91/).

---

<div class="post-metadata">

**Author:** ![Esprise\_Me](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/esprise_me/32/2947_2.png) [@Esprise\_Me](https://boards.straightdope.com/u/Esprise_Me)\
**Post date:** [April 22, 2020, 5:21pm UTC](https://boards.straightdope.com/t/how-does-zoom-video-conferencing-software-insert-virtual-backgrounds-so-well/850808/27 "2020-04-22T17:21:30Z")

</div>

It does a terrible job on my system. I have a Lenovo Thinkpad running Windows 10 Pro. In a reasonably well-lit space, using the integrated camera on either Zoom or WebEx, I get a decent image of my face and whatever is behind me. But when I try to use the virtual background on Zoom, things behind me still appear, while pieces of me disappear. I found a small patch of bare white wall to stand in front of, and that almost worked, but the background showed up in the whites of my eyes! I don’t have a good way to hang a blanket or similar to use as a green screen.

---

<div class="post-metadata">

**Author:** ![Sunspace](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/sunspace/32/1250_2.png) [@Sunspace](https://boards.straightdope.com/u/Sunspace)\
**Post date:** [April 22, 2020, 7:23pm UTC](https://boards.straightdope.com/t/how-does-zoom-video-conferencing-software-insert-virtual-backgrounds-so-well/850808/28 "2020-04-22T19:23:36Z")

</div>

> [@Darren\_Garrison](#):
>
> [Apparently Zoom lets you change your appearance, too](https://soranews24.com/2020/04/10/japanese-twitter-users-plan-to-open-virtual-beautiful-hostess-bar-hits-major-snag%E3%80%90video%E3%80%91/).

I am… surprised by all this! I thought it was just doing the unmoving-background substitution too.

[Previous page](https://boards.straightdope.com/t/how-does-zoom-video-conferencing-software-insert-virtual-backgrounds-so-well/850808.md?page=1)
