Invert Voice Isolation

  • Author
  • Message
Offline

Zeke Faust

  • Posts: 32
  • Joined: Mon Sep 25, 2017 7:46 pm

Invert Voice Isolation

PostMon Jan 23, 2023 1:24 am

Pretty self explanatory. Since we can isolate the voice track, it makes sense to me to have an "invert" button so that the voice is removed, and only the ambient sound remains.

Case study: I have some footage recorded in the rain, and I want to boost the voices to make them more clear, but without adjusting the rain sound.

With this feature, I'd duplicate the audio track, enable voice isolation on both, and "invert" the rain track. Then I could enhance/boost only the voice however I need. Without the feature, I'd get a doubling effect if I tried this.
Threadripper 3960x
128GB memory
NVIDIA GeForce RTX 3090
Offline

ArcanePath

  • Posts: 12
  • Joined: Thu Jan 19, 2023 2:45 pm
  • Real Name: Danny Akuma

Re: Invert Voice Isolation

PostSat Feb 04, 2023 12:38 pm

I second this. It would be a great tool, like being able to have multi channel audio from a single track. You could change the pitch of a voice for example, without changing the pitch of the background noises.
Offline

Andy Mees

  • Posts: 2423
  • Joined: Wed Aug 22, 2012 7:48 am

Re: Invert Voice Isolation

PostSat Feb 04, 2023 1:41 pm

+1 ... in the meantime, I've been using this online service with some success, it creates separate stems:
https://vocalremover.org/
Let's have a return to the glory days, when press releases for new versions included text like "...with over 300 new features and improvements that professional editors and colorists have asked for."
Offline

ricardo marty

  • Posts: 1452
  • Joined: Wed Apr 26, 2017 4:03 am

Re: Invert Voice Isolation

PostSat Feb 04, 2023 4:52 pm

+2

Ricardo Mary
DVR_S 18, Asus ProArt PD5, 2.5 GHz i7 8-Core 64GB of 3200 MHz DDR4 RAM GeForce RTX 3070 1TB M.2 NVMe Window 11
Legion 2.6 i7 10750h 2.6, 64gb 3200mhz, rtx 2060, 1tb ssd M.2 Win 11
BenQ PD3420Q, Sony FS700R, Bmp4k, Sony A6600. PreSonus AudioBox
Offline
User avatar

jamedia

  • Posts: 870
  • Joined: Sun Apr 14, 2019 7:21 pm
  • Location: Birmingham UK
  • Real Name: Chris Hills

Re: Invert Voice Isolation

PostSat Feb 04, 2023 9:31 pm

+2
There are times you need the background sound to cover gaps in the audio when editing in B-Roll. Removing the voice would give you more audio to play with.

As an aside I had cause to use voice isolation on an outdoor interview in a public street. Amazing!
www.JAmedia.uk
[AMD Ryzen 5950X 16 Core CPU | 128GB Ram | NVIDIA 3080TI 12GB ]
[MB ASUS ProArt B550| C Drive:; 1TB M2 980 Pro | D Drive; 2TB M2 970 EVO ]
[ Win 10 home |Resolve Studio V18 | Speed Editor via USB | Scarlett 2i2 3rd Gen| ]
Offline
User avatar

Marc Wielage

  • Posts: 9263
  • Joined: Fri Oct 18, 2013 2:46 am
  • Location: Hollywood, USA

Re: Invert Voice Isolation

PostMon Feb 06, 2023 11:09 am

Zeke Faust wrote:Pretty self explanatory. Since we can isolate the voice track, it makes sense to me to have an "invert" button so that the voice is removed, and only the ambient sound remains.

I think that makes sense. I know there's an invert feature in iZotope RX, and we can use that to figure out when we've gone too far in increasing the NR level. Voice Isolation is different, but it'd still be nice to be able to listen to what's being filtered out to understand the compromises and artifacts.
marc wielage, csi • VP/color & workflow • chroma | hollywood
Offline

Leonel Dolara

  • Posts: 2
  • Joined: Tue Jul 23, 2019 4:11 pm
  • Real Name: Leonel Dolara

Re: Invert Voice Isolation

PostFri Feb 10, 2023 3:54 pm

I too second this, I think it should not be difficult to deliver the sound that was left behind when isolating the voice, as the IA process has already been made, it's not a new process.

Sometimes we need that background noise to add in another scene where it should be but for a mistake in the continuity of the shots it is not.

Hope it will be added soon!!!

Kindest regards,
Offline
User avatar

Johan Fleetwood

  • Posts: 106
  • Joined: Tue Mar 21, 2017 12:52 pm
  • Location: Sweden

Re: Invert Voice Isolation

PostFri Feb 10, 2023 10:35 pm

Yes, that's a good suggestion!
Johan Fleetwood
Colorist | Editor | Post Production Consultant
- Win10pro, RTX 2080, Decklink, Mini Panel, Speed Editor, Ample RAM & SSD storage -
Offline
User avatar

Tekkerue

  • Posts: 316
  • Joined: Fri Feb 25, 2022 2:12 am
  • Real Name: Sean Brewer

Re: Invert Voice Isolation

PostSat Feb 11, 2023 9:49 am

+1!

However, it seems like they might have to do a little more than simply invert the voice because it also removes reverb from voice. If the dry voice was simply inverted, then you'd have the voice's reverb tail still present along with the background sounds. This would require some tweaks to the algorithm to also remove the voice's reverb from the background.

If they are able to tweak it to isolate the reverb like that, then it would be cool to have a checkbox to preserve reverb even when isolating the vocal as well. Waves Clarity Vx does preserve reverb when isolating voices, so it is definitely possible to do this.
OS: Windows 10 Pro 64-bit
CPU: Intel Core i7-8700 CPU 3.20GHz
MOBO: ASUS PRIME Z370-A
Graphics: Intel UHD Graphics 630 (Yeah, I know!)
Audio: Audient iD14 USB Interface
Storage: Seagate SATA HDD
Offline
User avatar

jamedia

  • Posts: 870
  • Joined: Sun Apr 14, 2019 7:21 pm
  • Location: Birmingham UK
  • Real Name: Chris Hills

Re: Invert Voice Isolation

PostSat Feb 11, 2023 10:11 am

Tekkerue wrote:+1!

However, it seems like they might have to do a little more than simply invert the voice because it also removes reverb from voice. If the dry voice was simply inverted, then you'd have the voice's reverb tail still present along with the background sounds. This would require some tweaks to the algorithm to also remove the voice's reverb from the background.

If they are able to tweak it to isolate the reverb like that, then it would be cool to have a checkbox to preserve reverb even when isolating the vocal as well. Waves Clarity Vx does preserve reverb when isolating voices, so it is definitely possible to do this.


I had a feeling it might not of been quite so simple. which is probalby why there is no "invert" check box wth the feature.
www.JAmedia.uk
[AMD Ryzen 5950X 16 Core CPU | 128GB Ram | NVIDIA 3080TI 12GB ]
[MB ASUS ProArt B550| C Drive:; 1TB M2 980 Pro | D Drive; 2TB M2 970 EVO ]
[ Win 10 home |Resolve Studio V18 | Speed Editor via USB | Scarlett 2i2 3rd Gen| ]
Offline

Videoneth

  • Posts: 995
  • Joined: Fri Nov 13, 2020 11:03 pm
  • Real Name: Maxwell Allington

Re: Invert Voice Isolation

PostSat Feb 11, 2023 1:25 pm

Check out Spleeter from Deezer here : https://github.com/deezer/spleeter.

It's mostly used to extract instruments and vocals. I personally used it on other things than songs... regular audio with voices and background noises.

It was a while back so I don't remember exactly, but I'm pretty sure that by selecting "2 stems", I got the voice in one file, and whatever was in the background in a second file.

On the github page, they say :
Spleeter pre-trained models have also been used by professional audio softwares. Here's a non-exhaustive list:

iZotope in its Music Rebalance feature within RX 8
SpectralLayers in its Unmix feature in SpectralLayers 7
Acon Digital within Acoustica 7
VirtualDJ in their stem isolation feature
Algoriddim in their NeuralMix and djayPRO app suite


So I imagine this type of operation can be done, if Resolve can isolate voices, it can isolate the background noise.

I didn't use any of the mentioned tools but iZotope is a standalone and a plugin for DAWs right?
So I imagine that the operation can be done in real time.
Windows 10
18.1.2
nVidia 3090 - 527.56

Return to DaVinci Resolve Feature Requests

Who is online

Users browsing this forum: Jim Simon, shebbe and 13 guests