Transcribe timeline need long time and result is "funny"

Get answers to your questions about color grading, editing and finishing with DaVinci Resolve.
  • Author
  • Message
Offline

DaveCGN

  • Posts: 6
  • Joined: Fri Jan 17, 2020 11:26 pm
  • Real Name: David Cologne

Transcribe timeline need long time and result is "funny"

PostFri Jan 10, 2025 1:01 pm

Hello,

I am using audio transcription very successful in Davinci Resolve Studio 19.1 Build 12. Only sometimes I get "funny" translations like today.

My 1.5 minute timeline needed minutes to transcribe (usually it's much faster). Instead of transcribing the audio completely it just starts good and then writes

"Untertitel im Auftrag des ZDF, 2017"

You can see it on the attached screenshot. The woman (speaker, speaking in German) is speaking much more, but her last sentences are completely missing.

2025-01-10 133403.png
2025-01-10 133403.png (469.5 KiB) Viewed 626 times


Usually text recognition from audio works great in German language. It looks like a bug in this fantastic feature.

To help investigating I made some more screenshots. When clicking on the transcription, you can see what parts of the timeline are responsible.

2025-01-10 135220.png
2025-01-10 135220.png (581.56 KiB) Viewed 626 times

The screenshot ABOVE has a mistake: The arrow should begin at "Untertitel im Auftrag des ZDF, 2017" a little bit higher!


2025-01-10 135344.png
2025-01-10 135344.png (725.67 KiB) Viewed 626 times


So it looks like the (...) represents a lot of text, and the "Untertitel im Auftrag des ZDF, 2017" is silence.

Is that bug known already at Davinci Resolve Team? Is there a workaround? In the changelog of the newest version (19.1.2) is no hint about improving transcription, only small changes, so I guess it's not about my version.

Thank you very much

David
Offline
User avatar

Uli Plank

  • Posts: 25040
  • Joined: Fri Feb 08, 2013 2:48 am
  • Location: Germany and Indonesia

Re: Transcribe timeline need long time and result is "funny"

PostFri Jan 10, 2025 1:08 pm

AI is always good for a surprise!
My disaster protection: export a .drp file to a physically separated storage regularly.

Studio 19.1.3
MacOS 13.7.4, 2017 iMac, 32 GB, Radeon Pro 580 + eGPU
MacBook M1 Pro, 16 GPU cores, 32 GB RAM, MacOS 14.7.2
SE, USM G3
Offline

robwuijster

  • Posts: 171
  • Joined: Mon Feb 22, 2021 2:37 pm
  • Real Name: Rob Wuijster

Re: Transcribe timeline need long time and result is "funny"

PostFri Jan 10, 2025 3:40 pm

Uli Plank wrote:AI is always good for a surprise!


And/or a good laugh! ;)
Windows 11 ⊕ Resolve Studio 18.6.5 b7 ⊕ ASUS PRIME X670E-Pro ⊕ AMD Ryzen 9-7900X ⊕ Arctic Liquid Cooler II ⊕ 64GB RAM ⊕ OS SSD Samsung 980Pro 2Tb ⊕ Cache SSD Samsung 870 EVO 1Tb ⊕ Video HD WD Blue 4Tb ⊕ Geforce RTX 3060 12Gb ⊕ BenQ SW270C ⊕ Dell U2412M
Offline

DaveCGN

  • Posts: 6
  • Joined: Fri Jan 17, 2020 11:26 pm
  • Real Name: David Cologne

Re: Transcribe timeline need long time and result is "funny"

PostTue Jan 14, 2025 2:59 pm

Yes, it's funny. Anyone has an idea how to improve that? Maybe from Blackmagic- Team?
Offline

Stephen Swaney

  • Posts: 201
  • Joined: Tue Jun 15, 2021 4:23 pm
  • Location: Michigan, USA
  • Real Name: Stephen Swaney

Re: Transcribe timeline need long time and result is "funny"

PostTue Jan 14, 2025 5:15 pm

Given that everything is a situation, maybe use a bit of audio preprocessing - Voice Isolation, Noise Reduction, a bit of EQ.

I have not tried German, but experiments with English, Australian, and American Hillbilly were quite successful.
Offline
User avatar

Uli Plank

  • Posts: 25040
  • Joined: Fri Feb 08, 2013 2:48 am
  • Location: Germany and Indonesia

Re: Transcribe timeline need long time and result is "funny"

PostWed Jan 15, 2025 3:37 am

My experiences with German were not too bad either (not using "Auto").
Voice Isolation didn't make it any better, sometimes worse. I was impressed how good the AI can be, even with music or much background noise. Sometimes I went back over a passage listening carefully, since the AI got it right and I had difficulties identifying the text (no, my hearing is still OK).
And at other times I also experienced those repetitions or complete nonsense too. Some subtle fiddling with EQ seems to help a bit, but it is what it is.
AI is getting better scarily fast anyway.
My disaster protection: export a .drp file to a physically separated storage regularly.

Studio 19.1.3
MacOS 13.7.4, 2017 iMac, 32 GB, Radeon Pro 580 + eGPU
MacBook M1 Pro, 16 GPU cores, 32 GB RAM, MacOS 14.7.2
SE, USM G3
Offline
User avatar

Marc Wielage

  • Posts: 12691
  • Joined: Fri Oct 18, 2013 2:46 am
  • Location: Hollywood, USA

Re: Transcribe timeline need long time and result is "funny"

PostWed Jan 15, 2025 8:17 am

Stephen Swaney wrote:I have not tried German, but experiments with English, Australian, and American Hillbilly were quite successful.

Ah, "American Hillbilly" sounds interesting.
Certified DaVinci Resolve Color Trainer • AdvancedColorTraining.com
Offline
User avatar

Uli Plank

  • Posts: 25040
  • Joined: Fri Feb 08, 2013 2:48 am
  • Location: Germany and Indonesia

Re: Transcribe timeline need long time and result is "funny"

PostWed Jan 15, 2025 8:50 am

I think I should try some Bavarian or Schwizerdütsch.
My disaster protection: export a .drp file to a physically separated storage regularly.

Studio 19.1.3
MacOS 13.7.4, 2017 iMac, 32 GB, Radeon Pro 580 + eGPU
MacBook M1 Pro, 16 GPU cores, 32 GB RAM, MacOS 14.7.2
SE, USM G3

Return to DaVinci Resolve

Who is online

Users browsing this forum: Bing [Bot], dtzankatian, panos_mts, Ron Simmons, Steve Alexander and 180 guests