Speech enhancement

Using Videopipe to make the speech in your video more clear.

🧰 What is this feature?

The speech enhancement model takes a video file (.mp4) and enhances the perceptual quality of speech in the video by removing noise, background music, etc.

🔧 How to use it?

1️⃣ Export audio: Use AVID media composer to send a video using the following ‘send to playback profiles’. Make sure to remember the filename of the input.

RTL Nieuws Online Editorial Team: NIEUWS_AZURE_DI_ENHANCE_SPEECH

Promo Editors: PROMO_AZURE_DI_ENHANCE_SPEECH

Please make sure that there are no spaces in the filename. Example of some correct filenames are enhancemepls.mp4, enhance_me.mp4. Filenames like enhance me.mp4 will not work.

⁠

2️⃣ Wait for processing: Grab a ☕ and wait 3 to 10 minutes for the audio to be processed. Longer input files will take longer to process.

⁠

3️⃣ Download audio files: You will find the separated audio files in a file folder you can access, where filename is the filename of the audio you sent in step 1. The folder location is as mentioned on the right →

RTL Nieuws Online Editorial Team:

Enhanced speech: It is automatically ingested into Interplay at Incoming Media\Nieuws ingest.

Promo Editors:

Enhanced speech: It is automatically ingested into Interplay at Promo\04 to Promo\04 Mediadesk to Promo.

⁠

❌ Did not receive the files?

Things can go wrong, even machines make mistakes. Did you wait 20 minutes and are the audio files are still not in your dropbox location? Here’s what you can do:

✉️ Contact Data Science: Ask in the slack channel

#videopipe-for-editors⁠

what the status is on the audio, make sure to mention the filename in the message so we know what to look for. A Data Scientist will try to help you out as soon as possible!

⁠

🤖 A little note of appreciation for the model:

The model behind the speech enhancement model is DeepFilterNet by Hendrik Schroter, Alberto N. Escalante-B, Tobias Rosenkranz, and Andreas Maier.

The model is enabled by exploiting domain knowledge of speech production and psychoacoustic perception. You can read more about the model

here⁠

⁠

Want to print your doc?
This is not the way.

Try clicking the ⋯ next to your doc name or using a keyboard shortcut (

CtrlP

) instead.