Close Menu
    Trending
    • Creating AI that matters | MIT News
    • Scaling Recommender Transformers to a Billion Parameters
    • Hidden Gems in NumPy: 7 Functions Every Data Scientist Should Know
    • Is RAG Dead? The Rise of Context Engineering and Semantic Layers for Agentic AI
    • ChatGPT Gets More Personal. Is Society Ready for It?
    • Why the Future Is Human + Machine
    • Why AI Is Widening the Gap Between Top Talent and Everyone Else
    • Implementing the Fourier Transform Numerically in Python: A Step-by-Step Guide
    ProfitlyAI
    • Home
    • Latest News
    • AI Technology
    • Latest AI Innovations
    • AI Tools & Technologies
    • Artificial Intelligence
    ProfitlyAI
    Home » A new AI translation system for headphones clones multiple voices simultaneously
    AI Technology

    A new AI translation system for headphones clones multiple voices simultaneously

    ProfitlyAIBy ProfitlyAIMay 9, 2025No Comments3 Mins Read
    Share Facebook Twitter Pinterest LinkedIn Tumblr Reddit Telegram Email
    Share
    Facebook Twitter LinkedIn Pinterest Email


    Spatial Speech Translation consists of two AI fashions, the primary of which divides the house surrounding the individual carrying the headphones into small areas and makes use of a neural community to seek for potential audio system and pinpoint their path. 

    The second mannequin then interprets the audio system’ phrases from French, German, or Spanish into English textual content utilizing publicly accessible knowledge units. The identical mannequin extracts the distinctive traits and emotional tone of every speaker’s voice, such because the pitch and the amplitude, and applies these properties to the textual content, basically making a “cloned” voice. Which means when the translated model of a speaker’s phrases is relayed to the headphone wearer a number of seconds later, apparently it’s coming from the speaker’s path and the voice sounds quite a bit just like the speaker’s personal, not a robotic-sounding laptop.

    Provided that separating out human voices is tough sufficient for AI techniques, with the ability to incorporate that capability right into a real-time translation system, map the gap between the wearer and the speaker, and obtain first rate latency on an actual system is spectacular, says Samuele Cornell, a postdoc researcher at Carnegie Mellon College’s Language Applied sciences Institute, who didn’t work on the venture.

    “Actual-time speech-to-speech translation is extremely laborious,” he says. “Their outcomes are excellent within the restricted testing settings. However for an actual product, one would wish rather more coaching knowledge—probably with noise and real-world recordings from the headset, slightly than purely counting on artificial knowledge.”

    Gollakota’s staff is now specializing in lowering the period of time it takes for the AI translation to kick in after a speaker says one thing, which is able to accommodate extra natural-sounding conversations between folks talking completely different languages. “We need to actually get down that latency considerably to lower than a second, in an effort to nonetheless have the conversational vibe,” Gollakota says.

    This stays a serious problem, as a result of the velocity at which an AI system can translate one language into one other is determined by the languages’ construction. Of the three languages Spatial Speech Translation was educated on, the system was quickest to translate French into English, adopted by Spanish after which German—reflecting how German, in contrast to the opposite languages, locations a sentence’s verbs and far of its which means on the finish and never originally, says Claudio Fantinuoli, a researcher on the Johannes Gutenberg College of Mainz in Germany, who didn’t work on the venture. 

    Lowering the latency might make the translations much less correct, he warns: “The longer you wait [before translating], the extra context you’ve gotten, and the higher the interpretation can be. It’s a balancing act.”



    Source link

    Share. Facebook Twitter Pinterest LinkedIn Tumblr Email
    Previous ArticleClustering Eating Behaviors in Time: A Machine Learning Approach to Preventive Health
    Next Article Svenska AI-reformen – miljoner svenskar får gratis AI-verktyg
    ProfitlyAI
    • Website

    Related Posts

    AI Technology

    Why AI should be able to “hang up” on you

    October 21, 2025
    AI Technology

    From slop to Sotheby’s? AI art enters a new phase

    October 17, 2025
    AI Technology

    Future-proofing business capabilities with AI technologies

    October 15, 2025
    Add A Comment
    Leave A Reply Cancel Reply

    Top Posts

    The Automation Trap: Why Low-Code AI Models Fail When You Scale

    May 16, 2025

    Simulating Flood Inundation with Python and Elevation Data: A Beginner’s Guide

    May 30, 2025

    Efficient Graph Storage for Entity Resolution Using Clique-Based Compression

    May 15, 2025

    Unpacking the bias of large language models | MIT News

    June 17, 2025

    Studenter kan Vibe koda med Cursor Pro helt gratis i ett helt år

    May 8, 2025
    Categories
    • AI Technology
    • AI Tools & Technologies
    • Artificial Intelligence
    • Latest AI Innovations
    • Latest News
    Most Popular

    MIT gears up to transform manufacturing | MIT News

    August 13, 2025

    Physics-Informed Neural Networks for Inverse PDE Problems

    July 29, 2025

    Pedestrians now walk faster and linger less, researchers find | MIT News

    July 24, 2025
    Our Picks

    Creating AI that matters | MIT News

    October 21, 2025

    Scaling Recommender Transformers to a Billion Parameters

    October 21, 2025

    Hidden Gems in NumPy: 7 Functions Every Data Scientist Should Know

    October 21, 2025
    Categories
    • AI Technology
    • AI Tools & Technologies
    • Artificial Intelligence
    • Latest AI Innovations
    • Latest News
    • Privacy Policy
    • Disclaimer
    • Terms and Conditions
    • About us
    • Contact us
    Copyright © 2025 ProfitlyAI All Rights Reserved.

    Type above and press Enter to search. Press Esc to cancel.