Scientific researchers implement an algorithm for reconstructing audio signals from video

Scientific researchers implement an algorithm for reconstructing audio signals from video

Researchers at the Massachusetts Institute of Technology, Microsoft, and Adobe have jointly developed an algorithm that can reconstruct audio signals by analyzing the tiny vibrations of video depicting objects. In a set of experiments, they took vibrations from a potato chip package shot through a soundproof glass from a distance of 15 feet and successfully restored clear sound. In other experiments, they realized the movement of extracting aluminum foil, water surface, and potted plant leaves to reconstruct the video into audio signals. Researchers will present their findings at this year's computer graphics conference Siggraph.
"When the sound hits an object, it can cause the object to vibrate," said researchers at the Massachusetts Institute of Technology's Electrical Engineering and Computer Science. "This kind of vibration creates a very weak visual signal that is usually invisible to the naked eye. People are not aware of this information." The researchers used high-speed cameras that captured 2000 to 6000 frames per second to perform experiments. This is much faster than a 60-frame-per-second smartphone, but lower than a commercial high-speed camera, which can reach 100,000 frames per second. In other experiments, they only use ordinary digital cameras. Because researchers can infer high-frequency vibration information from 60 frames per second video. Although the reconstruction of this sound is not true, the use of high-speed cameras still has various errors, and the experimenter cannot achieve a completely silent environment.
In traditional video, the slight distortion of the object's edge, despite the invisible eyes, contains high-frequency vibration information of the object. This information is enough to produce a potentially useful audio signal. Current researchers have begun to try to determine the material and structural properties of objects from short bursts of sound.

Rotary Dryer can be widely used for the following industries:

[chemical industry]: ammonium sulfate, sulfur alkali, safety powder, ammonium nitrate, urea, oxalic acid, potassium dichromate, polyvinyl chloride, nitric acid phosphate fertilizer, calcium magnesium phosphate fertilizer, compound fertilizer.

[food] industry: glucose, salt, sugar, vitamins, malted milk, strong sugar granules

[mineral products]: talc, bentonite, titanium concentrate, coal, manganese ore, pyrite, limestone, peat

[other]: woodchip, iron powder, flat soybean, waste abrasive, match bar, sawdust, distiller's grains



rotary drum dryer price

Rotary Dryer

Rotary Dryer,Rotary Washing Line,Rotary Drum Dryer,Rotary Dryer Design

Henan Mingyuan Heavy Industrial Machinery Company Co., LTD. , http://www.heavyequipmentchina.com