Sony Corporation is the electronics business unit and the parent company of the Sony Group, which is engaged in business through its four operating components: electronics (AV, IT & communication products, semiconductors, video games, network services and medical business), motion pictures, music and financial services. These make Sony one of the most comprehensive entertainment companies in the world. The group consists of Sony Corporation, Sony Pictures Entertainment, Sony Interactive Entertainment, Sony Music Entertainment, Sony Financial Holdings and others. Sony is among the semiconductor sales leaders and as of 2016, the fifth-largest television manufacturer in the world after Samsung Electronics, LG Electronics, TCL and Hisense. The company’s current slogan is BE MOVED. Their former slogans were make believe.
A direction of a sound source located in the surrounding of a detector of a panoramic video is established. A preset view of the panoramic video is determined based on the established direction. Playback of the panoramic video is based on the determined preset view. Various embodiments relate to a method of processing a panoramic video, a method of playing back a panoramic video, and to corresponding devices. In particular, various embodiments relate to techniques of determining a view of the panoramic video based on a direction of sound source.
US 9,686,467 Patent is all about
BACKGROUND OF THE INVENTION
Detectors are known which are capable of capturing a panoramic video, i.e., a video which images a significant part of a surrounding of the detector. Sometimes, it may be desirable to play back the panoramic video on a size-limited display device such as a conventional two-dimensional (2d) screen with a limited resolution. In such a case, it is possible that parts of the panoramic video need to be cropped and thereby omitted from the playback. It is also possible that the panoramic video gets warped or distorted at playback to fit the dimensions of the 2d screen. Such effects limit the quality of the playback. Further, information relevant for the user may be lost.
Therefore, a need exists to provide techniques which address at least some of these shortcomings. In particular, there is a need to provide techniques which enable comfortable play back of a panoramic video on size-limited display devices.
Detailed Concept
According to an aspect, a method of processing a panoramic video is provided. The method comprises retrieving video data of a panoramic video. The panoramic video images a first part of a surrounding of a detector. The method further comprises establishing a direction of a sound source located in the surrounding of the detector of the panoramic video. The method further comprises determining control data indicating a preset view of the panoramic video based on the establishing of the direction of the sound source.
The device comprises a processor configured to retrieve video data of a panoramic video. The panoramic video images of a surrounding of a detector of the panoramic video. The processor is further configured to establish a direction of a sound source located in the surrounding of the detector. The processor is further configured to determine control data indicating a preset view of the panoramic video based on said establishing of the direction of the sound source.
Conclusion
A method of playing back a panoramic video is provided. The method comprises retrieving video data of a panoramic video. The method further comprises retrieving control data indicating a preset view of the panoramic video. The preset view relates to a direction of a sound source located in a surrounding of a detector of the panoramic view. The method further comprises determining a view of the panoramic video based on the preset view. The method further comprises playing back the panoramic video employing the determined view.
A method of processing a panoramic video, comprising: retrieving video data of a panoramic video, the panoramic video imaging a first part of a surrounding of a detector of the panoramic video; establishing a direction of a sound source located in the surrounding of the detector; based on said establishing of the direction of the sound source, determining control data indicating a preset view of the panoramic video, the preset view imaging a second part of the surrounding of the detector, and storing, in computing memory, a portion of the video data containing the preset view of the panoramic video, and absent storing, in the computing memory, a remaining portion of the video data outside the second part of the surrounding of the detector to discard the remaining portion.
