Title of Invention

A METHOD OF CREATING A NEW MEDIA CONTENT

Abstract

This invention relates to the field of Software Desktop application, Feature Phone (Mobile Phone) and Smart phone. More particularly, this invention relates to a new use case for desktop, Mobile phone with video record facility. This invention explains a method of creating a new media content in a mobile phone in real time comprising the steps of: allowing a user to perform playback and recording at a time which enables viewing live video along with playback of recorded media file; and allowing the said user to create a new media content by mixing either original audio and live video or original audio and merged live and recorded video.

Full Text

FIELD OF INVENTION This invention relates to the field of Software Desktop application, Feature Phone (Mobile Phone), Smart phone & handheld device. Further, this invention relates to a new use case for desktop, Mobile phone with video record facility & hand held device for creating a new media content. More particularly, this invention relates to a method of creating new media content. DESCRIPTION OF RELATED ART There are some desktop audio-video editing application available but none of them provides a facility to play original clip and record your own video at a time and mixing of media streams to create a new mobile phone media file format (3gp/3g2/mp4). Therefore this is the only application that allows user to compare original video and live video in real time and also allows user to record same comparison in file. Some handheld devices are available for recording but complete functionality as explained above is not available in one device and the user needs to use multiple devices and tools to create such mobile phone media file format (3gp/3g2/mp4) which consumes time, cost and also, multimedia knowledge to handle the tools is required. LIMITATIONS Currently there is no such application available that allows user to perform recording and playback together in real time to form a new media content. In the current approach user needs to record video and then create a new media content by editing recorded video and original video either using desktop tools or video editor. But this being a non-real time technique it is not possible to create a media content similar to real time effect As the application works in real time, no further editing, processing is required as the new media content is available immediately after closing the application. Due to real time effect it is possible to compare live actions and original actions together and also it is possible to compare both by playing the recorded content in media player. It relieves user from using different devices and tools to generate such kind of media files, saves user time, money and gives real time comparison of original video and recorded video which is not available in any application or device. SUMMARY OF THE INVENTION The invention discloses a new use case of creating a new media content in real time by allowing user to perform playback and recording at a time which enables him to view live video along with playback of recorded media file and also allows the user to create a new media content by mixing either original audio and live video or original audio and merged live and recorded video. Due to this application user can watch and compare original video and live video together in real time and also can record this session in a transportable media format which can be played or can be shared with other users. Accordingly, this invention explains a method of creating a new media content in real time comprising the steps of: (a) allowing a user to perform playback and recording at a time which enables viewing live video along with playback of recorded media file; and (b) allowing the said user to create a new media content by mixing either original audio and live video or original audio and merged live and recorded video. The application provides following features to the user: a. Allows user to play original audio-video mobile phone media file format (3gp/3g2/mp4) and record live video at a time. b. User can watch both original video and live video in Picture in Picture format on display screen to compare live video with original video. The Application provides following two options for recording or to create a new mobile phone media file format (3gp/3g2/mp4): · Option1-Original audio from input mobile phone media file format (3gp/3g2/mp4) as well as live video are written in a new mobile phone media file format (3gp/3g2/mp4). Please refer fig.1. · Option2-lt performs frame by frame real time merging of two videos i.e. decoded video frame from input file and live video frame from 4 camera as displayed in Picture in Picture format. Merged video frame is encoded and written to new mobile phone media file format (3gp/3g2/mp4) along with original audio of input file. This is depicted in the figure 2. Ail above operations are performed in real time. The newly created file can be sent to other users using MMS or IMS file share application or can be played in a media player. Due to simultaneous playback of input media file and live video from Camera user can compare actions in two videos as they are displayed in picture in picture format As application allows an option of recording and creating mobile phone media file format (3gp/3g2/mp4) during this process, the same comparison can be done when the file is played in media player. Thus user can compare recorded actions with original video at the time of executing application and also when recorded file is played in media player. As recorded file is being in mobile phone media file format (3gp/3g2/mp4) can be shared with other users through MMS or IMS applications. These and other objects, features and advantages of the present invention will become more apparent from the ensuing detailed description of the invention taken in conjunction with the accompanying drawings. BRIEF DESCRIPTION OF THE ACCOMPANYING DRAWINGS 5 Figure 1 Following diagram illustrate the components involved in the implementation for option1. Figure 2 Block diagram showing the components involved In Implementation for option2 DETAILED DESCRIPTION OF THE INVENTION The preferred embodiments of the present invention will now be explained with reference to the accompanying drawings. It should be understood however that the disclosed embodiments are merely exemplary of the invention, which may be embodied in various forms. The following description and drawings are not to be construed as limiting the invention and numerous specific details are described to provide a thorough understanding of the present invention, as the basis for the claims and as a basis for teaching one skilled in the art how to make and/or use the invention. However in certain instances, well-known or conventional details are not described in order not to unnecessarily obscure the present invention in detail. The following are required to implement the invention: · A Camera Mobile Terminal or handheld device with camera or desktop with Camera · Codecs supported by mobile phone media file format (3gp/3g2/mp4) · mobile phone media file format reader and writer(3gp/3g2/mp4) · Image processing algorithm to merge two YUV images for recording picture in picture view · Display device The figure 1 shows the major processing blocks required for option 1 to be selected by user. The media file reader block reads audio/ video stream of mobile phone media file (3gp/3g2/mp4) selected by user. The audio decoder block decodes the audio bit-stream supplied by media file reader block. The video decoder block decodes the video bit-stream supplied by media file reader block. The media file reader block & audio/video decoder blocks are mainly responsible for playback of the input file selected by user. The decoded audio is played by speaker & decoded video is displayed on display device. The decoded display forms one part of Picture in Picture format. Simultaneously Camera captures the live image & displays captured live image on display device. This image forms the other part of picture in picture format. Thus display device shows two images in picture in picture format, one from camera & another is original video provided by video decoder. The live image captured by camera is also provided to video encoder in addition to display device. The video encoder encodes live data provided by camera & feeds to media file writer. The media file reader also feeds encoded audio bit-stream to media file writer. The audio bit-stream from media file reader & video bit-stream from video encoder is synchronized & written to a file by media file writer. The figure 2 shows the major processing blocks required for option 2 to be selected by user. The media file reader block is used to read audio & video bit-stream of mobile phone media file (3gp/3g2/mp4) selected by user. The audio decoder block decodes the audio bit-stream supplied by media file reader block. The video decoder block decodes the video bit-stream supplied by media file reader block. The media file reader block & audio/video decoder blocks are mainly responsible for playback of the input file selected by user. The decoded audio is played by speaker & decoded video is displayed on display device. The decoded display forms one part of Picture in Picture format. Simultaneously Camera captures the live image & displays captured live image on display device. This image forms the other part of picture in picture format. Thus display device shows two images in picture in picture format, one from camera & another from input file provided by video decoder. The live image captured by camera is also provided to image processing block in addition to display device. The image processing block gets another image from video decoder. The two images provided to image processing block are basically two images displayed on display device. The image processing block merges two images into one image. The resultant image is one image as displayed in picture in picture format on display device. The video encoder encodes image provided by image processing block & feeds to media file writer. The media file reader also feeds encoded audio bit-stream to media file writer. The audio bit-stream from media file reader & video bit-stream from video encoder is synchronized & written to a file by media file writer. Operation Details · User selects any audio-video or audio only mobile phone media file format (3gp/3g2/mp4) · User chooses one of the following option for recording · Recording option 1- option of merging live and video data from input file to form one video and then writing merged encoded video data in a new file along with encoded audio of input file in mobile phone media file format (3gp/3g2/mp4). This is basically recording of picture in picture format that user watches on Display device. · Recording option 2-option of writing encoded live video data captured by camera and encoded audio from input media file in mobile phone media file format (3gp/3g2/mp4) · When application is launched it starts input output devices and major processing blocks like mobile phone media file reader, mobile phone media file writer, audio and video codecs and input/output devices like camera, sound output device, display device etc. · Dance with Me application reads the audio and video streams using mobile phone media file format reader, decodes audio video bit-streams with the help of audio and video decoder. The video data decoded by decoder is displayed in small window of Picture in Picture on Display screen and audio data decoded by audio decoder is played on speaker. The decoding is done by frame by frame. In other words application starts local playback of selected file in frame by frame mode. · • At the same time application also captures live video data from camera. Depending on the file recording option specified by user video data from camera is either merged with the decoded video data of input file and given to video encoder (to record picture in picture as seen on display for non real time comparison) or without merging camera output is directly given to video encoder · • Mobile phone media file format writer receives encoded video data from video encoder and encoded audio data from input file and writes to a new file in mobile phone media file format (3gp/3g2/mp4) · Application displays two videos at a time on Display device in picture in picture format, one is live video from camera in big size and another is decoded video data of input file in small size. With this feature user can compare live video and original video. The bigger size live video frame and smaller size decoded video frame from input file is merged to a single video frame as displayed on LCD using image processing algorithm and then given to encoder and file writer for recording comparison. · Application stops all devices and processing blocks when it detects an end of input mobile phone media file · The newly recorded file is ready for playback when all devices and processing blocks are closed. When Recorded file is played it shows original audio and live recorded video or original audio and picture in picture comparison of original and live recorded video depending on the option chosen by user. Features of the invention: New use case that allows playback and recording operation together to form a new audio video content. New use case that allows user to compare original video with live video in synchronization with original audio. New use case to create new audio video content by combining original audio and live video in real time that can be shared through MMS New use case to create new audio video content by combining original audio and merged video (Live and original) in real time that can be shared through MMS. New use case which is "Video Karaoke" i.e. adding live video to already existing original audio as original audio provides a reference to live video. New use case to watch comparison of original video and live video in real time on display device . New use case to watch comparison of original video and recorded video by playing audio video content recorded by an application. Following processes happens in parallel and in real time · Input Media file reading for audio and video · Decoding of audio and video streams from input media file · Play-out of decoded audio and display of decoded video from input media file · Camera preview to capture live video · Merging of camera preview and video decoded from input media file optional) · Encoding of live video from camera or merged video in step (e). · Writing encoded video and original encoded audio from input file in a new media file Application provides Picture in Picture display of original video and live video Real time comparison of live video and original video in synchronization with audio. Application provides recording of Picture in Picture display of original video and live video by merging two videos to form one video before it goes to encoder. Application displays original video and live-recorded video together when recorded file is played as was seen in Picture in picture at the time of recording. Application reads two videos at a time one from input file and another from Camera and merges two videos to form a single video as seen in picture in picture (PIP) format. The merged video and original audio is mixed together and written in a new media file. Application reads two videos at a time one from input file and another from Camera. Live video from camera is encoded and original audio is mixed together and written in a new media file. Original input audio -video file is played in synchronized form and provides a real time reference to record live video. Audio from input file and live video is synchronized in real time and written to a file. Audio from input file and Picture in Picture merged video is synchronized in real time and written to a file. Non-real time comparison of two videos in same file. Impact on current implementation This is a new application not available in mobile phones, desktop or any device. As the application is complex and involves lot of processing in real time CPU with high processing power is required to meet the real time constraints and synchronization of audio and video. It will also be obvious to those skilled in the art that other control methods and apparatuses can be derived from the combinations of the various methods and apparatuses of the present invention as taught by the description and the accompanying drawings and these shall also be considered within the scope of the present invention. Further, description of such combinations and variations is therefore omitted above. It should also be noted that the host for storing the applications include but not limited to a microchip, microprocessor, handheld communication device, computer, rendering device or a multi function device. Although the present invention has been fully described in connection with the preferred embodiments thereof with reference to the accompanying drawings, it is to be noted that various changes and modifications are possible and are apparent to those skilled in the art. Such changes and modifications are to be understood as included within the scope of the present invention as defined by the appended claims unless they depart therefrom.

Documents:

321-CHE-2006 AMENDED PAGES OF SPECIFICATION 26-10-2012.pdf

321-CHE-2006 AMENDED CLAIMS 26-10-2012.pdf

321-CHE-2006 EXAMINATION REPORT REPLY RECEIVED 26-10-2012.pdf

321-CHE-2006 FORM-13 26-10-2012.pdf

321-CHE-2006 OTHER PATENT DOCUMENT 26-10-2012.pdf

321-CHE-2006 POWER OF ATTORNEY 26-10-2012.pdf

321-CHE-2006 AMENDED CLAIMS 04-01-2013.pdf

321-CHE-2006 AMENDED CLAIMS 11-12-2012.pdf

321-CHE-2006 AMENDED CLAIMS 21-11-2012.pdf

321-CHE-2006 CORRESPONDENCE OTHERS 04-01-2013.pdf

321-CHE-2006 CORRESPONDENCE OTHERS 11-12-2012.pdf

321-CHE-2006 CORRESPONDENCE OTHERS 21-11-2012.pdf

321-CHE-2006 POWER OF ATTORNEY 11-12-2012.pdf

321-CHE-2006 POWER OF ATTORNEY 21-11-2012.pdf

321-CHE-2006 POWER OF ATTORNEY 04-01-2013.pdf

321-CHE-2006 CORRESPONDENCE OTHERS.pdf

321-CHE-2006 FORM 1.pdf

321-CHE-2006 FORM 18.pdf

321-che-2006-abstract.pdf

321-che-2006-claims.pdf

321-che-2006-correspondence-others.pdf

321-che-2006-description(complete).pdf

321-che-2006-drawings.pdf

321-che-2006-form 1.pdf

321-che-2006-form 26.pdf