Title of Invention | APPARATUS FOR REPRODUCING AV DATA IN INTERACTIVE MODE, METHOD OF HANDLING USER INPUT, AND INFORMATION STORAGE MEDIUM THEREFOR |
---|---|
Abstract | Abstract An apparatus reproduces AV data in an interactive mode, a method handles a user input, and an information storage medium stores information therefore. The information storage medium includes AV data and a markup document utilized to reproduce the AV data in an interactive mode. The markup document includes first event information of an occurrence of a key input event corresponding to a user action to inform, by default, an AV playback engine, which plays back the AV data. Accordingly, interactive contents may be controlled using a limited user input device. |
Full Text | FORM 2 THE PATENTS ACT, 1970 (39 of 1970) & THE PATENTS RULES, 2003 COMPLETE SPECIFICATION (See section 10, rule 13) Apparatus for reproducing AV data in interactive mode, method of handling user input, and information storage medium therefor SAMSUNG ELECTRONICS CO., LTD., a Korean Corporation, of 416, Maetan-dong, Yeongtong-gu, Suwon-si, Gyeonggi-do 442-742 Republic of Korea The following specification particularly describes the invention and the manner in which it is to be performed. GRANTED WO-2004/019318 FCT/KR2003/001724 APPARATUS FOR REPRODUCING AV DATA IN INTERACTIVE MODE, METHOD Or HANDLING USER INPUT, AND INFORMATION GTORAGE MEDIUM THEREFOR Technical Field The present invention relates to an apparatus for reproducing AV data in an interactive mode, a method of handling a user input, and an information storage medium therefor. Background Art Digital versatile discs (DVDs), which are capable of playing back AV data in an interactive mode based on a personal computer (PC), are being sold in the marketplace. On interactive DVDs, AV data is recorded according to DVD-Video standards in addition to markup documents for supporting an interactive function. AV data recorded on an interactive DVD may be displayed in two modes: a video mode wherein AV data is displayed in the same way as general DVD-Video data and an interactive mode wherein an AV picture from AV data is embedded in a display window defined in a markup document to be displayed along with a markup document. For example, in a case wherein AV data is a movie title, the movie title is shown in a display window of a screen and various additional pieces of information such as scripts, plots, photos of actors and actresses, and the like are displayed on the remaining portion of the screen. Alternatively, the various additional information may be displayed in synchronization with the title (AV data). For example, when a specific actor or actress appears in the title, a markup document containing information on his or her background may be displayed. The interactive mode requires two playback engines, i.e., a playback engine for interpreting and presenting a markup document and an AV playback engine for playing back AV data of a DVD-Video format. In other words, two large domains, which may be navigated by a user, i.e., a markup document and DVD-Video data, exist in the interactive mode. Since the two domains are controlled and navigated by different methods, it is preferable that a control key and a navigation key exist separately. In a case of a conventional interactive DVD, a browser built in a PC serves as a playback engine for playing back a markup document and user input devices of the PC, i, e. , a keyboard with relationary many input keys and a mouse capable of pointing anywhere in the markup document, serve as navigation keys. However, in an event that a home device, which is controlled by a user input device such as a remote control with limited keys and supports the interactive mode, is desired to be realized, the use of individual navigation keys is not efficient. Statement of invention Accordingly, the present invention relates to A method of handling a user input in an interactive mode in which played back AV data is displayed with a markup document, the method comprising: when a key input event corresponding to a user action occurs, informing an ENAV engine, which interprets and executes the markup document, of the occurrence of the key input event; and informing, by default, by the ENAV engine, an AV playback engine, which plays back the AV data, of the occurrence of the key input event. Disclosure of the Invention The present invention provides an apparatus which reproduces AV data in an interactive mode by effectively handling a user input using a user input device with a limited number of keys, a method which handles the user input, and an information storage medium which stores information therefor. A reproducing apparatus manages a user input in a predetermined manner so that an interactive content maker makes interactive contents with which a user may further effectively interact. In addition, a method handles the user input, and an information storage medium stores information therefor. According to an aspect of the present invention, an information storage medium includes AV data and a markup document necessary to reproduce the AV data in an interactive mode. The markup document includes first event information to inform by default an AV playback engine, which plays back the A V data, of an occurrence of a key input event corresponding to a user action. The first event information may include event registration information to check whether tlie user performed the action and event handling information to handle the event by controlling an operation of the AV playback engine when the key input event occurs. The event registration information may be recorded using an on-click event defined in the markup document, and the event handling information may be created by a function to allow the AV playback engine WO 2004/019318 PCT/KR2003/001721 to perform an operation corresponding to the on-ciick event, or the event registration information may be recorded using a key input event listener to check whether the key input event occurs, and the event handling information may be recorded using a key input event handler to control the operation of the AV playback engine. The AV playback engine may be informed of the occurrence of the key input event via an ENAV engine that interprets and executes the markup document. The markup document may include second event information to prohibit the AV playback engine, which decodes the AV data, from being informed of the occurrence of the key input event. According to another aspect of the present invention, a method handles a user input in an interactive mode in which played back AV data is displayed with a markup document. When a key input event corresponding to a user action occurs, an ENAV engine, which interprets and executes the markup document, is informed of the occurrence of the key input event. By default, the ENAV engine informs an AV playback engine of the occurrence of the key input event, and the AV playback engine plays back the AV data. According to still another aspect of the present invention, a method handles a user input in an interactive mode in which played back AV data is displayed with a markup document. An AV playback engine, which decodes the AV data, is informed by default of an occurrence of a key input event corresponding to a user action. When a second event occurs using second event information recorded in the markup document, the AV playback engine is prohibited from being informed of the occurrence of the key input event. According to yet another aspect of the present invention, an apparatus reproduces AV data in an interactive mode. The apparatus includes an AV playback engine that plays back the AV data and an ENAV engine that interprets and executes a markup document. When a key input event corresponding to a user action occurs, the ENAV engine informs, by default, the AV playback engine of the occurrence of the key input event. 001/019318 When a second event occurs using second event information recorded in the markup document, the ENAV engine may not inform the AV playback engine of the occurrence of the key input event. The ENAV engine may include an interface handler that informs the AV playback engine of the occurrence of the key input event. Additional aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention. Brief Description of the Drawings FIG. 1 is a conceptional view of a playback system according to an embodiment of the present invention. FIG. 2 is a top view of a remote control 400 of FIG. 1. FIG. 3 is a block diagram of a playback device 200 of FIG. 1. FIG. 4 is a partial block diagram to illustrate, in more detail, an embodiment of the operation of an enhanced audio video (ENAV) engine 3 of FIG. 3. FIG. 5 illustrates an example of an interactive screen in accordance with an embodiment of the present invention. FIGS. 6Aand 6B illustrate "predetermined information on the operations of the ENAV engine 3 and an AV playback engine 4" in accordance with an embodiment of the present invention. FIG 7 is a flowchart illustrating operations of a method of handling a user input in an interactive mode, according to an embodiment of the present invention. FIG. 8 is a flowchart illustrating operations of a method of handling a user input in an interactive mode, according to another embodiment of the present invention. FIG. 9 is a flowchart illustrating operations of a method of handling a user input in an interactive mode, according to still another embodiment of the present invention. FIG. 10 is a flowchart illustrating operations of a method of handling a user input in an interactive mode, according to yet another embodiment of the present invention. FIG. 11 is a flowchart illustrating operations of a method of handling a user input in an interactive mode, according to still yet another embodiment of the present invention. Best mode for carrying out the Invention The term 'Interactive contents' refers to all contents which are displayed or are displayable to a user in an interactive mode. In other words, the term "interactive contents" refers to contents which may be shown by AV data, markup documents, and program codes and/or resource files inserted into or linked to the markup documents. For example, when DVD-Video data is played back in an interactive mode, interactive contents are largely classified into DVD-Video contents (AV contents) and markup documents. A 'markup document' is written in markup language such as XML, HTML, or the like. In other words, the 'markup document' indicates a markup resource including A.png, A.jpg, and A.mpeg linked to A.xml as well as A.xml. Thus, the markup document serves as an application necessary to play back AV data in an interactive mode and as interactive contents which are displayed with AV data to the user. FIG. 1 is a conceptional view of a playback system according to an embodiment of the present invention. Referring to FIG 1, the playback system includes a DVD 300 as an information storage medium, a playback device 200, a TV 100 as a display device, and a remote control 400 as a user input device. The remote control 400 receives a user's control command, and then transmits the user's control command to the playback device 200. The playback device 200 plays back AV data recorded on the DVD 300 in an Interactive mode. When the DVD 300 is loaded into a DVD drive in the playback device 200 and a user chooses an interactive mode, the playback device 200 plays back the corresponding AV data in the interactive mode using a corresponding markup document, and then transmits the corresponding AV data to the TV 100. The TV 100 displays an AV picture formed by AV data that has been played back together with a markup picture formed by a markup document by embedding the AV picture in the markup picture. The WO 2004/019318 ■ PCT/KR2003/00172.1 interactive mode refers to a mode in which an AV picture is displayed in a display window defined in a markup document, i.e., an AV picture is embedded in a markup picture. Here, the AV picture is formed by playing back DVD-Video data recorded on the DVD 300, by the playback device 200, and then is displayed on the TV 100. The markup picture is formed by interpreting and implementing a markup document recorded on the DVD 300, by the playback device 200, and then is displayed on the TV 100. The markup picture in which the AV picture is embedded, i.e., a picture displayed in the interactive mode, is called an interactive picture. A "video mode" refers to a mode in which AV data is played back as defined in conventional DVD-Video standards, i.e., only an AV picture formed by playing back corresponding AV data is displayed. In the embodiment of FIG. 1, the playback device 200 supports the interactive mode, the video mode, and a full-screen mode that is a sub-display mode of the interactive mode. The full-screen mode Is a display mode defined in Korean Patent Application No. 02-7031, entitled "Information Storage Medium on which Mode Display Information is Recorded, and Playing Back Apparatus and Method therefor", filed on February 7, 2002 by the applicant of the present invention. The full-screen mode refers to a mode in which an AV picture is magnified and appears on the entire screen in an interactive mode. Furthermore, in the embodiment of FIG. 1, the playback device 200 may fetch a markup document from a network. FIG. 2 illustrates a top view of the remote control 400 of FIG. 1. Referring to FIG. 2, the remote control 400 Includes various functional keys. A 'TV button 41 is utilized to view a broadcast signal received from an externa? source via the TV 100. A 'DVD' button 42 is utilized to view a video title, according to the embodiment of FIG. 2, wherein the video title is AV data transmitted from the playback device 200 via the TV 100. Numeral/special character keys 43, used to choose channels, are arranged on an upper portion of the remote control 400. A'Setup' button 44 is a key utilized to call an on-screen display (OSD) menu to set up the playback device 200, an 'HIE button 45 is a language conversion key, an 'SP' button 46 is a space key, and a 'DEL' button 47 is a delete key. A 'Screen' button 48 is a key that is used to convert a display mode of an O 2004/019318- AV picture into an interactive mode, i.e., from an embedded mode to a full-screen mode, a 'Menu' button 49 is a key that is used to call a menu screen, and a 'Content' button 50 is a key that is used to download predetermined information from the Internet. Reference numerals 52, 53, 54, and 55 denote an up key, a left key, a down key, and a right key, respectively, which are direction keys to move focus or highlighted information in the interactive picture. An 'OK' button 51 is a key to select elements of a markup document containing focus or highlighted information or a menu. Reference numerals 56, 57, 58, 59, 60, and 61 denote a preview key, a next key, a fastrewind key, a stop key, a play/pause key, and a fastforward key, respectively, which are keys to play back the video title. When a video title is played back, a user may convert the language of the audio portion using an 'Audio' button 62, language of the subtitles using a 'Subtitle' button 63, and the angle of a picture using an 'Angle' button 64. A 'Focus change' button 65 is used to change to and from different domains in the interactive picture, i.e., to move a focus from an AV picture to a markup picture or from a markup picture to the AV picture. When a user presses the 'Focus change' button 65, a user input corresponding to the button pressed is processed according to an embodiment of the present invention. The detailed descriptions of this process will be explained later. A 'Return' button 66 is used to move among hierarchies in a menu having a hierarchical structure. An 'Exit' button 67 is used to move from a menu screen to a playback screen of the video title. The remote control 400 shown in FIG 2 has been used as an example to specifically manage the DVD 300 on which the video title is recorded. Therefore, detailed functional keys of the remote control 400 and the number of the functional keys may vary. Also, some of the functional keys may be put into the OSD menu. Alternatively, some items of the OSD menu may be realized as the functional keys. FIG. 3 is a block diagram of the playback device 200 of FIG. 1. Referring to FIG. 3, the playback device 200 includes a reader 2, an ENAV engine 3, an AV playback engine 4, and a blender 7. WO 2004/019318- PCT/KR2003/001724 The reader 2 reads AV data, i.e., DVD-Video data and a markup document according to the present embodiment, from the DVD 300 in response to a control signal output from the ENAV engine 3. The markup document contains at least one of first event information, second event information, and third event information as event information according to an embodiment of the present invention. The first event information is used to control an AV picture in an interactive mode, i.e., the AV playback engine 4's operation of playing back the DVD-Video data. The second event information is used to prohibit a user input from being transmitted to the AV playback engine 4. The third event information is used to control the operation of the ENVA engine 3 when the user input is forwarded to or prohibited from being forwarded to the AV playback engine 4. A first event occurs when the first event information is used, a second event occurs when the second event information is used, and a third event occurs when the third event information is used. The AV playback engine 4 plays back the read AV data. In an embodiment, since AV data is recorded as DVD-Video data, the AV playback engine 4 is embodied as a DVD-Video data playback engine to play back DVD-Video data. The AV playback engine 4 communicates with the ENAV engine 3 via an application program interface (API). In other words, the AV playback engine 4 informs the ENAV engine 3 of a property of the operational status thereof in response to a request made by the ENAV engine 3 and transmits a trigger to the ENAV engine 5. For example, when the movie 'StarWars' is shown in an interactive mode, the trigger informs the ENAV engine 3, before or after a point of time at which a war scene is to be displayed, that a quiz corresponding to the war scene is to be displayed in a markup picture when the war scene is displayed in an AV picture. Moreover, when a key input event occurs via a predetermined key of the remote control 400 pressed by the user, the AV playback engine 4 receives the key input event via the ENAV engine 3. In other words, when the user presses the predetermined key of the remote control 400, the key input event occurs and the AV playback engine 4 is informed of WO 2004/019318 PCT/KR2003/001724 the occurrence of the key input event so that the AV playback engine 4 controls the DVD-Video data using the key input event. When the first event occurs, the AV playback engine 4 performs an operation defined by the first event. However, as previously described, when the second event occurs, the AV playback engine 4 cannot be informed of the occurrence of the key input event from the user. The ENVA engine 3 is an interpretation engine which verifies, interprets, and executes markup documents written in markup language, script language and/or other program languages. In an embodiment, the ENAV engine 3 verifies, interprets, and lays out a markup document in order to play back DVD-Video data which is recorded on the DVD 300 in the interactive mode, in the interactive mode. In particular, when the first event information is recorded in the markup document and the first event occurs using the first event information, the ENAV engine 3 informs the AV playback engine 4 of the occurrence of the first event. When the key input event corresponding to the user action occurs, the ENAV engine 3 may inform, by default, the AV playback engine 4 of the occurrence of the key input event. In a case wherein the second event information is recorded in the markup document and the second event occurs using the second event information, the ENAV engine 3 may prohibit the AV playback engine 4 from being informed of the occurrence of the key input event corresponding to the user action. Furthermore, in a case wherein the third event information is recorded in the markup document and the third event occurs using the third event information when the user input is forwarded directly to or prohibited from being forwarded to the AV playback engine 4, the ENAV engine 3 performs an operation corresponding to the third event. The ENAV engine 3 may include various plug-ins. The plug-ins enable files of various formats contained in or linked to the markup document to be opened. For example, the ENAV engine 3 may call a WINDOWS MEDIA PLAYER to play back the AV data for the windows media player. Also, the ENAV engine 3 may be connected to a network to fetch necessary information such as markup documents or the like. 2004/019318 The blender 7 blends and outputs a DVD-Video stream that has been played back with an interpreted markup document. Next, an interactive picture including a markup picture 22 and an AV picture 21 is displayed on the TV 100. FIG. 4 is a partial block diagram to illustrate, in more detail, the operation of the ENAV engine 3 of FIG. 3. Referring to FIG. 4, the ENAV engine 3 includes a parser & interpreter 15, a decoder 25, and an interface handler 35. When the key input event corresponding to the user action occurs, the interface handler 35 is informed of the occurrence of the key input event corresponding to the user action and informs, by default, the AV playback engine 4 of the occurrence of the key input event. The parser & interpreter 15 parses a markup document and interprets the markup document and script codes recorded in the markup document. The script codes are used to control, dynamically, objects contained in the markup document in an interactive mode. An event serves as a trigger to activate an event handler (function) to control the objects. In other words, in an embodiment, the parser & interpreter 15 interprets event information recorded in the markup document in markup language and/or script language and transmits a corresponding command to the interface handler 35 to handle the event according to the interpreted event information. The Interface handler 35 converts a trigger transmitted from the AV playback engine 4 into an event that may be interpreted by the parser & interpreter 15, a status from the AV playback engine 4 into a property that may be understood by the parser & interpreter 15, and a command from the parser & interpreter 15 into a control command mat may be handled by the interface handler 35 or understood by the AV playback engine 4. In an embodiment, when the first event occurs using the first event information to control the AV picture in the interactive mode, the interface handler 35 informs the AV playback engine 4 of the occurrence of the first event. Also, when the key input event corresponding to the user action occurs, the interface handler 35 transmits the control command to the AV playback engine 4 through a path A using an API command InputRCKey ■ij ■ that has a KeyCode assigned to a key of the remote control 400 as a parameter. In addition, when the second event occurs using the second event information, the interface handler 35 does not inform the AV playback engine 4 of the occurrence of the key input event, even though the key input event corresponding to the user action occurs. Furthermore, when a user input to control the markup document in the interactive mode, i.e., the third event, occurs using the third event information, the interface handler 35 transmits the user input to the parser & interpreter 15 so that the parser & interpreter 15 may perform an operation corresponding to the user input. The decoder 25 decodes and renders interactive contents according to the command transmitted from the parser & interpreter 15. The term "renders" refers to controlling the layout of pages of a markup document and the output of AV data. Hereinafter, events according to an embodiment of the present invention will be described in detail. The first event information includes event registration information to check whether the user performs an action corresponding to the first event and event handling information to handle the first event by controlling the operation of the AV playback engine 4. Here, the first event information is recorded in the markup document so that the first event occurs, the event registration information is used to register the first event, and the event handling information is used to handle the first event. The registration of the first event is realized by a key input event listener to check whether the key input event occurs, and the handling of the first event is realized by a key input event handler to control the operation of the AV playback engine 4. The registration of the first event is realized by an on-click event defined in markup language, and the handling of the first event is realized by a function to allow the AV playback engine 4 to perform an operation corresponding to the on-click event. Here, the key input event handler or WO200I/0193H PCT/ICR2003/001724 the function serves to transmit a control command corresponding to a key or button pressed by a user to the AV playback engine 4. Source codes of a markup document according to Example 1 of Realization of First Event are represented as follows: br/> "http://www.dvdforum.org/envideo/dtd/dvdhtml-1-0.dtd"> WO 2004/019318 PCT/KR2003/001724 In the markup document according to Example 1 of Realization of First Event, the event registration information is written in JavaScript language as follows: As may be seen in the above event registration information, when an event 'rckeypress' occurs, i.e., a user presses a predetermined key of the remote control 400, a function 'RcKeyEventHandler' is called. The event handling information is written in JavaScript language as follows: As may be seen in the above event handling information, a function 'RcKeyEventHandler' executes dvdVideo.lnputRCKey(12) when a key code is 12. In other words, when a code assigned to a key pressed by a user is 12, the ENAV engine 3 transmits a corresponding control command to the AV playback engine 4 using the command API dvdVideo.lnputRCKey so that the AV playback engine 4 performs a playback control operation assigned to the key code 12. ■WO 2004/019318 In other words, by registering a key input event of the remote control 400 in the 'body' of a markup document, when the user presses a key of the remote control 400, the ENAV engine 3 is informed of the occurrence of the key input event and informs the AV playback engine 4 of the occurrence of the key input event. Playback of DVD-Video data may be controlled by a method in which a control command corresponding to the pressed key is transmitted to the AV playback engine 4 when a markup document maker chooses one of the keys of the remote control 400 and the user presses the chosen key. Source codes of a markup document according to Example 2 of Realization of First Event are represented as follows: br/> "http://www.dvdforum.org/envideo/dtd/dvdhtml-1- •0.dtd">
Best View in Resolution of 1024x768 or later. Enable Javascript for Better Performance. |
---|
92-mumnp-2005-abstract(granted)-(31-10-2006).doc
92-mumnp-2005-abstract(granted)-(31-10-2006).pdf
92-mumnp-2005-cancelled page(31-10-2006).pdf
92-mumnp-2005-claim(granted)-(31-10-2006).pdf
92-mumnp-2005-claims(granted)-(31-10-2006).doc
92-mumnp-2005-correspondence (05-11-2007).pdf
92-mumnp-2005-correspondence(ipo)-(02-01-2006).pdf
92-mumnp-2005-drawing(31-10-2006).pdf
92-mumnp-2005-form 1(31-01-2005).pdf
92-mumnp-2005-form 18(14-07-2005).pdf
92-mumnp-2005-form 2(granted)-(31-10-2006).doc
92-mumnp-2005-form 2(granted)-(31-10-2006).pdf
92-mumnp-2005-form 26(31-10-2006).pdf
92-mumnp-2005-form 3(11-07-2005).pdf
92-mumnp-2005-form 3(28-01-2005).pdf
92-mumnp-2005-form 3(31-10-2006).pdf
92-mumnp-2005-form 5(28-01-2005).pdf
92-mumnp-2005-form-pct-ipea-409 1(31-01-2005).pdf
92-mumnp-2005-form-pct-isa-210 1(31-01-2005).pdf
Patent Number | 213382 | ||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Indian Patent Application Number | 92/MUMNP/2005 | ||||||||||||||||||
PG Journal Number | 41/2008 | ||||||||||||||||||
Publication Date | 10-Oct-2008 | ||||||||||||||||||
Grant Date | 01-Jan-2008 | ||||||||||||||||||
Date of Filing | 31-Jan-2005 | ||||||||||||||||||
Name of Patentee | SAMSUNG ELECTRONICS CO. LTD | ||||||||||||||||||
Applicant Address | 416, MAETAN-DONG, YEONGTONG-GU SUWON-SI, GYEONGGI -DO 442-742, | ||||||||||||||||||
Inventors:
|
|||||||||||||||||||
PCT International Classification Number | G11B | ||||||||||||||||||
PCT International Application Number | PCT/KR2003/001724 | ||||||||||||||||||
PCT International Filing date | 2003-08-26 | ||||||||||||||||||
PCT Conventions:
|