Title of Invention	INFORMATION STORAGE MEDIUM STORING GRAPHIC DATA AND APPARATUS AND METHOD OF PRECESSING THE GRAPHIC DATA
Abstract	An information storage medium including graphic data and presentation information, and an apparatus and method of processing the graphic data are provided. The information storage medium includes the graphic data, paga\e compposition which defines page composition of the graphic data, and the presentation information indicating when graphic screen data, which is composed with reference to the page composition information of the graphic data, is output is display screen. Therefore, a graphic object is reusable in graphic data processing, and accordingly, a time takewn to process the graphic data is reducible and memory area may be saved.

Title of Invention

INFORMATION STORAGE MEDIUM STORING GRAPHIC DATA AND APPARATUS AND METHOD OF PRECESSING THE GRAPHIC DATA

Abstract

An information storage medium including graphic data and presentation information, and an apparatus and method of processing the graphic data are provided. The information storage medium includes the graphic data, paga\e compposition which defines page composition of the graphic data, and the presentation information indicating when graphic screen data, which is composed with reference to the page composition information of the graphic data, is output is display screen. Therefore, a graphic object is reusable in graphic data processing, and accordingly, a time takewn to process the graphic data is reducible and memory area may be saved.

Full Text	FORM 2THE PATENTS ACT, 1970 (39 of 1970)&The Patents Rules, 2003 PROVISIONAL / COMPLETE SPECIFICATION(See section 10 and rule 13) 1. TITLE OF THE INVENTION :“INFORMATION STORAGE MEDIUM STORING GRAPHIC DATA AND APPARATUS AND METHOD OF PROCESSING THE GRAPHIC DATA” 2. APPLICANT (S) (a) NAME : SAMSUNG ELECTRONICS CO., LTD. (b) NATIONALITY : Korean (c) ADDRESS : 416, Maetan-dong, Yeongtong-gu, Suwon-si, Gyeonggi-do 442-742, Republic of Korea 3. PREAMBLE TO THE DESCRIPTION PROVISIONALThe following specification describes the invention COMPLETEThe following specification particularly describes the invention and the manner in which it is to be performed. 4. DESCRIPTION (Description shall start from next page) 5. CLAIMS (not applicable for provisional specification. Claims should start with the preamble -"l/we claim" on separate page) 6. DATE AND SIGNATURE (to be given at the end of last page of specification) 7. ABSTRACT OF THE INVENTION (to be given along with complete specification on separate page) 2 Description INFORMATION STORAGE MEDIUM STORING GRAPHIC DATA AND APPARATUS AND METHOD OF PROCESSING THE GRAPHIC DATA Technical Field [1 ] The present invention relates to graphic data processing and more particularly, to an information storage medium including graphic data having presentation information, and an apparatus and method of processing the graphic data. Background Art [2] Various data compression formats are used to transmit video and audio data through broadcasting or store the video and audio data in a storage medium. Among the data compression formats, motion picture experts group (MPEG)-2 transport stream (TS) multiplexes and stores video and audio data by dividing the video and audio data into packets having a predetermined size. Since graphic data, as well as video data, is displayed on a screen, the MPEG-2 TS stored in an information storage medium includes the graphic data. The graphic data roughly comprises subtitle graphic data and navigation graphic data. [3] The graphic data included in the MPEG-2 TS is decoded in a graphic data processing apparatus and output to a display screen. Together with the graphic data, time information indicating when the graphic data is transmitted to a variety of buffers disposed inside the graphic data processing apparatus and time information indicating when the graphic data of a completely composed screen is output and stored in the information storage medium. Times indicated by the time information should be properly set so that graphic data processing may be performed efficiently. Further, a configuration of the buffers in the graphic data processing apparatus determines an efficiency of die graphic data processing apparatus. A conventional graphic data processing apparatus has a disadvantage in that the graphic data processing apparatus cannot reuse a graphic object of which a graphic screen is composed, thereby deteriorating the efficiency in the graphic data processing. Disclosure of Invention Technical Solution [4] The present invention provides an information storage medium including graphic data that newly defines presentation information included therein to improve an efficiency in graphic data processing and an apparatus and method of processing the 3 graphic data. Advantageous Effects [5] As described above, if graphic data composition information and presentation in- formation are used, a graphic object is reusable during graphic data processing. Accordingly, a time taken to process graphic data is reducible and memory area may be saved. Description of Drawings [6] FIG. 1 is a diagram illustrating a structure of MPEG-2 TS for graphic data according to a first embodiment of the present invention; [7] FIG. 2 is a block diagram of an apparatus for processing graphic data according to a second embodiment of the present invention; [8] FIG. 3 is a diagram illustrating a third embodiment of the present invention of the graphic data; [9] FIG. 4A is a diagram illustrating a state in which a first display set having a page composition segment (PCS) with a page_jd=l is stored in buffers; [10] FIG. 4B is a diagram illustrating a state in which a second display set having the PCS with the page_jd=2 is stored in the buffers; [11] FIG. 4C is a diagram illustrating a state in which a third display set having the PCS with the page_jd=3 is stored in the buffers; [ 12] FIG. 4D is a diagram illustrating a state in which a fourth display set having the PCS with the page_jd=4 is stored in the buffers; [13] FIGS. 5A-D are diagrams illustrating a process of inputting and outputting data to and from the buffers in accordance with a passage of time; [14] FIG. 6 is a detailed block diagram of a second buffer; [15] FIG. 7 is a flow chart illustrating a process of outputting graphic display data of a completely composed screen to a display device; [16] FIG. 8A is a flow chart illustrating a process of outputting a decoded graphic object; and [17] FIG. 8B is a flow chart illustrating a process of inputting the graphic object to a decoder. Best Mode [18] According to an aspect, an information storage medium is provided comprising: graphic data; page composition information which describes a page composition of the graphic data; and presentation information indicating when graphic screen data, which is composed with reference to the page composition information of the graphic data, is 4 output to a display screen. [19] According to another aspect, an information storage medium is provided comprising: a graphic object of which a graphic data screen is composed; and presentation information indicating when the graphic object is decoded and output or when the graphic object is input to a decoder. [20] According to another aspect, an information storage medium is provided comprising graphic data having a structure thereof which includes a display set comprising: a page composition segment which includes information on a composition of a graphic screen and a first presentation time stamp value; an object display segment which includes a graphic object of which the graphic screen is composed, information about a size of the graphic object, and a second presentation time stamp value; and an end segment which indicates an end of the display set, wherein a first presentation time stamp value indicates when graphic screen data composing the page composition segment and the object display segment are output to a display device. [21] According to another aspect, an information storage medium is provided comprising graphic data having a structure thereof which includes a display set comprising: a page composition segment which includes information on a composition of a graphic screen and a first presentation time stamp value; an object display segment which includes a graphic object of which the graphic screen is composed, information about a size of the graphic object, and a second presentation time stamp value; and an end segment which indicates an end of die display set, wherein a second presentation time stamp value indicates when the graphic object is decoded and output. [22] According to another aspect, an apparatus for processing graphic data is provided, the apparatus comprising: a first buffer which distinguishes decoded graphic object data by identifiers of graphic objects and stores the distinguished graphic object data; and a second buffer which receives a graphic object used in a screen composition among the graphic object data stored in the first buffer and stores graphic screen information composed with reference to page composition information. [23] According to still another aspect, an apparatus for processing graphic data is provided, the apparatus comprising: a coded data buffer which receives and stores coded graphic data and outputs the coded graphic data according to presentation information included in the graphic data; a decoder which decodes die coded graphic data; a page composition buffer which stores page composition information among the decoded graphic data; a first buffer which stores objects of the decoded graphic data by graphic object identifiers; a second buffer which receives a graphic object used in a 5 screen composition among the graphic objects stored in the first buffer and stores graphic screen information composed with reference to the page composition in formation; and an image controller which receives the page composition information stored in the page composition buffer and controls the graphic objects to be transmitted from the first buffer to the second buffer. [24] According to another aspect, a method of processing graphic data is provided, the method comprising: receiving the graphic data; receiving page composition information which describes a page composition of the graphic data; and outputting graphic screen data, which is composed with reference to the page composition information of the graphic data, to a display screen according to presentation information indicating a time when graphic screen data is output to the display screen. [25] According to another aspect, a method of processing graphic data is provided, the method comprising: receiving a graphic object of which a graphic data screen is composed; and outputting a decoded graphic object according to presentation information indicating when the graphic object is decoded and output or when the g raphic data is input to a decoder. Mode for Invention [26] Reference will now be made in detail to the embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the like elements throughout. The embodiments are described below to explain the present invention by referring to the figures. [27] Graphic data, which is displayed together with video data, is classified into subtitle graphic data and navigation graphic data. The subtitle graphic data is screen description data, such as superimposed dialogs, and the navigation graphic data is graphic data regarding menus, such as buttons used in navigating me video data. [28] A subtitle graphic data stream and a navigation graphic data stream are processed by different graphic data processing apparatuses in a video reproduction system. However, the graphic data processing apparatuses have a common configuration. The graphic data processing apparatuses process the subtitle graphic data stream and the navigation graphic data stream which are coded in a form of a motion picture experts group (MPEG)-2 transport stream (TS). [29] FIG. 1 is a diagram illustrating a structure of MPEG-2 TS for graphic data according to a first embodiment of the present invention. [30] Referring to FIG. 1, the graphic MPEG-2 TS includes a TS Packet header 110 and a data packet 120. The data packet 120 represents subtitle graphic data and navigation 6 graphic data, and includes display sets 120a through 120n, which are graphic data groups displayed on one graphic screen. [31] The display set 120a, 120b ... or 120n is a group of graphic data output to one display screen. Referring to FIG. 1, the display set 120a, 120b ... or 120n includes at least two segments. That is, one display set must include a page composition segment (PCS) 121 and an end segment END 123. An object display segment (ODS) is optionally included in the display set 120a, 120b ... or 120n, and a plurality of ODSs 122a through 122n may be included in the display set 120a, 120b ... or 120n, if necessary. Each of the different segments will be explained in detail hereinbelow. [32] The PCS 121 includes composition information of the ODSs 122a through 122n displayed on one screen. That is, the PCS 121 includes position information indicating where objects are displayed on the screen and time information indicating when the objects are output to a display device. The time information is called presentation time stamp (PTS) information. Accordingly, the PCS 121 includes the PTS information. In an apparatus for processing graphic data which will be described with reference to FIG. 2, the PTS information indicates when graphic screen data, which is composed of the ODSs 122a through 122n necessary to compose one graphic screen, is output from a second buffer 234 to the display device. [33] The ODSs 122a through 122n include subtitle graphic object data and navigation graphic object data, and may contain size information, such as a width and a height, or color table information of a pertinent object. The size information and color table information will not be described in detail, but may be included in a separate segment of the display set 120a, 120b ... or 120n. The ODSs 122a through 122n also include the PTS information thereof. The PTS information of the ODS 122 through 122n indicates when the ODSs 122a through 122n are stored in a first buffer 233 of the graphic data processing apparatus 230. The END 123 indicates the end of one display set 120a, 120b...or l20n. [34] Two types of presentation information exist. That is, when graphic data and page composition information which defines a page composition of the graphic data, one type of presentation information indicates when graphic screen data exist, which is composed with reference to the page composition information of the graphic data, is output to the display screen. The presentation information is recorded in the page composition segment (PCS) 121 including the page composition information. [35] When a graphic object of which the graphic data screen is composed, another type of the presentation information indicates when the graphic object is decoded in a 7 decoder and is outputted. If a time taken to decode the graphic object in the decoder is 0, the presentation information may be considered as being information indicating when the graphic object is input to the decoder to be decoded. [36] FIG. 2 is a block diagram of a graphic data processing apparatus 230 for processing graphic data according to a second embodiment of the present invention. [37] The graphic data processing apparatus 230 includes a coded data buffer 231, a decoder 232, a first buffer 233, a second buffer 234, a page composition buffer 235 and an image controller 236. [38] The subtitle graphic stream and the navigation graphic stream, which are stored in a form of an MPEG-2 TS in the information storage medium, pass through a read buffer (not shown) and a source de-packetizer (not shown) in which an arrival time stamp (ATS) that had been added to the MPEG-2 TS is removed, and further, are input to a transport packet identifier (PID) filter 210 in the form of an MPEG-2 TS packet. Input timing of a first byte of the MPEG-2 TS packet input to the PID filter 210 is determined by ATS information contained in a first header of the MPEG-2 TS packet. Further MPEG-2 TS packets are input to the PID filter 210 according to a TS_recording_rate. [39] The PID filter 210 determines, with reference to a PID of the MPEG-2 TS packet, whether or not the input MPEG-2 TS packet has a desired PED value, and transmits MPEG-2 TS packets having the desired PID values to a transport buffer 220. Since buffering and delay do not theoretically occur in the PID filter 210, the MPEG-2 TS packets are output immediately after being input to the PID filter 210. [40] The transport buffer 220 receives an MPEG-2 TS packet having a specific PID value output from the PID filter 210. That is, the transport buffer 220 performs a queue operation to temporarily store the MPEG-2 TS packet before the MPEG-2 TS packet is input to the graphic data processing apparatus 230. Once the MPEG-2 TS packet is input to the transport buffer 220, a header of the MPEG-2 TS packet and a header of a PES packet are removed. Further, referring to FIG. 1, the header 110 of the MPEG-2 TS packet for the subtitle graphic data and navigation graphic data includes PTS information. After the header of the MPEG-2 TS packet is removed, the PTS information indicates when the data packet 120, including of the display sets 120a, 120b .. .and 120n shown in FIG. 1, is input to the coded data buffer 231. [41] The coded data buffer 231 receives the subtitle graphic data stream and the navigation graphic data stream in a coded state and buffers the subtitle graphic data stream and the navigation graphic data stream that are to be processed in the graphic 8 data processing apparatus 230. The subtitle graphic data stream and the navigation graphic data stream input to the coded data buffer 231 are output from the coded data buffer 231 according to the PTS information included in the ODS 122a through 122n. [42] The PTS information of the ODS 122a through 122n is, for example, information indicating when a storage of the ODS 122a through 122n in the first buffer 233 ends, since an ideal decoding time of the graphic data in the decoder 232 is 0. That is, a time when the ODS 122a through 122n is output from the coded data buffer 231 is equal to a time when the ODS 122a through 122n is stored in the first buffer 233. The PTS information of the ODS 122a through 122n indicates not only the time when the ODS is output from the coded data buffer 231 but also the time when the ODS 122a through 122n is stored in the first buffer 233 after being decoded. However, since time is actually taken for the decoder 232 to decode the ODS 122a through 122n PTS values of two ODSs, for example, 122a and 122b have a predetermined time interval there between in consideration of a time taken to decode a previous object. [43] The decoder 232 decodes the input subtitle graphic data and input navigation graph ic data. After the input subtitle and input navigation graphic data are decoded, the decoded PCS 121 is output to the page composition buffer 235 and the decoded ODS 122a through 122n is output to the first buffer 233. Theoretically, a time taken to decode the input data in the decoder 232 is 0. Thus, the decoding operation is called an instant decoding operation. [44] The page composition buffer 235 stores the PCS 121 which is decoded and output from the decoder 232. [45] The first buffer 233 stores the ODS 122a through 122n, which is decoded in the decoder 232, according to object identifier objected of the ODS 122a through 122n. Since the decoded object data is stored in the first buffer 233, one object is reusable several times before the first buffer 233 is completely reset. [46] The second buffer 234 stores data right before graphic screen data of a screen, which is composed of graphic data objects necessary to display the subtitle graphic data and the navigation graphic data on the display device, is output. The data stored in the second buffer 234 is output to the display device according to the PTS information of the PCS 121 having page composition information of a pertinent page. [47] The image controller 236 controls, with reference to object identifiers (i.e., objected), objects to be transmitted from the first buffer 233 to the second buffer 234 and to be displayed on one page. That is, the image controller 236 controls the first buffer 233 to select the graphic data object necessary to compose the pertinent page 9 (i.e. screen), based on the page composition information of the PCS data output from the page composition buffer 23S, and to transmit selected graphic data object from the first buffer 233 to the second buffer 234. The image controller 236 transmits the page composition information to the second buffer 234 to compose the display screen. Further, when the image controller 236 receives a user operation from a user, the image controller 236 controls the above elements to select the subtitle graphic data and the navigation graphic data having a different PID and composes a display screen. [48] FIG. 3 is a diagram illustrating a third embodiment of the present invention of graphic data. [49] An operation of processing the graphic data having display sets 120a through 120n in a graphic data processing apparatus 230 and displaying the processed graphic data on a display screen will be explained in detail with reference to FIG. 3. [50] Referring to FIG. 3, subtitle graphic data and navigation graphic data have four display sets 305 through 320, 325 through 330, 335 through 345, and 350 through 360. As an MPEG-2 TS including a plurality of display sets, passes through the decoder 232, die subtitle graphic data and the navigation graphic data included in the ODS 122a through 122n is stored in the first buffer 233 and the page composition in formation contained in the PCS 121 is stored in the page composition buffer 235. Further, both the graphic data and the page composition information are, respectively, transmitted to the second buffer 234 based on respective PTS information. The operation will be explained below. A header of each display set is not shown in FIG. 3 for convenience of description. [51] FIG. 4A is a diagram illustrating a state in which a first display set 305 through 320 having a PCS 305 with a page_jd=l is stored in buffers. [52] Graphic data of an ODS 310 with an objected=l and graphic data of an ODS 315 with the object_id=2 are stored in the first buffer 233 at a time indicated by the PTS information included in the ODSs 310 and 315. At this time, no data is stored in the page composition buffer 235. In general, an instance where all object data stored in the first buffer 233 is no longer used and a new display set is input to the first buffer 233 to process new object data is called mode conversion. A first PCS input during mode conversion has no data or is a dummy PCS. Accordingly, a graphic data processing apparatus 230 decodes only necessary objects of the first display set 305 through 320 until a subsequent mode conversion and stores the necessary objects in the first buffer 233. Therefore, there is no data in the second buffer 234. [53] FIG. 4B is a diagram illustrating a state in which a second display set 325 through 10 330 having a PCS 325 with the page_jd=2 is stored in the buffers. [54] Referring to FIG. 3, the second display set 325 through 330 having the PCS 325 with the page_jd=2 includes the PCS 325 and an END 330. The second display set 325 through 330 includes the page composition information to display the objects of the first display set 305 through 320 with the page_jd=l stored in the first buffer 233 on the display screen. Accordingly, the PCS 325 with the page_jd=2 includes position information indicating which graphic objects are displayed and where the graphic objects are displayed on the display screen. The image controller 236 controls the first buffer 233 using the page composition information of the PCS 325 with the page_jd=2 so that the graphic objects corresponding to the ODS 310 with the object_id=l and the ODS 315 with the object_id=2 is transmittable to the second buffer 234 and the screen may be composed. At a time indicated by the PTS information included in the PCS 325, graphic screen data of a completely composed screen is output from the second buffer 234 to the display device. [55] FIG. 4C is a diagram illustrating a state in which a third display set 335 through 345 having a PCS 335 with the page_jd=3 is stored in the buffers. [56] Referring to FIG. 3, the third display set 335 through 345 having the PCS 335 with the page_id=3 includes the PCS 335, an ODS 340 with the object_id=2, and an END 345. The ODS 340 included in the third display set 335 through 345 having the PCS 335 with the page_jd=3 has a common object_id as that of the ODS 315 of die ODSs 310 and 315 of the first display set 305 through 320 having the PCS 305 with the page_jd=l. Since the ODS 340 having the common object_id as that of the ODS 315 overlies the ODS 315, the ODS 340 consequently performs an update operation. That is, although die page composition information of the PCS does not change, an updated object is reflected on the display screen such that at a time indicated by PTS information of the pertinent PCS, graphic data, which is stored in the second buffer 234, of a completely composed screen is output to the display device. [57] FIG. 4D is a diagram illustrating a state in which a fourth display set 350 through 360 having a PCS 350 with the page_id=4 is stored in the buffers. [58] Referring to FIG. 3, the fourth display set 350 through 360 having the PCS 350 with the page_jd=4 includes the PCS 350 containing new page composition information, an ODS 355 with the objected=3, and an END 360. After the graphic processing apparatus 230 stores data corresponding to each segment in the first buffer 233, the second buffer 234, and the page composition buffer 235, the graphic processing apparatus 230 outputs data, which is stored in the second buffer 235, of a 11 completely composed screen to the display device at a time indicated by PTS information of the PCS 350 with the page_jd=4. [59] FIGS. 5A-5D are diagrams illustrating a process of inputting and outputting data to and from the buffers in accordance with a passage of time. [60] Referring to FIG. 5A-5D, all of the PCS 305, ODS 310 and 315 and END 320 of the first display set 305 through 320 are stored in the coded data buffer 231 at a time 510 indicated by PTS information included in an MPEG-2 TS header of a pertinent packet, and are output from the coded data buffer 231, decoded in the decoder 232, and stored in the first buffer 233 between times 550 and 560 indicated by PTS information of the respective ODSs 310 and 315. As previously explained, a time when one object is output from the coded data buffer 231 theoretically is equal to a time when the object is decoded in the decoder 232 and stored in die first buffer 233. However, in actuality, since time is taken to decode the object, the value of the time 560 indicated by the PTS information of the ODS 315 with the objected=2 is greater than that of the time 550 indicated by the PTS information of the ODS 310 with the object_jd=l. [61 ] Accordingly, a first graphic object of the ODS 310 with the object_jd=l is output from the coded data buffer 231 and is decoded and stored in the first buffer 233 at the time 550 indicated by the PTS information of the ODS 310 with the objected=l. A second graphic object of the ODS 315 with the object_id=2 is output from the coded data buffer 231, and then decoded and stored in the first buffer 233 at the time 560 indicated by the PTS information of the ODS 315 with the object_id=2. [62] All the PCS 325 and END 330 of the second display set 325 through 330 are stored in the coded data buffer 231 at a time 530 indicated by PTS information included in a header of the pertinent packet. The PCS 325 is decoded in the decoder 232 and stored in the page composition buffer 235. The image controller 236 controls the first buffer 233 to transmit the object necessary to compose the pertinent screen from the first buffer 233 to the second buffer 234 based on the page composition information. A time when the object stored in the first buffer 233 is transmitted to the second buffer 234 and the screen composition starts, is the same as a time indicated by the PTS information of the ODS, which is stored last in the first buffer 233. [63] However, since the PCS 305 of the first display set 305 through 320 is a dummy PCS with no page composition information, the ODS 315 with the objecte_id=2, which is stored last, is not transmitted to the second buffer 234 at the time indicated by die PTS information thereof, and not used in the screen composition. When the image controller 236 uses the PCS information of the second display set 325 through 330 12 which is decoded and stored in the page composition buffer 235, the first graphic object with the object_id=l and the second graphic object with the object_id=£, which are necessary for the screen composition, are transmitted from the first buffer 233 to the second buffer 234 such that the screen composition starts. At a time 590 indicated by PTS information of the PCS 325 with the page_jd=2, the graphic screen data of a completely composed screen is output to the display screen. [64] All of the PCS 335, ODS 340, and END 345 of the third display set 335 through 345 are stored in the coded data buffer 231 at a time 530 indicated by PTS information included in a header of the pertinent packet and are output from the coded data buffer 231, decoded, and immediately stored in the first buffer 233 at a time 570 indicated by the PTS information of the ODS 340 of the third display set 335 through 345. At this time, since the ODS 340 included in the third display set 335 through 345 uses a common object_id as that of the ODS 315, which has already been stored in the first buffer 233, the ODS 340 overlies the previously stored second object of the ODS 315. As a result, an updated second object is obtainable. [65] However, since the PCS 335 with the page_jd=3 performs the screen composition using the ODSs 310 and 340 with the objected=l and the objected=2, the ODS 340 with the object_id=2 is stored last in the first buffer 233 at the time indicated by the PTS information of the ODS 340, and is simultaneously transmitted to the second buffer 234 to be used in the screen composition. At a time 591 indicated by the PTS information of the PCS 335 with the page_id=3, a page of a completely composed screen is output to the display device. At this time, the second buffer 234 maintains a display screen output which is composed based on the page composition information of the PCS 325 with the page_id=2 until the time indicated by the PTS information of the PCS 335 with the page_id=3. [66] Furthermore, all of the PCS 350, ODS 355, and END 360 of the fourth display set 350 through 360 are stored in the coded data buffer 231 at a time 540 indicated by the PTS information included in a header of the pertinent packet and are output from the coded data buffer 231, decoded, and immediately stored in the first buffer 233 at a time 580 indicated by the PTS information of the ODS 355 of the fourth display set 350 through 360. At a time 592 indicated by the PTS information of the PCS 350 with the page_id=4, a page of a completely composed screen is output to the display device. At this time, the second buffer 234 maintains a display screen output which is composed based on the page composition information of the PCS 335 with the page_id=3 until the time indicated by the PTS information of the PCS 350 with the 13 page_jd=4. Accordingly, the second buffer 234 includes a preparing bu ffer 610 and a display buffer 620 as shown in FIG. 6. [67] FIG. 6 is a detailed block diagram of the second buffer 234. [68] Referring to FIG. 6, the second buffer 234 includes the preparing buffer 610 and the display buffer 620. The preparing buffer 610 is a memory used in placing with reference to the page composition information, objects input from the first buffer 233 at predetermined positions of the display screen. The display buffer 620 is a memory used in displaying data of the prepared display screen. At a time indicated by the PTS information of the PCS 305, 325, 335 and 350, operations of the preparing buffer 610 and the display buffer 620 are exchanged and data of the completely composed screen is finally output to a display device 630. [69] In further detail with reference to FIGS. 4B and 4C, when the screen composition is completed with reference to the information of the PCS 325 with the page_id=2, contents of the second buffer 234 of FIG. 4B are stored in the display buffer 620, and output to the display device 630. Screen composition proceeds in the preparing buffer 610 with reference to the information of the PCS 325 with the page_jd=3. At the time indicated by the PTS information of the PCS 335 with the page_id=3, the operations of the preparing buffer 610 and the display buffer 620 are exchanged such that the contents of the second buffer 234 shown in FIG. 4 are output to the display device 630 and the data of the fourth display set 350 through 360 is input to the preparing buffer 610 in a common manner as described above so as to be used in the screen composition. [70] FIG. 7 is a flow chart illustrating an operation of outputting graphic display data of a completely composed page to the display device. [71] In operation S710, graphic data is received. In operation S720, page composition information which describes a page composition of the graphic data is received. In step operation S730, graphic screen data which is composed with reference to the page composition information of the graphic data is output to the display screen according to presentation information which indicates when the graphic screen data is output to the display screen. The presentation information is recorded in a page composition segment including the page composition information. Further, if a plurality of graphic data values exists, a graphic display screen composition starts with reference to the presentation information of a respective one of the graphic data values, among the plurality of graphic data values, that was last input. [72] FIG. 8A is a flow chart illustrating an operation of outputting a decoded graphic 14 object. [73] In operation S810, a graphic object of which a graphic data screen is composed is received. In operation S820a, a decoded graphic object is output according to presentation information indicating when the graphic object is decoded and output. [74] FIG. 8B is a flow chart illustrating an operation of inputting a graphic object to the decoder. [75] In operation S810, a graphic object of which a graphic screen is composed is received. In operation S820b, the graphic object is input to the decoder 232 to be decoded according to presentation information indicating when the graphic object is input to the decoder 232. [76] In theory, assuming that a decoding time in the decoder 232 is 0, FIGS. 8A and 8B show that a time when the graphic object is input to the decoder 232 is the same as a time when the graphic object is output from the decoder 232. The presentation information is recorded in an object display segment having the graphic object. Thus, according to the invention, if a plurality of graphic objects exist, time values, respectively, indicated by presentation information of the graphic objects have a predetermined time interval there between. [77] This invention may be embodied in a general purpose digital computer by running a program from a computer usable medium, including but not limited to, storage media such as magnetic storage media (e.g., ROMs, floppy discs, hard discs, etc.), optically readable media (e.g., CD-ROMs, DVDs, etc.), and carrier waves (e.g., transmissions over the Internet). The computer readable recording medium may be dispersively installed in a computer system connected to a network, and stored and executed as a computer readable code by a distributed computing environment. [78] Although a few embodiments of the present invention have been shown and described, it would be appreciated by those skilled in the art that changes may be made in this embodiment without departing from the principles and spirit of the invention, the scope of which is defined in the claims and their equivalents. 15 Claims [ 1 ] 1. An information storage medium for use by a computer, comprising: graphic data; page composition information which defines a page composition of the graphic data; and presentation information indicating when graphic screen data, which is composed with reference to the page composition information of the graphic data, is output to a display screen. [2] 2. The information storage medium of claim 1, wherein the presentation in- formation is recorded in a page composition segment including the page composition information. [3] 3. The information storage medium of claim 1, wherein if a plurality of graphic data values exist, a screen composition of the graphic data starts with reference to presentation information of a last inputted graphic data value among the plurality of graphic data values. [4] 4. An information storage medium for use by a computer comprising: a graphic object to compose a graphic data screen; and presentation information indicating when the graphic object is decoded and outputted or when the graphic object is input to a decoder. [5] 5. The information storage medium of claim 4, wherein the presentation in- formation is recorded in an object display segment having the graphic object. [6] 6. The information storage medium of claim 4, wherein if a plurality of graphic objects exist, time values, respectively, indicated by presentation information of the graphic objects have a predetermined time interval there between. [7] 7. An information storage medium including graphic data having a structure thereof which includes a display set comprising: a page composition segment which includes information of a composition of a graphic screen and of a first presentation time stamp value; an object display segment which includes a graphic object to compose the graphic screen, information of a size of the graphic object and of a second presentation time stamp value; and an end segment which indicates an end of the display set, wherein the first presentation time stamp value indicates when graphic screen data composed of the page composition segment and the object display segment 16 is outputtable to a display device. [8] 8. The information storage medium of claim 7, wherein if a plurality of object display segments exist, the composition of the graphic screen starts with reference to presentation information of a respective one of the object display segments, among the plurality of object display segments, that was last input. [9] 9. An information storage medium for use by a computer and including graphic data having a structure thereof which includes a display set comprising: a page composition segment which includes information of a composition of a graphic screen and of a first presentation time stamp value; an object display segment which includes a graphic object to compose the graphic screen, information of a size of the graphic object and of a second presentation time stamp value; and an end segment which indicates an end of the display set, wherein the second presentation time stamp value indicates when the graphic object is decoded and outputted. [10] 10. The information storage medium of claim 9, wherein the second presentation time stamp value indicates when the graphic object is input to a decoder. [11] 11. The information storage medium of claim 9, wherein if a plurality of object display segments exist, second presentation time stamp values of the plurality of object display segments have a predetermined time interval there between. [12] 12. An apparatus for processing graphic data, the apparatus comprising: a first buffer which stores decoded graphic object data by graphic object identifiers; and a second buffer which receives a graphic object used in a screen composition among the graphic object data stored in the first buffer and stores graphic screen information composed with reference to page composition information. [13] 13. The apparatus of claim 12, wherein the second buffer comprises: a preparing buffer which receives the graphic object used in the screen composition among the graphic object data stored in the first buffer and performs the screen composition with reference to the page composition information; and a display buffer which stores graphic screen data of a completely composed screen and transmits the stored graphic screen data to a display device. [14] 14. The apparatus of claim 12, wherein operations of the preparing buffer and the display buffer are exchanged with reference to presentation information indicating that the screen composition is completed and that the graphic screen 17 information is outputtable to the display device. [15] 15. The apparatus of claim 12, wherein after a mode conversion, the apparatus decodes only necessary graphic objects of a display set and stores the necessary objects in the first buffer. [16] 16. The apparatus of claim 12, wherein if the page composition information does not change, an updated graphic object is reflected on a display screen such that at a time indicated by presentation time stamp information of graphic object data, which is stored in the second buffer, of a completely composed screen is output to the display device. [17] 17. An apparatus for processing graphic data, the apparatus comprising: a coded data buffer which receives and stores coded graphic data and outputs the coded graphic data according to presentation information included in the graphic data; a decoder which decodes the coded graphic data; a page composition buffer which stores page composition information among the decoded graphic data; a first buffer which stores graphic objects of the decoded graphic data by graphic object identifiers; a second buffer which receives a respective graphic object used in a screen composition among the graphic objects stored in the first buffer and stores graphic screen information composed with reference to the page composition information; and an image controller which receives the page composition information stored in the page composition buffer and controls the graphic objects to be transmitted from the first buffer to the second buffer. [18] 18. The apparatus of claim 17, wherein the second buffer comprises: a preparing buffer which receives the graphic object used in the screen composition among the graphic objects stored in the first buffer and performs the screen composition with reference to the page composition information; and a display buffer which stores graphic screen data of a completely composed screen and transmits the stored graphic screen data to a display device. [19] 19. The apparatus of claim 18, wherein operations of the preparing buffer and the display buffer are exchanged with reference to presentation information indicating that the screen composition is completed and that the graphic screen information is outputtable to the display device. 18 [20] 20. A method of processing graphic data, the method comprising: receiving the graphic data; receiving page composition information which defines a page composition of me graphic data; and outputting graphic screen data, which is composed with reference to the page composition information of the graphic data, to a display screen according to presentation information indicating when the graphic screen data is output to the display screen. [21] 21. The method of claim 20, wherein the presentation information is recorded in a page composition segment including the page composition information. [22] 22. The method of claim 20, wherein if a plurality of graphic data values exist, starting a screen composition of the graphic data with reference to presentation information of a last input graphic data value among the plurality of graphic data values. [23] 23. A method of processing graphic data, the method comprising: receiving a graphic object to compose a graphic data screen; and outputting a decoded graphic object according to presentation information indicating when the graphic object is decoded and outputted or when the graphic object is input to a decoder. [24] 24. The method of claim 23, wherein the presentation information is recorded in an object display segment having the graphic object. [25] 25. The method of claim 23, wherein if a plurality of graphic objects exist, time values, respectively, indicated by presentation information of the plurality of graphic objects have a predetermined time interval there between. [26] 26. An information storage medium for use in a computer, and including graphic data having a structure thereof which includes a display set comprising: a page composition segment including information of a composition of a graphic screen and of a first presentation time stamp value indicating when graphic screen data is outputtable to a display device; and an object display segment including a graphic object composing the graphic screen information. [27] 27. An apparatus for processing graphic data, comprising: a decoding buffer to stores decoded graphic object data; and a receiving buffer to receive a graphic object used in a screen composition from the decoded graphic object data and to store graphic screen information 19 composed in accordance with page composition information. [28] 28. The apparatus of claim 27, wherein if more than one graphic object exists, presentation timestamp values thereof have a predetermined time interval there between in consideration of a time taken to decode a previous graphic object. [29] 29. The apparatus of claim 27, wherein the receiving buffer comprises: a preparing buffer to receive the graphic object used in the screen composition and performs the screen composition with reference to the page composition information; and a display buffer to process graphic screen data of a composed screen to a display device. [30] 30. A method of processing graphic data, the method comprising: receiving the graphic data; receiving page composition information to define a page composition of the graphic data; and outputting graphic screen data, composed in accordance with the page composition information of the graphic data and timed in accordance with presentation information, to a display screen. [31] 31. A method of processing graphic data, the method comprising: receiving a graphic object to compose a graphic data screen; and outputting a decoded graphic object according to presentation information indicating a timing of the graphic object with respect to a decoding operation. [32] 32. A method of according to claim 31, wherein a graphic object is reusable during graphic data processing to reduce a time thereof. [33] 33. A computer readable medium for storing graphic screen information to use in a computer, comprising: page composition segment including information of a composition of a graphic screen and of a first presentation time stamp value indicating when graphic screen data is outputtable to a display device; and an object display segment including a graphic object composing the graphic screen information. 20 34. An information storage medium for use by a computer including graphic data having structure thereof; an apparatus for processing graphic data; a method of processing graphic data; an apparatus for processing graphic data and a computer readable medium such as herein described with reference to the accompanying drawings. Dated this 25th day of August 2005. G. DEEPAK SRINIWAS OF K & S PARTNERS AGENT FOR THE APPLICANT(S) 21 Abstract An information storage medium including graphic data and presentation information, and an apparatus and method of processing the graphic data are provided. The information storage medium includes the graphic data, page composition information which defines page composition of the graphic data, and the presentation information indicating when graphic screen data, which is composed with reference to the page composition information of the graphic data, is output to a display screen. Therefore, a graphic object is reusable in graphic data processing and accordingly, a time taken to process die graphic data is reducible and memory area may be saved.

Full Text

FORM 2THE PATENTS ACT, 1970 (39 of 1970)&The Patents Rules, 2003 PROVISIONAL / COMPLETE SPECIFICATION(See section 10 and rule 13)
1. TITLE OF THE INVENTION :“INFORMATION STORAGE MEDIUM STORING GRAPHIC DATA AND APPARATUS AND METHOD OF PROCESSING THE GRAPHIC DATA”
2. APPLICANT (S) (a) NAME : SAMSUNG ELECTRONICS CO., LTD. (b) NATIONALITY : Korean (c) ADDRESS : 416, Maetan-dong, Yeongtong-gu, Suwon-si, Gyeonggi-do 442-742, Republic of Korea
3. PREAMBLE TO THE DESCRIPTION
PROVISIONALThe following specification describes the invention COMPLETEThe following specification particularly describes the invention and the manner in which it is to be performed.
4. DESCRIPTION (Description shall start from next page)
5. CLAIMS (not applicable for provisional specification. Claims should start with the preamble -"l/we claim" on separate page)
6. DATE AND SIGNATURE (to be given at the end of last page of specification)
7. ABSTRACT OF THE INVENTION (to be given along with complete specification on separate page)

2
Description
INFORMATION STORAGE MEDIUM STORING GRAPHIC DATA AND APPARATUS AND METHOD OF
PROCESSING THE GRAPHIC DATA
Technical Field
[1 ] The present invention relates to graphic data processing and more particularly, to
an information storage medium including graphic data having presentation information, and an apparatus and method of processing the graphic data.
Background Art
[2] Various data compression formats are used to transmit video and audio data
through broadcasting or store the video and audio data in a storage medium. Among the data compression formats, motion picture experts group (MPEG)-2 transport stream (TS) multiplexes and stores video and audio data by dividing the video and audio data into packets having a predetermined size. Since graphic data, as well as video data, is displayed on a screen, the MPEG-2 TS stored in an information storage medium includes the graphic data. The graphic data roughly comprises subtitle graphic data and navigation graphic data.
[3] The graphic data included in the MPEG-2 TS is decoded in a graphic data
processing apparatus and output to a display screen. Together with the graphic data, time information indicating when the graphic data is transmitted to a variety of buffers disposed inside the graphic data processing apparatus and time information indicating when the graphic data of a completely composed screen is output and stored in the information storage medium. Times indicated by the time information should be properly set so that graphic data processing may be performed efficiently. Further, a configuration of the buffers in the graphic data processing apparatus determines an efficiency of die graphic data processing apparatus. A conventional graphic data processing apparatus has a disadvantage in that the graphic data processing apparatus cannot reuse a graphic object of which a graphic screen is composed, thereby deteriorating the efficiency in the graphic data processing.
Disclosure of Invention
Technical Solution
[4] The present invention provides an information storage medium including graphic
data that newly defines presentation information included therein to improve an efficiency in graphic data processing and an apparatus and method of processing the

3
graphic data.
Advantageous Effects
[5] As described above, if graphic data composition information and presentation in-
formation are used, a graphic object is reusable during graphic data processing. Accordingly, a time taken to process graphic data is reducible and memory area may be saved.
Description of Drawings
[6] FIG. 1 is a diagram illustrating a structure of MPEG-2 TS for graphic data
according to a first embodiment of the present invention;
[7] FIG. 2 is a block diagram of an apparatus for processing graphic data according to a
second embodiment of the present invention;
[8] FIG. 3 is a diagram illustrating a third embodiment of the present invention of the
graphic data;
[9] FIG. 4A is a diagram illustrating a state in which a first display set having a page
composition segment (PCS) with a page_jd=l is stored in buffers;
[10] FIG. 4B is a diagram illustrating a state in which a second display set having the
PCS with the page_jd=2 is stored in the buffers;
[11] FIG. 4C is a diagram illustrating a state in which a third display set having the PCS
with the page_jd=3 is stored in the buffers;
[ 12] FIG. 4D is a diagram illustrating a state in which a fourth display set having the
PCS with the page_jd=4 is stored in the buffers;
[13] FIGS. 5A-D are diagrams illustrating a process of inputting and outputting data to
and from the buffers in accordance with a passage of time;
[14] FIG. 6 is a detailed block diagram of a second buffer;
[15] FIG. 7 is a flow chart illustrating a process of outputting graphic display data of a
completely composed screen to a display device;
[16] FIG. 8A is a flow chart illustrating a process of outputting a decoded graphic
object; and
[17] FIG. 8B is a flow chart illustrating a process of inputting the graphic object to a
decoder.
Best Mode
[18] According to an aspect, an information storage medium is provided comprising:
graphic data; page composition information which describes a page composition of the graphic data; and presentation information indicating when graphic screen data, which is composed with reference to the page composition information of the graphic data, is

4
output to a display screen.
[19] According to another aspect, an information storage medium is provided
comprising: a graphic object of which a graphic data screen is composed; and presentation information indicating when the graphic object is decoded and output or when the graphic object is input to a decoder.
[20] According to another aspect, an information storage medium is provided
comprising graphic data having a structure thereof which includes a display set comprising: a page composition segment which includes information on a composition of a graphic screen and a first presentation time stamp value; an object display segment which includes a graphic object of which the graphic screen is composed, information about a size of the graphic object, and a second presentation time stamp value; and an end segment which indicates an end of the display set, wherein a first presentation time stamp value indicates when graphic screen data composing the page composition segment and the object display segment are output to a display device.
[21] According to another aspect, an information storage medium is provided
comprising graphic data having a structure thereof which includes a display set comprising: a page composition segment which includes information on a composition of a graphic screen and a first presentation time stamp value; an object display segment which includes a graphic object of which the graphic screen is composed, information about a size of the graphic object, and a second presentation time stamp value; and an end segment which indicates an end of die display set, wherein a second presentation time stamp value indicates when the graphic object is decoded and output.
[22] According to another aspect, an apparatus for processing graphic data is provided,
the apparatus comprising: a first buffer which distinguishes decoded graphic object data by identifiers of graphic objects and stores the distinguished graphic object data; and a second buffer which receives a graphic object used in a screen composition among the graphic object data stored in the first buffer and stores graphic screen information composed with reference to page composition information.
[23] According to still another aspect, an apparatus for processing graphic data is
provided, the apparatus comprising: a coded data buffer which receives and stores coded graphic data and outputs the coded graphic data according to presentation information included in the graphic data; a decoder which decodes die coded graphic data; a page composition buffer which stores page composition information among the
decoded graphic data; a first buffer which stores objects of the decoded graphic data by graphic object identifiers; a second buffer which receives a graphic object used in a

5
screen composition among the graphic objects stored in the first buffer and stores
graphic screen information composed with reference to the page composition in
formation; and an image controller which receives the page composition information
stored in the page composition buffer and controls the graphic objects to be transmitted
from the first buffer to the second buffer.
[24] According to another aspect, a method of processing graphic data is provided, the
method comprising: receiving the graphic data; receiving page composition information which describes a page composition of the graphic data; and outputting graphic screen data, which is composed with reference to the page composition information of the graphic data, to a display screen according to presentation information
indicating a time when graphic screen data is output to the display screen.
[25] According to another aspect, a method of processing graphic data is provided, the
method comprising: receiving a graphic object of which a graphic data screen is composed; and outputting a decoded graphic object according to presentation information indicating when the graphic object is decoded and output or when the g raphic data is input to a decoder.
Mode for Invention
[26] Reference will now be made in detail to the embodiments of the present invention,
examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the like elements throughout. The embodiments are described below to explain the present invention by referring to the figures.
[27] Graphic data, which is displayed together with video data, is classified into subtitle
graphic data and navigation graphic data. The subtitle graphic data is screen description data, such as superimposed dialogs, and the navigation graphic data is graphic data regarding menus, such as buttons used in navigating me video data.
[28] A subtitle graphic data stream and a navigation graphic data stream are processed
by different graphic data processing apparatuses in a video reproduction system. However, the graphic data processing apparatuses have a common configuration. The graphic data processing apparatuses process the subtitle graphic data stream and the navigation graphic data stream which are coded in a form of a motion picture experts group (MPEG)-2 transport stream (TS).
[29] FIG. 1 is a diagram illustrating a structure of MPEG-2 TS for graphic data
according to a first embodiment of the present invention.
[30] Referring to FIG. 1, the graphic MPEG-2 TS includes a TS Packet header 110 and a
data packet 120. The data packet 120 represents subtitle graphic data and navigation

6
graphic data, and includes display sets 120a through 120n, which are graphic data groups displayed on one graphic screen.
[31] The display set 120a, 120b ... or 120n is a group of graphic data output to one
display screen. Referring to FIG. 1, the display set 120a, 120b ... or 120n includes at least two segments. That is, one display set must include a page composition segment (PCS) 121 and an end segment END 123. An object display segment (ODS) is optionally included in the display set 120a, 120b ... or 120n, and a plurality of ODSs 122a through 122n may be included in the display set 120a, 120b ... or 120n, if necessary. Each of the different segments will be explained in detail hereinbelow.
[32] The PCS 121 includes composition information of the ODSs 122a through 122n
displayed on one screen. That is, the PCS 121 includes position information indicating where objects are displayed on the screen and time information indicating when the objects are output to a display device. The time information is called presentation time stamp (PTS) information. Accordingly, the PCS 121 includes the PTS information. In an apparatus for processing graphic data which will be described with reference to FIG. 2, the PTS information indicates when graphic screen data, which is composed of the ODSs 122a through 122n necessary to compose one graphic screen, is output from a second buffer 234 to the display device.
[33] The ODSs 122a through 122n include subtitle graphic object data and navigation
graphic object data, and may contain size information, such as a width and a height, or color table information of a pertinent object. The size information and color table information will not be described in detail, but may be included in a separate segment of the display set 120a, 120b ... or 120n. The ODSs 122a through 122n also include the
PTS information thereof. The PTS information of the ODS 122 through 122n indicates
when the ODSs 122a through 122n are stored in a first buffer 233 of the graphic data
processing apparatus 230. The END 123 indicates the end of one display set 120a,
120b...or l20n.
[34] Two types of presentation information exist. That is, when graphic data and page
composition information which defines a page composition of the graphic data, one type of presentation information indicates when graphic screen data exist, which is composed with reference to the page composition information of the graphic data, is output to the display screen. The presentation information is recorded in the page composition segment (PCS) 121 including the page composition information.
[35] When a graphic object of which the graphic data screen is composed, another type
of the presentation information indicates when the graphic object is decoded in a

7
decoder and is outputted. If a time taken to decode the graphic object in the decoder is 0, the presentation information may be considered as being information indicating when the graphic object is input to the decoder to be decoded.
[36] FIG. 2 is a block diagram of a graphic data processing apparatus 230 for processing
graphic data according to a second embodiment of the present invention.
[37] The graphic data processing apparatus 230 includes a coded data buffer 231, a
decoder 232, a first buffer 233, a second buffer 234, a page composition buffer 235 and an image controller 236.
[38] The subtitle graphic stream and the navigation graphic stream, which are stored in a
form of an MPEG-2 TS in the information storage medium, pass through a read buffer (not shown) and a source de-packetizer (not shown) in which an arrival time stamp (ATS) that had been added to the MPEG-2 TS is removed, and further, are input to a transport packet identifier (PID) filter 210 in the form of an MPEG-2 TS packet. Input timing of a first byte of the MPEG-2 TS packet input to the PID filter 210 is
determined by ATS information contained in a first header of the MPEG-2 TS packet. Further MPEG-2 TS packets are input to the PID filter 210 according to a TS_recording_rate.
[39] The PID filter 210 determines, with reference to a PID of the MPEG-2 TS packet,
whether or not the input MPEG-2 TS packet has a desired PED value, and transmits MPEG-2 TS packets having the desired PID values to a transport buffer 220. Since buffering and delay do not theoretically occur in the PID filter 210, the MPEG-2 TS packets are output immediately after being input to the PID filter 210.
[40] The transport buffer 220 receives an MPEG-2 TS packet having a specific PID
value output from the PID filter 210. That is, the transport buffer 220 performs a queue operation to temporarily store the MPEG-2 TS packet before the MPEG-2 TS packet is input to the graphic data processing apparatus 230. Once the MPEG-2 TS packet is input to the transport buffer 220, a header of the MPEG-2 TS packet and a header of a PES packet are removed. Further, referring to FIG. 1, the header 110 of the MPEG-2 TS packet for the subtitle graphic data and navigation graphic data includes PTS information. After the header of the MPEG-2 TS packet is removed, the PTS information indicates when the data packet 120, including of the display sets 120a, 120b .. .and 120n shown in FIG. 1, is input to the coded data buffer 231.
[41] The coded data buffer 231 receives the subtitle graphic data stream and the
navigation graphic data stream in a coded state and buffers the subtitle graphic data stream and the navigation graphic data stream that are to be processed in the graphic

8
data processing apparatus 230. The subtitle graphic data stream and the navigation graphic data stream input to the coded data buffer 231 are output from the coded data buffer 231 according to the PTS information included in the ODS 122a through 122n.
[42] The PTS information of the ODS 122a through 122n is, for example, information
indicating when a storage of the ODS 122a through 122n in the first buffer 233 ends, since an ideal decoding time of the graphic data in the decoder 232 is 0. That is, a time when the ODS 122a through 122n is output from the coded data buffer 231 is equal to a time when the ODS 122a through 122n is stored in the first buffer 233. The PTS information of the ODS 122a through 122n indicates not only the time when the ODS is output from the coded data buffer 231 but also the time when the ODS 122a through 122n is stored in the first buffer 233 after being decoded. However, since time is actually taken for the decoder 232 to decode the ODS 122a through 122n PTS values of two ODSs, for example, 122a and 122b have a predetermined time interval there between in consideration of a time taken to decode a previous object.
[43] The decoder 232 decodes the input subtitle graphic data and input navigation graph
ic data. After the input subtitle and input navigation graphic data are decoded, the decoded PCS 121 is output to the page composition buffer 235 and the decoded ODS 122a through 122n is output to the first buffer 233. Theoretically, a time taken to decode the input data in the decoder 232 is 0. Thus, the decoding operation is called an instant decoding operation.
[44] The page composition buffer 235 stores the PCS 121 which is decoded and output
from the decoder 232.
[45] The first buffer 233 stores the ODS 122a through 122n, which is decoded in the
decoder 232, according to object identifier objected of the ODS 122a through 122n. Since the decoded object data is stored in the first buffer 233, one object is reusable several times before the first buffer 233 is completely reset.
[46] The second buffer 234 stores data right before graphic screen data of a screen,
which is composed of graphic data objects necessary to display the subtitle graphic data and the navigation graphic data on the display device, is output. The data stored in the second buffer 234 is output to the display device according to the PTS information of the PCS 121 having page composition information of a pertinent page.
[47] The image controller 236 controls, with reference to object identifiers (i.e.,
objected), objects to be transmitted from the first buffer 233 to the second buffer 234 and to be displayed on one page. That is, the image controller 236 controls the first buffer 233 to select the graphic data object necessary to compose the pertinent page

9
(i.e. screen), based on the page composition information of the PCS data output from the page composition buffer 23S, and to transmit selected graphic data object from the first buffer 233 to the second buffer 234. The image controller 236 transmits the page composition information to the second buffer 234 to compose the display screen. Further, when the image controller 236 receives a user operation from a user, the image controller 236 controls the above elements to select the subtitle graphic data and the navigation graphic data having a different PID and composes a display screen.
[48] FIG. 3 is a diagram illustrating a third embodiment of the present invention of
graphic data.
[49] An operation of processing the graphic data having display sets 120a through 120n
in a graphic data processing apparatus 230 and displaying the processed graphic data on a display screen will be explained in detail with reference to FIG. 3.
[50] Referring to FIG. 3, subtitle graphic data and navigation graphic data have four
display sets 305 through 320, 325 through 330, 335 through 345, and 350 through 360. As an MPEG-2 TS including a plurality of display sets, passes through the decoder
232, die subtitle graphic data and the navigation graphic data included in the ODS
122a through 122n is stored in the first buffer 233 and the page composition in
formation contained in the PCS 121 is stored in the page composition buffer 235.
Further, both the graphic data and the page composition information are, respectively,
transmitted to the second buffer 234 based on respective PTS information. The
operation will be explained below. A header of each display set is not shown in FIG. 3
for convenience of description.
[51] FIG. 4A is a diagram illustrating a state in which a first display set 305 through 320
having a PCS 305 with a page_jd=l is stored in buffers.
[52] Graphic data of an ODS 310 with an objected=l and graphic data of an ODS 315
with the object_id=2 are stored in the first buffer 233 at a time indicated by the PTS information included in the ODSs 310 and 315. At this time, no data is stored in the page composition buffer 235. In general, an instance where all object data stored in the first buffer 233 is no longer used and a new display set is input to the first buffer 233 to process new object data is called mode conversion. A first PCS input during mode conversion has no data or is a dummy PCS. Accordingly, a graphic data processing apparatus 230 decodes only necessary objects of the first display set 305 through 320 until a subsequent mode conversion and stores the necessary objects in the first buffer
233. Therefore, there is no data in the second buffer 234.
[53] FIG. 4B is a diagram illustrating a state in which a second display set 325 through

10
330 having a PCS 325 with the page_jd=2 is stored in the buffers.
[54] Referring to FIG. 3, the second display set 325 through 330 having the PCS 325
with the page_jd=2 includes the PCS 325 and an END 330. The second display set 325 through 330 includes the page composition information to display the objects of the first display set 305 through 320 with the page_jd=l stored in the first buffer 233 on the display screen. Accordingly, the PCS 325 with the page_jd=2 includes position information indicating which graphic objects are displayed and where the graphic objects are displayed on the display screen. The image controller 236 controls the first buffer 233 using the page composition information of the PCS 325 with the page_jd=2 so that the graphic objects corresponding to the ODS 310 with the object_id=l and the ODS 315 with the object_id=2 is transmittable to the second buffer 234 and the screen may be composed. At a time indicated by the PTS information included in the PCS 325, graphic screen data of a completely composed screen is output from the second buffer 234 to the display device.
[55] FIG. 4C is a diagram illustrating a state in which a third display set 335 through 345
having a PCS 335 with the page_jd=3 is stored in the buffers.
[56] Referring to FIG. 3, the third display set 335 through 345 having the PCS 335 with
the page_id=3 includes the PCS 335, an ODS 340 with the object_id=2, and an END 345. The ODS 340 included in the third display set 335 through 345 having the PCS 335 with the page_jd=3 has a common object_id as that of the ODS 315 of die ODSs 310 and 315 of the first display set 305 through 320 having the PCS 305 with the page_jd=l. Since the ODS 340 having the common object_id as that of the ODS 315 overlies the ODS 315, the ODS 340 consequently performs an update operation. That is, although die page composition information of the PCS does not change, an updated object is reflected on the display screen such that at a time indicated by PTS information of the pertinent PCS, graphic data, which is stored in the second buffer 234, of a completely composed screen is output to the display device.
[57] FIG. 4D is a diagram illustrating a state in which a fourth display set 350 through
360 having a PCS 350 with the page_id=4 is stored in the buffers.
[58] Referring to FIG. 3, the fourth display set 350 through 360 having the PCS 350
with the page_jd=4 includes the PCS 350 containing new page composition information, an ODS 355 with the objected=3, and an END 360. After the graphic processing apparatus 230 stores data corresponding to each segment in the first buffer 233, the second buffer 234, and the page composition buffer 235, the graphic
processing apparatus 230 outputs data, which is stored in the second buffer 235, of a

11
completely composed screen to the display device at a time indicated by PTS information of the PCS 350 with the page_jd=4.
[59] FIGS. 5A-5D are diagrams illustrating a process of inputting and outputting data to
and from the buffers in accordance with a passage of time.
[60] Referring to FIG. 5A-5D, all of the PCS 305, ODS 310 and 315 and END 320 of
the first display set 305 through 320 are stored in the coded data buffer 231 at a time 510 indicated by PTS information included in an MPEG-2 TS header of a pertinent packet, and are output from the coded data buffer 231, decoded in the decoder 232, and stored in the first buffer 233 between times 550 and 560 indicated by PTS information of the respective ODSs 310 and 315. As previously explained, a time when one object is output from the coded data buffer 231 theoretically is equal to a time when the object is decoded in the decoder 232 and stored in die first buffer 233. However, in actuality, since time is taken to decode the object, the value of the time 560 indicated by the PTS information of the ODS 315 with the objected=2 is greater than that of the time 550 indicated by the PTS information of the ODS 310 with the object_jd=l.
[61 ] Accordingly, a first graphic object of the ODS 310 with the object_jd=l is output
from the coded data buffer 231 and is decoded and stored in the first buffer 233 at the time 550 indicated by the PTS information of the ODS 310 with the objected=l. A second graphic object of the ODS 315 with the object_id=2 is output from the coded data buffer 231, and then decoded and stored in the first buffer 233 at the time 560 indicated by the PTS information of the ODS 315 with the object_id=2.
[62] All the PCS 325 and END 330 of the second display set 325 through 330 are stored
in the coded data buffer 231 at a time 530 indicated by PTS information included in a header of the pertinent packet. The PCS 325 is decoded in the decoder 232 and stored in the page composition buffer 235. The image controller 236 controls the first buffer
233 to transmit the object necessary to compose the pertinent screen from the first buffer 233 to the second buffer 234 based on the page composition information. A time when the object stored in the first buffer 233 is transmitted to the second buffer
234 and the screen composition starts, is the same as a time indicated by the PTS information of the ODS, which is stored last in the first buffer 233.
[63] However, since the PCS 305 of the first display set 305 through 320 is a dummy
PCS with no page composition information, the ODS 315 with the objecte_id=2, which is stored last, is not transmitted to the second buffer 234 at the time indicated by die PTS information thereof, and not used in the screen composition. When the image controller 236 uses the PCS information of the second display set 325 through 330

12
which is decoded and stored in the page composition buffer 235, the first graphic object with the object_id=l and the second graphic object with the object_id=£, which are necessary for the screen composition, are transmitted from the first buffer 233 to the second buffer 234 such that the screen composition starts. At a time 590 indicated by PTS information of the PCS 325 with the page_jd=2, the graphic screen data of a completely composed screen is output to the display screen.
[64] All of the PCS 335, ODS 340, and END 345 of the third display set 335 through 345 are stored in the coded data buffer 231 at a time 530 indicated by PTS information included in a header of the pertinent packet and are output from the coded data buffer 231, decoded, and immediately stored in the first buffer 233 at a time 570 indicated by the PTS information of the ODS 340 of the third display set 335 through 345. At this time, since the ODS 340 included in the third display set 335 through 345 uses a common object_id as that of the ODS 315, which has already been stored in the first buffer 233, the ODS 340 overlies the previously stored second object of the ODS 315. As a result, an updated second object is obtainable.
[65] However, since the PCS 335 with the page_jd=3 performs the screen composition using the ODSs 310 and 340 with the objected=l and the objected=2, the ODS 340 with the object_id=2 is stored last in the first buffer 233 at the time indicated by the
PTS information of the ODS 340, and is simultaneously transmitted to the second buffer 234 to be used in the screen composition. At a time 591 indicated by the PTS information of the PCS 335 with the page_id=3, a page of a completely composed screen is output to the display device. At this time, the second buffer 234 maintains a display screen output which is composed based on the page composition information of the PCS 325 with the page_id=2 until the time indicated by the PTS information of the PCS 335 with the page_id=3.
[66] Furthermore, all of the PCS 350, ODS 355, and END 360 of the fourth display set 350 through 360 are stored in the coded data buffer 231 at a time 540 indicated by the PTS information included in a header of the pertinent packet and are output from the coded data buffer 231, decoded, and immediately stored in the first buffer 233 at a time 580 indicated by the PTS information of the ODS 355 of the fourth display set 350 through 360. At a time 592 indicated by the PTS information of the PCS 350 with the page_id=4, a page of a completely composed screen is output to the display device. At this time, the second buffer 234 maintains a display screen output which is composed based on the page composition information of the PCS 335 with the page_id=3 until the time indicated by the PTS information of the PCS 350 with the

13
page_jd=4. Accordingly, the second buffer 234 includes a preparing bu ffer 610 and a display buffer 620 as shown in FIG. 6.
[67] FIG. 6 is a detailed block diagram of the second buffer 234.
[68] Referring to FIG. 6, the second buffer 234 includes the preparing buffer 610 and the
display buffer 620. The preparing buffer 610 is a memory used in placing with reference to the page composition information, objects input from the first buffer 233 at predetermined positions of the display screen. The display buffer 620 is a memory used in displaying data of the prepared display screen. At a time indicated by the PTS information of the PCS 305, 325, 335 and 350, operations of the preparing buffer 610 and the display buffer 620 are exchanged and data of the completely composed screen is finally output to a display device 630.
[69] In further detail with reference to FIGS. 4B and 4C, when the screen composition is
completed with reference to the information of the PCS 325 with the page_id=2, contents of the second buffer 234 of FIG. 4B are stored in the display buffer 620, and output to the display device 630. Screen composition proceeds in the preparing buffer 610 with reference to the information of the PCS 325 with the page_jd=3. At the time indicated by the PTS information of the PCS 335 with the page_id=3, the operations of the preparing buffer 610 and the display buffer 620 are exchanged such that the contents of the second buffer 234 shown in FIG. 4 are output to the display device 630 and the data of the fourth display set 350 through 360 is input to the preparing buffer 610 in a common manner as described above so as to be used in the screen composition.
[70] FIG. 7 is a flow chart illustrating an operation of outputting graphic display data of
a completely composed page to the display device.
[71] In operation S710, graphic data is received. In operation S720, page composition
information which describes a page composition of the graphic data is received. In step operation S730, graphic screen data which is composed with reference to the page composition information of the graphic data is output to the display screen according to presentation information which indicates when the graphic screen data is output to the display screen. The presentation information is recorded in a page composition segment including the page composition information. Further, if a plurality of graphic data values exists, a graphic display screen composition starts with reference to the
presentation information of a respective one of the graphic data values, among the
plurality of graphic data values, that was last input.
[72] FIG. 8A is a flow chart illustrating an operation of outputting a decoded graphic

14
object.
[73] In operation S810, a graphic object of which a graphic data screen is composed is
received. In operation S820a, a decoded graphic object is output according to presentation information indicating when the graphic object is decoded and output.
[74] FIG. 8B is a flow chart illustrating an operation of inputting a graphic object to the
decoder.
[75] In operation S810, a graphic object of which a graphic screen is composed is
received. In operation S820b, the graphic object is input to the decoder 232 to be decoded according to presentation information indicating when the graphic object is input to the decoder 232.
[76] In theory, assuming that a decoding time in the decoder 232 is 0, FIGS. 8A and 8B
show that a time when the graphic object is input to the decoder 232 is the same as a time when the graphic object is output from the decoder 232. The presentation information is recorded in an object display segment having the graphic object. Thus, according to the invention, if a plurality of graphic objects exist, time values, respectively, indicated by presentation information of the graphic objects have a predetermined time interval there between.
[77] This invention may be embodied in a general purpose digital computer by running a
program from a computer usable medium, including but not limited to, storage media such as magnetic storage media (e.g., ROMs, floppy discs, hard discs, etc.), optically readable media (e.g., CD-ROMs, DVDs, etc.), and carrier waves (e.g., transmissions over the Internet). The computer readable recording medium may be dispersively installed in a computer system connected to a network, and stored and executed as a computer readable code by a distributed computing environment.
[78] Although a few embodiments of the present invention have been shown and
described, it would be appreciated by those skilled in the art that changes may be made in this embodiment without departing from the principles and spirit of the invention, the scope of which is defined in the claims and their equivalents.

15

Claims
[ 1 ] 1. An information storage medium for use by a computer, comprising:
graphic data;
page composition information which defines a page composition of the graphic data; and
presentation information indicating when graphic screen data, which is composed with reference to the page composition information of the graphic data, is output to a display screen.
[2] 2. The information storage medium of claim 1, wherein the presentation in-
formation is recorded in a page composition segment including the page composition information.
[3] 3. The information storage medium of claim 1, wherein if a plurality of graphic
data values exist, a screen composition of the graphic data starts with reference to presentation information of a last inputted graphic data value among the plurality of graphic data values.
[4] 4. An information storage medium for use by a computer comprising:
a graphic object to compose a graphic data screen; and
presentation information indicating when the graphic object is decoded and outputted or when the graphic object is input to a decoder.
[5] 5. The information storage medium of claim 4, wherein the presentation in-
formation is recorded in an object display segment having the graphic object.
[6] 6. The information storage medium of claim 4, wherein if a plurality of graphic
objects exist, time values, respectively, indicated by presentation information of the graphic objects have a predetermined time interval there between.
[7] 7. An information storage medium including graphic data having a structure
thereof which includes a display set comprising:
a page composition segment which includes information of a composition of a graphic screen and of a first presentation time stamp value;
an object display segment which includes a graphic object to compose the graphic screen, information of a size of the graphic object and of a second presentation time stamp value; and
an end segment which indicates an end of the display set,
wherein the first presentation time stamp value indicates when graphic screen
data composed of the page composition segment and the object display segment

16
is outputtable to a display device.
[8] 8. The information storage medium of claim 7, wherein if a plurality of object
display segments exist, the composition of the graphic screen starts with reference to presentation information of a respective one of the object display segments, among the plurality of object display segments, that was last input.
[9] 9. An information storage medium for use by a computer and including graphic
data having a structure thereof which includes a display set comprising: a page composition segment which includes information of a composition of a graphic screen and of a first presentation time stamp value;
an object display segment which includes a graphic object to compose the graphic screen, information of a size of the graphic object and of a second presentation time stamp value; and
an end segment which indicates an end of the display set, wherein the second presentation time stamp value indicates when the graphic object is decoded and outputted.
[10] 10. The information storage medium of claim 9, wherein the second presentation
time stamp value indicates when the graphic object is input to a decoder.
[11] 11. The information storage medium of claim 9, wherein if a plurality of object
display segments exist, second presentation time stamp values of the plurality of object display segments have a predetermined time interval there between.
[12] 12. An apparatus for processing graphic data, the apparatus comprising:
a first buffer which stores decoded graphic object data by graphic object identifiers; and
a second buffer which receives a graphic object used in a screen composition among the graphic object data stored in the first buffer and stores graphic screen information composed with reference to page composition information.
[13] 13. The apparatus of claim 12, wherein the second buffer comprises:
a preparing buffer which receives the graphic object used in the screen composition among the graphic object data stored in the first buffer and performs the screen composition with reference to the page composition information; and
a display buffer which stores graphic screen data of a completely composed screen and transmits the stored graphic screen data to a display device.
[14] 14. The apparatus of claim 12, wherein operations of the preparing buffer and the
display buffer are exchanged with reference to presentation information indicating that the screen composition is completed and that the graphic screen

17
information is outputtable to the display device.
[15] 15. The apparatus of claim 12, wherein after a mode conversion, the apparatus
decodes only necessary graphic objects of a display set and stores the necessary objects in the first buffer.
[16] 16. The apparatus of claim 12, wherein if the page composition information does
not change, an updated graphic object is reflected on a display screen such that at a time indicated by presentation time stamp information of graphic object data, which is stored in the second buffer, of a completely composed screen is output to the display device.
[17] 17. An apparatus for processing graphic data, the apparatus comprising:
a coded data buffer which receives and stores coded graphic data and outputs the coded graphic data according to presentation information included in the graphic data;
a decoder which decodes the coded graphic data;
a page composition buffer which stores page composition information among the decoded graphic data;
a first buffer which stores graphic objects of the decoded graphic data by graphic object identifiers;
a second buffer which receives a respective graphic object used in a screen composition among the graphic objects stored in the first buffer and stores graphic screen information composed with reference to the page composition information; and
an image controller which receives the page composition information stored in the page composition buffer and controls the graphic objects to be transmitted from the first buffer to the second buffer.
[18] 18. The apparatus of claim 17, wherein the second buffer comprises:
a preparing buffer which receives the graphic object used in the screen composition among the graphic objects stored in the first buffer and performs the screen composition with reference to the page composition information; and a display buffer which stores graphic screen data of a completely composed screen and transmits the stored graphic screen data to a display device.
[19] 19. The apparatus of claim 18, wherein operations of the preparing buffer and the
display buffer are exchanged with reference to presentation information indicating that the screen composition is completed and that the graphic screen information is outputtable to the display device.

18
[20] 20. A method of processing graphic data, the method comprising:
receiving the graphic data;
receiving page composition information which defines a page composition of me
graphic data; and
outputting graphic screen data, which is composed with reference to the page
composition information of the graphic data, to a display screen according to
presentation information indicating when the graphic screen data is output to the
display screen.
[21] 21. The method of claim 20, wherein the presentation information is recorded in
a page composition segment including the page composition information.
[22] 22. The method of claim 20, wherein if a plurality of graphic data values exist,
starting a screen composition of the graphic data with reference to presentation
information of a last input graphic data value among the plurality of graphic data
values.
[23] 23. A method of processing graphic data, the method comprising:
receiving a graphic object to compose a graphic data screen; and
outputting a decoded graphic object according to presentation information
indicating when the graphic object is decoded and outputted or when the graphic
object is input to a decoder.
[24] 24. The method of claim 23, wherein the presentation information is recorded in
an object display segment having the graphic object.
[25] 25. The method of claim 23, wherein if a plurality of graphic objects exist, time
values, respectively, indicated by presentation information of the plurality of
graphic objects have a predetermined time interval there between.
[26] 26. An information storage medium for use in a computer, and including graphic
data having a structure thereof which includes a display set comprising:
a page composition segment including information of a composition of a graphic screen and of a first presentation time stamp value indicating when graphic screen data is outputtable to a display device; and
an object display segment including a graphic object composing the graphic screen information.
[27] 27. An apparatus for processing graphic data, comprising:
a decoding buffer to stores decoded graphic object data; and
a receiving buffer to receive a graphic object used in a screen composition from the decoded graphic object data and to store graphic screen information

19
composed in accordance with page composition information.
[28] 28. The apparatus of claim 27, wherein if more than one graphic object exists,
presentation timestamp values thereof have a predetermined time interval there between in consideration of a time taken to decode a previous graphic
object.
[29] 29. The apparatus of claim 27, wherein the receiving buffer comprises:
a preparing buffer to receive the graphic object used in the screen composition and performs the screen composition with reference to the page composition information; and
a display buffer to process graphic screen data of a composed screen to a display
device.
[30] 30. A method of processing graphic data, the method comprising:
receiving the graphic data;
receiving page composition information to define a page composition of the graphic data; and
outputting graphic screen data, composed in accordance with the page composition information of the graphic data and timed in accordance with presentation information, to a display screen.
[31] 31. A method of processing graphic data, the method comprising:
receiving a graphic object to compose a graphic data screen; and
outputting a decoded graphic object according to presentation information indicating a timing of the graphic object with respect to a decoding operation.
[32] 32. A method of according to claim 31, wherein a graphic object is reusable
during graphic data processing to reduce a time thereof.
[33] 33. A computer readable medium for storing graphic screen information to use in
a computer, comprising:
page composition segment including information of a composition of a graphic screen and of a first presentation time stamp value indicating when graphic screen data is outputtable to a display device; and
an object display segment including a graphic object composing the graphic screen information.

20
34. An information storage medium for use by a computer including graphic data having structure thereof; an apparatus for processing graphic data; a method of processing graphic data; an apparatus for processing graphic data and a computer readable medium such as herein described with reference to the accompanying drawings.
Dated this 25th day of August 2005.

G. DEEPAK SRINIWAS
OF K & S PARTNERS
AGENT FOR THE APPLICANT(S)

21

Abstract
An information storage medium including graphic data and presentation information, and an apparatus and method of processing the graphic data are provided. The information storage medium includes the graphic data, page composition information which defines page composition of the graphic data, and the presentation information indicating when graphic screen data, which is composed with reference to the page composition information of the graphic data, is output to a display screen. Therefore, a graphic object is reusable in graphic data processing and accordingly, a time taken to process die graphic data is reducible and memory area may be saved.

INFORMATION STORAGE MEDIUM STORING GRAPHIC DATA AND APPARATUS AND METHOD OF PRECESSING THE GRAPHIC DATA

Documents:

Inventors:

PCT Conventions: