Title of Invention

RECORDING MEDIUM, REPRODUCING DEVICE, RECORDING METHOD, AND REPRODUCING METHOD

Abstract On a BD-ROM, PlayList information is recorded. The PlayList information includes MainPath information and SubPath information. The MainPath information specifies one of a plurality of AVClips as a MainClip, and defines a primary playback section on the MainClip. The SubPath information specifies, among the rest of the AVClips, one AVClip as a SubClip, and defines, on the SubClip, a secondary playback section to be synchronized with the primary playback section. The PlayList information includes an STN_table, which indicates SubClip and, from among a plurality of elementary streams multiplexed into the SubClip, elementary streams allowed to be played back. A total data size of AVClip per unit time is, for example, less than or equal to 48 Mbits when the AVClip includes a plurality of elementary streams allowed in the STN_table to be played back and does not include elementary streams which are not allowed in the STN_table to be played back.
Full Text Description
RECORDING MEDIUM, REPRODUCING DEVICE, RECORDING METHOD, AND
REPRODUCING METHOD
Technical Field
[0001]
The present invention belongs to a technical field of Out-of-
MUX framework.
Background Art
[0002]
The Out-of-MUX framework is a technology that simultaneously
reads a digital stream recorded on a read-only recording medium, such
as a BD-ROM, and a digital stream recorded in a local storage, which
is a rewritable recording medium, supplies them to a decoder, and
then plays back them synchronously.
Here, assume that the digital stream recorded on a BD-ROM is a
main portion of a movie while the digital stream recorded in a local
storage is a commentary of the director of the movie. In this case,
by realizing the above-mentioned Out-of-MUX framework, the main
portion of the movie on the BD-ROM and the commentary can be played
back together, which thereby improves and expands content on the BD-
ROM.
The prior art regarding read-only recording media includes the
following patent application.
Japanese Laid-Open Patent Application No.
H8-83478
Disclosure of the Invention
1

[Problems that the Invention is to Solve]
[0003]
In the above-described Out-of-MOX framework, a stream recorded
on the BD-RCM and a stream recorded in the local storage must be read
simultaneously, and TS packets constituting these streams need to be
supplied to the decoder. According to an examination of how much
band is required for the supply to the decoder, in the worst case
where the supply bit rate of the BD-RCM is 48 Mbps and the supply bit
rate of the local storage is 48 Mbps, the data supply of as much as
96 Mbits (48 Mbits + 48 Mbits) may occur during the period of the
simultaneous readout. If such a worst case is likely to occure, the
band in the device must be increased so as to supply TS packets at 96
Mbps. If this cannot be done, it is necessary to provide a large
buffer in the decoder and cause the decoder to perform a prior read
operation to read TS packets in advance so that the supply does not
concentrate at a point in time. If the period of simultaneous
readout is short, it may be possible; however, in the case of plyaing
back a movie of two hours length, the buffer capacity is insufficient,
and the prior read operation is therefore not successfully performed.
[0004]
Since the prior read operation is not successfully performed,
an underflow occures in the buffer for the prior reading operation.
This then causes loss of video and audio, and therefore the playback
quality is significantly reduced. However, high-bit-rate data supply
results in an impediment of price reduction of such playback
apparatuses.
The present invention aims at providing a recording medium
capable of supplying, to a decoder, digital streams supplied from
2

different recording media without the need of the band to be
increased.
[Means to Solve the Problem]
[0005]
In order to achieve the above-mentioned object, the recording
medium of the present invention is characterized by that: the
playlist information includes main-path information and sub-path
information; the main-path information specifies, among a plurality
of digital streams, one digital stream as a main stream, and defines
a primary playback section on the main stream; the sub-path
information specifies, among rest of the plurality of digital streams,
one digital stream as a substream, and defines, on the substream, a
secondary playback section which is to be synchronized with the
primary playback section; the playlist information further includes a
stream table showing at least one pair of elementary streams which
are allowed to be simultaneously played back, the pair of elementary
streams being made up of one of a plurality of elementary streams
multiplexed into the main stream and one of a plurality of elementary
streams multiplexed into the substream; and the total data size of a
digital stream per unit time is less than or equal to a predetermined
value, the digital stream including the pair of elementary streams
and not including an elementary stream which is not allowed in the
stream table to be simultaneously played back.
[Advantageous Effects of the Invention]
[0006]
The total data size, per unit time, of a plurality of
elementary streams allowed in the stream table to be played back is
less than or equal to the predetermined value. Even in the worst
3

case, the amount of TS packets transferred per unit time does not
exceed the predetermined value.
For example, in the case where the unit time is one second and
the predetermined value is 48 Mbits, if the supply amount of TS
packets locally reaches 96 Mbits due to the simultaneous readout of
the streams, the bit amount per second is controlled to be less than
or equal to 48 Mbits. Accordingly, the worst case—i.e. the data
supply amount of 96 Mbits—does not continue for 0.5 seconds or more.
[0007]
Since it is ensured that "the worst case does not continue for
0.5 seconds or more" at any point on the time axis of stream playback,
an underflow in the buffer of the decoder can be prevented by
building the playback apparatus in such a manner that TS packets with
a size of 96 Mbits x 0.5 seconds are always read in advance and
supplied to the decoder.
The prior reading operation with the upper limit of "96 Mbits
x 0.5 seconds" prevents the occurrence of an underflow, and therefore
TS packets can be stably supplied to the decoder. This eliminates
the risk that simultaneous readout to realize the Out-of-MUX
framework has an influence on the quality of the digital stream. It
is possible to realize the Out-of-MUX framework on a playback
apparatus that performs ED-ROM playback only without requiring the
bandwidth to be increased. As a result, playback apparatuses that
realize the Out-of-MUX framework can be introduced to the market at
low prices.
[0008]
In addition, with the limitation of "48 Mbps or less per
second," if the playback apparatus executes the simple control of
4

"always performing a prior reading operation" as described above, it
is possible to prevent the occurrence of an underflow even if the
worst-case data supply occurs. This eliminates the need of
implementation of a process for predicting the timings at which the
worst-case data supply would occur, whereby facilitating development
of the playback apparatuses.
Brief Description of the Drawings
[0009]
FIG. 1 shows a usage application of a recording medium
according to the present invention;
FIG. 2 shows an internal structure of a BD-RCM;
FIG. 3 is a schematic structure of a file with an extension
of .m2ts attached thereto;
FIG. 4 shows further details of how video and audio streams
are stored in a PES packet sequence;
FIG. 5 shows how the video and audio are multiplexed into a
program stream and a transport stream;
FIG. 6 shows details of a transport stream;
FIG. 7 shows internal structures of a PAT packet and a PMT
packet;
FIG. 8 shows what processes TS packets constituting an AVClip
are subject to before they are written to the BD-RCM;
FIG. 9 shows an internal structure of an Aligned Unit;
FIG. 10 shows an internal structure of Clip information;
FIG. 11 shows EP_map settings for a video stream of a movie;
FIG. 12 shows a data structure of PlayList information;
FIG. 13 shows relationships between AVClip and PlayList
information;
5

FIG. 14 shows an internal structure of a local storage 200;
FIG. 15 shows the way a Primary TS and a Secondary TS making
up an Out_of_MUX application are supplied to a decoder within a BD-RCM
playback apparatus;
FIG. 16 shows a data structure of PlayList information;
FIG. 17 shows a close-up of an internal structure of Sutpath
information;
FIG. 18 shows relationship of SubClips in the local storage
200, PlayList information in the local storage 200 and MainClip in
the BD-RCM;
FIG. 19A shows an internal structure of an STN_table;
[0010]
FIG. 19B shows a Stream_attribute corresponding to a video
stream;
FIG. 19C shows a Stream_attribute corresponding to an audio
stream;
FIG. 19D shows a Stream_entry of the audio stream;
FIG. 20 shows TS packets read from a BD-RCM and from a local
storage, and illustrates, of these TS packets, ones to be supplied to
the decoder;
FIGs. 21A-21D show shift of Window;
FIG. 22 is a graph showing temporal transition regarding a
data amount of TS packets read from the BD-RCM as well as a data
amount of TS packets read from the local storage;
FIGs. 23A and 23B show the comparison between the
transmittable amount and the amount supplied to the decoder for each
Window;
6

FIG. 24 shows a connection state of Playltems and SubPlayItems
constituting the Out_of_MUX;
FIG. 25 shows a relationship between In_Times and Out_Times of
Playltems and In_Times and Out_Times of SubPlayltems in the case
where connection_condition information of Playltem and
sp_connection_condition infomraiton of SubPlayl tern shown in FIG. 24
are set to "= 5";
FIG. 26 shows an STC value to be referred to when part
existing from ln_Time to Out_Time of Playltem is played back and an
STC value to be referred to when part existing from In_Time to
Out_Time of SubPlayltem is played back;
FIG. 27 shows how TSls and TS2s are identified in a MainClip
referred to in the previous Playltem and a SubClip referred to in the
current Playltem;
FIG. 28 shows details of CC = 5 and SP_CC = 5;
FIG. 29 shows a relationship among multiple Video Presentation
Units specified by a previous Playltem and the current Playltem,
multiple Audio Presentation Units, and STC time axes;
FIG. 30 shows an internal structure of the playback apparatus
of the present invention;
FIG. 31 is a flowchart showing a playback procedure based on
PlayList information;
FIG. 32 is a flowchart showing a processing procedure of a
seamless connection of SubPlayltems;
FIG. 33 shows an internal structure of an authoring system of
Embodiment 2;
FIG. 34 is a flowchart showing the verification procedure on
Primary TSs and Secondary TSs;
7

FIG. 35 is a flowchart showing a procedure of verification on
a Primary TS and a Secondary TS when there are multiple elementary
streams of the same type;
FIG. 36 shows a detailed explanation of CC = 6;
FIG. 37 shows a correlation between PlayItems and
SubPlayItems ;
FIG. 38 schematically shows the way multiple TS packets
present on an ATC time axis are multiplexed;
FIG. 39 schematically shows, in the case where a subtitle (PG)
and a menu (IG) are also replaced in addition to audio, the way
multiple TS packets constituting the Primary TS and multiple TS
packets constituting the Secondary TS are multiplexed together;
FIG. 40 shows the way a Primary TS and a Secondary TS
constituting an audio mixing application are supplied to a decoder
within the BD-ROM playback apparatus;
FIG. 41 shows an internal structure of the playback appratus
according to Embodiment 5;
FIG. 42 shows a correlation between PlayItems and SubPlayIterns
specified by a PlayList indicating audio mixing; and
FIG. 43 shows an example of PlayList information making up
both a theatrical version and a director's cut.
Explanation of References
[0011]
la ED-ROM drive
lb, c read buffer
1b, a, c ATC counter
2a, d source depacketizer
2c, d ATC counter
8

3a, c STC counter
3b, d PID filter
4 video decoder
5 video plane
6 transport buffer
7 elementary buffer
8 audio decoder
10a, b, c, d switch
11 interactive graphics decoder
12 interactive graphics plane
13 presentation graphics decoder
14 presentation graphics plane
17 synthesis unit
21 memory
22 controller
23 PSR set
24 PID conversion unit
25 network unit
26 operation receiving unit
100 ED-ROM
200 local storage
300 playback apparatus
400 television
500 AV amplifier
Best Mode for Carrying Out the Invention
[0012]
EMBODIMENT 1
9

The following gives an account of a preferred embodiment of a
recording medium according to the present invention. First, a usage
application is described in relation to the implementation of the
recording medium of the present invention. FIG. 1 shows a usage
application of the recording medium according to the present
invention. A local storage 200 in FIG. 1 is the recording medium of
the present invention. The local storage 200 is used for the purpose
of supplying a movie to a home theater system composed of a playback
apparatus 300, a television 400, an AV amplifier 500 and speakers 600.
[0013]
The following explains a BD-ROM 100, the local storage 200 and
the playback apparatus 300.
The BD-ROM 100 is a recording medium on which a movie is
recorded.
The local storage 200 is a hard disk that is built in the
playback apparatus, and is used for storing content distributed from
a server of a movie distributor.
[0014]
The playback apparatus 300 is a digital home electrical
appliance supported for networks, and has a function to play the BD-
ROM 100. The playback apparatus 300 is also able to download content
from a server 700 of a movie distributor via a network, store the
downloaded content in the local storage 200, and combine this content
with content recorded on the ED-ROM 100 to expand/update the content
of the BD-ROM 100. A technology called "virtual package" combines
content recorded on the BD-ROM 100 with content stored in the local
storage 200 and treats data not recorded on the BD-ROM 100 in the way
as if it is recorded on the BD-ROM 100.
10

[0015]
Thus concludes the description of the usage application of the
recording medium of the present invention.
Next is described a production application of the recording
medium of the present invention. The recording medium of the present
invention can be realized as a result of improvements in the file
system of a BD-RCM.

FIG. 2 shows an internal structure of a ED-RCM. Level 4 in
the figure shows the BD-ROM, and Level 3 shows a track on the BD-ROM.
The figure depicts the track in a laterally drawn-out form, although
the track is, in fact, formed in a spiral, winding from the inside
toward the outside of the BD-RCM. The track is composed of a lead-in
area, a volume area, and a lead-out area. The volume area in the
figure has a layer model made up of a physical layer, a filesystem
layer, and an application layer. Level 1 in the figure shows a
format of the application layer of the BD-RCM by using a directory
structure. In Level 1, BD-RCM has BDMV directory under Root
directory.
[0016]
Furthermore, three subdirectories are located under the BDMV
directory: PIAYLIST directory; CLIPINF directory; and STREAM
directory.
The PIAYLIST directory includes a file to which an extension
of mpls is attached (00001.mpls).
The CLIPINF directory includes files to each of which an
extension of clpi is attached (00001.clip and 00002.clip).
[0017]
11

The STREAM directory includes files to each of which an
extension of m2ts is attached (00001.m2ts and 00002.m2ts) .
Thus, it can be seen that multiple files of different types
are arranged in the ED-RCM according to the directory structure above.

First, files to which the extension "m2ts" is attached are
explained. FIG. 3 shows a schematic structure of the file to which
the extension "m2ts" is attached. The files to each of which the
extension "m2ts" is attached (00001.m2ts and 00002.m2ts) store an
AVClip. The AVClip is a digital stream in the MPBG2-Transport Stream
format. The digital stream is generated by converting the digitized
video and audio (upper Level 1) into an elementary stream composed of
PES packets (upper Level 2), and converting the elementary stream
into TS packets (upper Level 3), and similarly, converting the
Presentation Graphics (PG) stream for the subtitles or the like and
the Interactive Graphics (IG) stream for the interactive purposes
(lower Level 1 and lower Level 2) into the TS packets (lower Level 3),
and then finally multiplexing these TS packets.
[0018]
The following describes the video stream, audio stream, PG
stream and IG stream.

Documents:

03784-kolnp-2007-abstract.pdf

03784-kolnp-2007-claims.pdf

03784-kolnp-2007-correspondence others-1.1.pdf

03784-kolnp-2007-correspondence others.pdf

03784-kolnp-2007-description complete.pdf

03784-kolnp-2007-drawings.pdf

03784-kolnp-2007-form 1.pdf

03784-kolnp-2007-form 2.pdf

03784-kolnp-2007-form 3.pdf

03784-kolnp-2007-form 5.pdf

03784-kolnp-2007-international search report.pdf

03784-kolnp-2007-others.pdf

03784-kolnp-2007-pct priority document notification.pdf

03784-kolnp-2007-pct request form.pdf

03784-kolnp-2007-priority document.pdf

03784-kolnp-2007-translated copy of priority document.pdf

3784-KOLNP-2007-(22-08-2014)-ABSTRACT.pdf

3784-KOLNP-2007-(22-08-2014)-CORRESPONDENCE.pdf

3784-KOLNP-2007-(22-08-2014)-DESCRIPTION (COMPLETE).pdf

3784-KOLNP-2007-(22-08-2014)-FORM-1.pdf

3784-KOLNP-2007-(22-08-2014)-FORM-2.pdf

3784-KOLNP-2007-(22-08-2014)-FORM-3.pdf

3784-KOLNP-2007-(22-08-2014)-FORM-5.pdf

3784-KOLNP-2007-(22-08-2014)-OTHERS.pdf

3784-KOLNP-2007-(22-08-2014)-PETITION UNDER RULE 137.pdf

3784-KOLNP-2007-(28-01-2014)-ANNEXURE TO FORM 3.pdf

3784-KOLNP-2007-(28-01-2014)-CORRESPONDENCE.pdf

3784-KOLNP-2007-CORRESPONDENCE 1.2.pdf

3784-KOLNP-2007-CORRESPONDENCE-1.3.pdf

3784-KOLNP-2007-CORRESPONDENCE-1.4.pdf

3784-KOLNP-2007-CORRESPONDENCE.pdf

3784-KOLNP-2007-FORM 1-1.1.pdf

3784-KOLNP-2007-FORM 13-1.1.pdf

3784-KOLNP-2007-FORM 13.pdf

3784-kolnp-2007-form 18.pdf

3784-KOLNP-2007-FORM 2-1.1.pdf

3784-KOLNP-2007-GPA.pdf

3784-KOLNP-2007-OTHERS.pdf

3784-KOLNP-2007-PA.pdf

3784-KOLNP-2007-REPLY TO EXAMINATION REPORT.pdf


Patent Number 265126
Indian Patent Application Number 3784/KOLNP/2007
PG Journal Number 07/2015
Publication Date 13-Feb-2015
Grant Date 09-Feb-2015
Date of Filing 05-Oct-2007
Name of Patentee PANASONIC CORPORATION,
Applicant Address 1006, OAZA KADOMA, KADOMA SHI, OSAKA
Inventors:
# Inventor's Name Inventor's Address
1 HIROSHI YAHATA C/O MATSUSHITA ELECTRIC INDUSTRIAL CO. LTD. 1006, OAZA KADOMA, KADOMA-SHI, OSAKA 571-8501
2 TOMOYUKI OKADA C/O MATSUSHITA ELECTRIC INDUSTRIAL CO. LTD. 1006, OAZA KADOMA, KADOMA-SHI, OSAKA 571-8501
PCT International Classification Number G11B 20/12
PCT International Application Number PCT/JP2006/307441
PCT International Filing date 2006-04-07
PCT Conventions:
# PCT Application Number Date of Convention Priority Country
1 2005-111426 2005-04-07 Japan
2 2005-111427 2005-04-07 Japan
3 2005-111429 2005-04-07 Japan
4 2005-111425 2005-04-07 Japan
5 2005-111428 2005-04-07 Japan