Title of Invention	A METHOD FOR CREATING AND EDITING MULTIMEDIA PRESENTATIONS ON A SMALL DISPLAY TERMINAL AND ASSOCIATED TERMINAL
Abstract	A method by which a multimedia presentation editor for use on a (typically handheld) communication or computing terminal (10) interfaces with a user so as to allow the user to create or edit a presentation (20), including: a step (51) in which objects to be displayed successively when a slide (21) is displayed in play mode, are instead assembled by the editor one under another in a column (25a), and objects (22) to be displayed continuously are also assembled in a (one-object-long) column (25b); and a step (52) in which the editor displays each column (25a-b) side-by-side, corresponding to the side-by-side arrangement of respective objects in the different columns (25a-b) when the slide (21) is displayed in play mode, thus allowing some parts of the slide (21) to be fixed, and some parts (23a-c) to change--the parts having columns with more than one object. Corresponding equipment is also provided.

Title of Invention

A METHOD FOR CREATING AND EDITING MULTIMEDIA PRESENTATIONS ON A SMALL DISPLAY TERMINAL AND ASSOCIATED TERMINAL

Abstract

A method by which a multimedia presentation editor for use on a (typically handheld) communication or computing terminal (10) interfaces with a user so as to allow the user to create or edit a presentation (20), including: a step (51) in which objects to be displayed successively when a slide (21) is displayed in play mode, are instead assembled by the editor one under another in a column (25a), and objects (22) to be displayed continuously are also assembled in a (one-object-long) column (25b); and a step (52) in which the editor displays each column (25a-b) side-by-side, corresponding to the side-by-side arrangement of respective objects in the different columns (25a-b) when the slide (21) is displayed in play mode, thus allowing some parts of the slide (21) to be fixed, and some parts (23a-c) to change--the parts having columns with more than one object. Corresponding equipment is also provided.

Full Text	MULTIMEDIA PRESENTATION EDITOR FOR A SMALL-DISPLAY COMMUNICATION TERMINAL OR COMPUTING DEVICE* ****** *TITLE**************** (LEAVE ABOVE LINE AS Is UNTIL FINAL DRAFT) BACKGROUND OF THE INVENTION 1. TECHNICAL FIELD The present invention pertains to the field of creating/editing presentations on a device with a small display. More particularly, the present invention pertains to creating presentations having content displayed/ played (providing possibly text and images and sound all at the same time) based on instructions encoded using the SMIL language oa a comparable XML-based language, and is especially useful for creating MMS messages using a handheld communication device, such as a cell phone. 2 . DISCUSSION OF RELATED ART The invention is related to editing/ creating (as opposed to viewing) multimedia presentations on a portable device. Multimedia presentations are e.g. shown by the device itself or using an external display or communicated between mobile/ cell phones or other communication terminals as a part of MMS -(multimedia oyotem)(Multmedia Messaging Service) messages, as prescribed by 3GPP (Third Generation Partnership Program) technical specifications. (MMS, like Short Message Service (SMS), provides automatic and immediate delivery of personal messages, but allows incorporating sound, images, and other rich content, transforming it into a personalized visual and audio message.) The presentation part in MMS messages can use different formats, but Synchronized Multimedia Integration Language (SMIL, pronounced "smile") 2.0 is the mandatory format specified by the current 3GPP Release 5 specification. The presentation part includes all media objects (content of the multimedia presentation) as one data object/ assembly, describing their layout, timing and other aspects of displaying/ playing the media objects on the receiving communication terminal. For example, if an MMS message contains two slides and each contains a text object and an image, the MMS message consists of MMS headers, two image objects, two text objects, and one SMIL object with information to the effect that the message consists of a sequence of two time containers and that the first time container contains parallel media objects (image and text). See Fig. 1 for an example of the structure of a presentation object in MMS. SMIL is an Extensible Markup Language (XML)-based language. It contains building blocks called modules. The modules which are important from the point of view of the present invention are the so-called structure module, the timing and synchronization module, and the media object module. Each module includes one or more so-called elements and so-called attributes. The most important elements of SMIL are the so-called "par" and wseq" elements. A par element groups object that should appear in parallel, temporally, in a presentation. For example, if text and an image are shown on one slide at the same time, they will be put within a single ... pair in a block of SMIL code. A seq element may contain objects that are supposed to be presented to the user sequentially, one after the other, i.e. the second one will not become visible until the first has been displayed/ played and is not longer being displayed/ played. So the two slides from the previous example would typically be put within a ... pair to indicate that they must be played in sequence. Also the main body element is treated as a seq element when timing is considered. These and some other more than two levels, a slide may itself be an entire presentation/ set of slides, each of which may itself be a new, further presentation/ set of slides, and so on.) MMS terminals available currently on the market are capable of editing or viewing only limited SMIL structures (in terms of time container nesting). The first (top) level of nesting represents the presentation and the second level represents slides. Media items are placed on the second level. Although some handheld terminals (such as cell/ mobile phones) can play more complicated content than a two-level presentation, it is impractical today for typical cell phones or other handheld terminals to create more complicated presentations because editing a three-level timing and a two-dimensional space presentations on the typically small screen of a mobile phone or other handheld and making it usable by an average user is difficult. All handheld-hosted editors today are not intuitive or simple and are too time-consuming when used to create complex presentations. Prior art MMS editors for handheld terminals (such as mobile phones) do not typically allow the content of a slide in a presentation to change with time. In other words, the slides created must be static (except that the media items contained in a slide may change, e.g. video clips, animated .GIF images, etc.). Other, more sophisticated MMS editors e.g. for desktop computers as opposed to handheld devices use an approach in which the entire presentation or animation (if the software is for video editing) is divided into "frames" displayed side-by-side in columns and rows, Fig. 3 showing one row, and a user can navigate between frames (in other words, move to a different point in the presentation) using some sort of a slider widget. An approach using frames displayed side-by-side is useful for computers with big screens, so that the software can reasonably display frames side-by-side all on the same screen. But doing so is not practical on a handheld device because of the small size of the screen. Yet another approach is used in- desktop presentations editors ouch as e.g.—Microsoft PowerPoint-—In such editors it io-possible-to chow tho true layout of several different images that are to appear on a single slide of a presentation and show them in sequence on the slide using an animations menu/ toolbar.—However,—doing so requires that in the editor (view)—the images be displayed one on top of the other—(i.e. overlapping,—so that the topmost at least partially obscures the others). What is therefore needed is a way of providing instructions for creating a complex multimedia message such as an MMS message on a handheld device, i.e. e.g. a multimedia message that is more than two levels. DISCLOSURE OF INVENTION Accordingly, in a first aspect of the invention, a method is provided for by which a multimedia presentation editor hosted by a communication or computing terminal having a display device, interfaces with a user so as to allow the user to create or edit a presentation including a slide in turn including a plurality of objects for display in playing the presentation, characterized by: a step in which the objects in each set of objects of the slide to be displayed successively one after the other when the presentation is played are instead assembled by the editor one under another in respective columns, and each single object of the slide to be displayed continuously on the slide when the presentation is played are also assembled by the editor in respective one-object columns, thereby providing a plurality of columns, wherein at least one of the columns has a plurality of objects; and a step in which the editor displays at the same time each column side-by-side with each other column on the display device; the objects of the slide thus forming on the display device when displayed by the editor one or more side-by-side vertical columns some of which may include only a single object and some of which include more than one object, thereby providing that some parts of the slide may remain fixed while the slide is displayed in play mode and some parts will change. In accord with the first object of the invention, the multimedia presentation may be for communication as an MMS message. In accord with the first object of the invention, SMIL may be used with the editor to prescribe how the multimedia presentation is to be played. In a second aspect of the invention, a computer program product is provided comprising: a computer readable storage structure embodying computer program code thereon for execution by a computer processor in a communication or computing terminal, with said computer program code characterized in that it includes instructions for performing the steps of a method according to the first aspect of the invention. In a third aspect of the invention, a communications or computing terminal is provided having a display device and including a multimedia presentation editor for creating or editing a presentation including a slide in turn including a plurality of objects for display in playing the presentation, characterized in that the editor comprises means for performing the steps of a method according to the first aspect of the invention. In a fourth aspect of the invention, a telecommunications network is provided including a plurality of telecommunications terminals at least one of which is according to the third aspect of the invention. ... TBD based—on the claims as in the final draft of the application - BRIEF DESCRIPTION OF THE DRAWINGS The above and other objects, features and advantages of the invention will become apparent from a consideration of the subsequent detailed description presented in connection with accompanying drawings, in which: Fig. 1 illustrates the structure of a presentation object used in MMS according to the OMA MMS 1.1 and 1.2 specifications. Fig. 2 illustrates the structure of message timing achievable using the invention, without making the user interface more complicated; notice the added dynamic image-changing. Fig. 3 illustrates the approach used by a typical multimedia editor intended for use with a desktop computer. Fig. 4A illustrates an editor screen in an actual implementation of the invention--in a Series 90 MMS Editor. When the same presentation is displayed in play mode, the images are shown one after the other, instead of at the same time (i.e. they are not all displayed at the same time), Fig. 4B illustrates the screens in play mode corresponding to the editor screen displayed in Fig. 4A. Fig. 5 is a flowchart illustrating a method according to the invention by which an editor hosted e.g. by a handheld device having a small screen enables a user to create a slide for a presentation. BEST MODE FOR CARRYING OUT THE INVENTION The invention provides a hybrid solution for how to create complex multimedia presentations on a handheld device, taking what is appropriate from the various existing solutions so as to provide increased editing capability on a handheld, editing that is intuitive and relatively fast. Referring now to Fig. 2, in editing a presentation 20 using an editor according to the invention, the parts of a slide 21 that change (i.e. typically the images, in that the images in a set of images 23a-c are to be shown when played one at a time and one after the other, but on the same slide 21) are shown like "frames" are shown by editors for desktop computers, i.e. next to each other (more specifically, one on top of the other, as shown in Fig. 2). But the parts of the slide 21 that are static--usually the text 22 for a slide--are shown only once, i.e. are not repeated for each part (usually an image) that changes. Such a hybrid solution saves space on the screen. The proposed solution assumes that the layout rules--i.e. e.g. the SMIL for the presentation--are fixed and that the part of a slide that does not change (typically the text) is fixed for the duration of a slide. For example, it is reasonable to suppose that a user might take three pictures with a built-in camera and might want to show the pictures in sequence in a presentation. At the same time the user might want a block of text to appear with all of the picture, such as e.g., "These are the pictures I took in front of my house." This is a likely use case because typing long text on a small device like a mobile phone (especially if it does not have a full "qwerty" keyboard) is time-consuming and so a user would likely not want to input a lot of different text blocks, whereas taking pictures is easy to do and fast. Also, it is unlikely that a user would want to manipulate the layout of a slide for a presentation on a handheld device because on a small screen there is not enough space for any (significant) manipulation. Using these assumptions, as explained above, the solution provided by the invention is to display images one under another (not overlapping, but arranged in a column) in the presentation editor--i.e. in edit mode--with instructions for play mode (provided e.g. using SMIL) that the images be displayed in a temporal sequence, one after the other. At the same time the horizontal layout remains true, i.e. corresponds to the layout seen when the presentation is played. Thus, the vertical layout in the editor does not correspond to the actual layout seen when the presentation is played: the vertical dimension in the editor represents time. Referring now to Fig. 4A, a display device 10a of a communications or computing terminal 10 for an exemplary slide 21 is shown when the slide 21 is displayed by an editor according to the invention. The slide 21 includes two pictures 23a-b and accompanying text block 22, and so in edit mode the screen is as shown in Fig. 4A, with the two pictures 23a-b arranged in a vertical column (of two rows) and appearing on the screen at the same time, and the text block 22 appearing as the one and only row of another vertical column. The corresponding screen in play mode for the slide would show the two pictures 23a-b one after the other in time (i.e. not at the same time), with the (same) text block 22 displayed for each. The instructions for so playing the slide (i.e. for displaying it in play mode) are included e.g. in an SMIL object (not shown) included with the image objects 23a-b and text object 22 in e.g. an MMS message. Note that if the text were longer, or if there were more images in the first column, the display device 10a would provide scroll controls typically on the right hand side so as to allow viewing all the text. The SMIL, in simplified form, corresponding to the _editor screen of Fig. 4A--i.e. indicated by the editor screen of FigL 4A as how the presentation is to be played, can be (more or less) as follows: (The "more or less" is because, as in the earlier exemplary SMIL code fragment, the SMIL code fragment here is also simplified encoding; an actual encoding in SMIL would include several more elements and attributes, none of which are relevant to the invention and so are omitted here for clarity.) To specify a presentation including both the slide(s) corresponding to the editor view of Fig. 4A and also another slide (or slides, depending on how you count) in whicl the same text is repeated for three different images, the SMI1 code fragment would be something like: _ As can be seen from the above SMIL code fragments, the invention allows creating a slide that is described by more than two (and in fact here three) levels of time containers in SMIL (as opposed to three levels of SMIL). Referring now to Fig. 4B, the two screens in play mode corresponding to the single editor screen (which, depending on the display device 10a, may not be visible all at once, and so may require scrolling) displayed in Fig. 4A are shown on a display device that may be the display device 10a of the communications or computing terminal 10 on which the exemplary slide 21_was created using an editor according to the invention (as is indicated in Fig. 4B), or that may be any other display device (not necessarily communicatively coupled to the communications or computing terminal 10). As indicated by the above code fragment for slide 1, in play mode, while slide 1 is being displayed, first imagel is shown and then, after about 10 seconds, image 2 is shown, i.e. on the same slide. Note that in some embodiments, to generate the SMIL (or comparable) code, the user using the editor would click on or otherwise signal the editor that the user would like to prescribe properties for an image being displayed in edit mode, and the user would then be presented with a dialog box in which the user is able to indicate e.g. the duration the image is to be displayed. The SMIL code can then be generated automatically based on the properties ascribed to each image and the arrangement of objects on the editor screen. Also, if a duration is not provided for the images, the editor can be configured to generate the SMIL code assuming a default duration for a slide and dividing the default duration for the slide into time segments of the same duration for each image. Alternatively, in some embodiments, a user can be presented with text editor by which the user can provide the SMIL__code for_a_ slide, referring to images either based on names associated with each and included in the respective properties of the images, or based on the order in which the images appear on the screen in edit mode. An advantage of the solution provided by the invention--at least in comparison to the frame-based approach of the prior art--is that it saves screen space and, in addition, has a more familiar look-and-feel for users already used to slide-based editors provided for use on desktop computers. To save screen space though, an editor according to the invention does not show the actual vertical alignment of the text versus image (i.e. as it is seen in playing the presentation); the user of the editor must preview the presentation in player mode to see the actual vertical alignment. Referring now to Fig. 5 (and also to Figs. 2 and 4), the invention is shown as a method by which a multimedia presentation editor hosted by the communication or computing terminal 10 having the display device (screen) 10a, interfaces with a user so as to allow the user to create or edit the presentation 20 including a slide 21 that in turn includes a plurality of objects such as the text object 22 and the image objects 23a-c for display (and also objects 24 for providing audible components of the presentation), the method including: a step 51 in which the displayable objects 22 23a-c in each set of (typically image) objects of the slide 21 that are to be displayed sequentially (one after the other in time) in play mode are instead assembled by the editor in multi-object columns 25b, i.e. one under another, and the objects that are to be displayed continuously are assembled into one-object-long columns 25a; and a step 52 in which each column 25a-b is displayed side-by-side with each other column 25a-b. Thus, if a column includes only a single object, that object is a fixed element of the slide, i.e. it appears for the entire time the slide is displayed in play mode. On the other hand, in case of a column including more than one object, each object is displayed for only some of the time the slide is displayed in play mode. In other words, the displayable objects 22 23a-c of the slide 21 form on the display device 10a in edit mode one or more side-by-side vertical columns 25a-b some of which may include only a single object 22 and some of which may include more than one object 23a-c, thus providing that some parts of the slide 20 may remain fixed (the part with the text object 22 in the illustration of Fig. 2) while the slide is displayed in play mode and some parts may change (the part with the image objects 23a-b in the illustration of Fig. 2). Although the invention has been shown and described in the case of unchanging text 22 and changing images 23a-c of a slide 21, so that in edit mode there are two side-by-side columns, it is also within the scope of the invention that there be more than two columns, and even that none of the columns include a single object. For example, a first column might include two objects, a second column three, and a third column four. In such a case, the timing relationships between the objects in the three columns can be specified by e.g. SMIL, or can even be automatically figure by a play device, based on the smallest number evenly divisible by the numbers of objects in each of the columns, in this case 12. An automatic determination of the timing relationship in this case would provide that each object in a column be displayed for a time proportional to the ratio of the smallest number evenly divisible by the numbers of objects in each of the columns to (divided by) the number of objects in the subject column. The invention has been described in terms (primarily) of the steps of a method. The invention also comprehends an apparatus for performing the above described steps. Thus, for each step described above, there can be a corresponding module of an apparatus, although it is also possible for the functionality for performing more than one of the above-described steps to be incorporated into a single module. Such modules may be implemented as hardware, or may be implemented as software or firmware for execution by a processor. In particular, in the case of firmware or software, the invention is provided as a computer program product including a computer readable storage structure embodying computer program code--i.e. the software or firmware--thereon for execution by a computer processor provided with the communication or computing terminal 10. It is important to understand that the invention is especially of use in creating presentations in any situation in which a small screen/ display is used, such as in handheld communication or computing terminals including e.g. digital cameras, personal digital assistants (PDAs) and so on, i.e. in any device hosting a microprocessor enabling a user of the device to manipulate images on a display. Thus, the invention is not restricted to creating presentations that are communicated, as e.g. an MMS message; the invention pertains only to the creating of a presentation. The presentation may be played by the same device or by another device, one not even necessarily having a small screen. Moreover the presentation need not be telecommunicated to the other device, i.e. communicated over a wireline or wireless telecommunication network(s); the presentation can be created using e.g. a cell phone and then shown e.g. via an external display such as a TV or other video display device. Further, the invention can be used to create different kinds of presentations, including presentations compatible with Microsoft Powerpoint. It is to be understood that the above-described arrangements are only illustrative of the application of the principles of the present invention. Numerous modifications and alternative arrangements may be devised by those skilled in the art without departing from the scope of the present invention, and the appended claims are intended to cover such modifications and arrangements. What is claimed is: 1. A method by which a multimedia presentation editor hosted by a communication or computing terminal (10) having a display device (10a), interfaces with a user so as to allow the user to create or edit a presentation (20) including a slide (21) in turn including a plurality of objects (21 22a~c) for display in playing the presentation (20), characterized by: a step (51) in which the objects (2-3—23a-c) in each set of objects of the slide (21) to be displayed successively one after the other when the presentation (20) is played__are instead assembled by the editor one under another in a: respective columns (2 5a—h), and each single object (22) of the slide (21) to be displayed continuously on the slide (21) when the presentation (20) is played are also assembled by the editor in respective one-object columns (25a), thereby providing a plurality of columns (25a-b), wherein at least one of the columns (25a) has a plurality of objects (23a-c); and a step (52) in which the editor displays at the same time each column (25a-b) side-by-side with each other column (25a-b) on the display device (10a); the objects (22 23a-c) of the slide (21) thus forming on the display device (10a) when displayed by the editor one or more side-by-side vertical columns (25a-b) some of which may include only a single object and some of which may include more than one object, thereby providing that some parts of the slide (21) may remain fixed while the slide (21) is displayed in play mode and some parts will change. 2. A method as in claim 1, wherein the multimedia presentation (20) is for communication as an MMS message. 3. A method as in claim 1,—wherein the multimedia presentation (20)—is for communication as an-MMS message. 43. A method as in claim 1, wherein SMIL is used with the editor to prescribe how the multimedia presentation (20) is to be played. C14. A computer program product comprising: a computer readable storage structure embodying computer program code thereon for execution by a computer processor in a communication or computing terminal (10), with said computer program code characterized in that it includes instructions for performing the steps of the method of claim 1. A15. A communications or computing terminal (10) having a display device (10a) and including a multimedia presentation editor for creating or editing a presentation (20) including a slide (21) in turn including a plurality of objects (21 22a-c) for display in playing the presentation (20), characterized in that the editor comprises: means (51) by which the objects (23a-c) in each set of objects of the slide (21) to be displayed successively one after the other when the presentation (20) is played are instead assembled by the editor one under another in respective columns (25a), and each single object (22) of the slide (21) to be displayed continuously on the slide (21) when the presentation (20) is played are also assembled by the editor in respective one-object columns (25a), thereby providing a plurality of columns (25a-b), wherein at least one of the columns (25a) has a plurality of objects (23a-c)which in which the objects—(22 23a e-)—in each set of objects- of -the slide—(-2-1-)—to be displayed successively when the presentation (20)—is played-arc instead assembled by the-editor one under another in a column—(25a-b); and means (52) by which the editor displays at the same time each column (25a-b) side-by-side with each other column (25a-b) on the display device (10a) ; the objects (22 23a-c) of the slide (21) thus forming on the display device (10a) when displayed by the editor one or more side-by-side vertical columns (25a-b) some of which may include only a single object and some of which may—include more than one object, thereby providing that some parts of the slide (21) may remain fixed while the slide (21) is displayed in play mode and some parts will change. 6. A communications or computing terminal (10) as in claim 5, wherein the multimedia presentation (20) is for communication as an MMS message. 7. A communications or computing terminal (10) as in claim 5, wherein SMIL is used with the editor to prescribe how the multimedia presentation (20) is to be played. 8. A telecommunications network including a plurality of telecommunications terminals (10) at least one of which is according to claim A15.

Full Text

MULTIMEDIA PRESENTATION EDITOR FOR A SMALL-DISPLAY
COMMUNICATION TERMINAL OR COMPUTING
DEVICE* ******** *****TITLE******************
(LEAVE ABOVE LINE AS Is UNTIL FINAL DRAFT) BACKGROUND OF THE INVENTION
1. TECHNICAL FIELD
The present invention pertains to the field of creating/editing presentations on a device with a small display. More particularly, the present invention pertains to creating presentations having content displayed/ played (providing possibly text and images and sound all at the same time) based on instructions encoded using the SMIL language oa a comparable XML-based language, and is especially useful for creating MMS messages using a handheld communication device, such as a cell phone.
2 . DISCUSSION OF RELATED ART
The invention is related to editing/ creating (as opposed to viewing) multimedia presentations on a portable device. Multimedia presentations are e.g. shown by the device itself or using an external display or communicated between mobile/ cell phones or other communication terminals as a part of MMS -(multimedia oyotem)(Multmedia Messaging Service) messages, as prescribed by 3GPP (Third Generation Partnership Program) technical specifications. (MMS, like Short Message Service (SMS), provides automatic and immediate delivery of personal messages, but allows incorporating sound, images, and other rich content, transforming it into a personalized visual and audio message.) The presentation part in MMS messages can use different formats, but Synchronized Multimedia Integration Language (SMIL, pronounced "smile") 2.0 is the mandatory format specified by the current 3GPP Release 5 specification. The presentation part includes all media objects (content of

the multimedia presentation) as one data object/ assembly, describing their layout, timing and other aspects of displaying/ playing the media objects on the receiving communication terminal. For example, if an MMS message contains two slides and each contains a text object and an image, the MMS message consists of MMS headers, two image objects, two text objects, and one SMIL object with information to the effect that the message consists of a sequence of two time containers and that the first time container contains parallel media objects (image and text). See Fig. 1 for an example of the structure of a presentation object in MMS.
SMIL is an Extensible Markup Language (XML)-based language. It contains building blocks called modules. The modules which are important from the point of view of the present invention are the so-called structure module, the timing and synchronization module, and the media object module. Each module includes one or more so-called elements and so-called attributes.
The most important elements of SMIL are the so-called "par" and wseq" elements. A par element groups object that should appear in parallel, temporally, in a presentation. For example, if text and an image are shown on one slide at the same time, they will be put within a single ... pair in a block of SMIL code. A seq element may contain objects that are supposed to be presented to the user sequentially, one after the other, i.e. the second one will not become visible until the first has been displayed/ played and is not longer being displayed/ played. So the two slides from the previous example would typically be put within a ... pair to indicate that they must be played in sequence. Also the main body element is treated as a seq element when timing is considered. These and some other

more than two levels, a slide may itself be an entire presentation/ set of slides, each of which may itself be a new, further presentation/ set of slides, and so on.)
MMS terminals available currently on the market are capable of editing or viewing only limited SMIL structures (in terms of time container nesting). The first (top) level of nesting represents the presentation and the second level represents slides. Media items are placed on the second level. Although some handheld terminals (such as cell/ mobile phones) can play more complicated content than a two-level presentation, it is impractical today for typical cell phones or other handheld terminals to create more complicated presentations because editing a three-level timing and a two-dimensional space presentations on the typically small screen of a mobile phone or other handheld and making it usable by an average user is difficult. All handheld-hosted editors today are not intuitive or simple and are too time-consuming when used to create complex presentations.
Prior art MMS editors for handheld terminals (such as mobile phones) do not typically allow the content of a slide in a presentation to change with time. In other words, the slides created must be static (except that the media items contained in a slide may change, e.g. video clips, animated .GIF images, etc.). Other, more sophisticated MMS editors e.g. for desktop computers as opposed to handheld devices use an approach in which the entire presentation or animation (if the software is for video editing) is divided into "frames" displayed side-by-side in columns and rows, Fig. 3 showing one row, and a user can navigate between frames (in other words, move to a different point in the presentation) using some sort of a slider widget. An approach using frames displayed side-by-side is useful for computers with big screens, so that the software can reasonably display frames side-by-side all on the

same screen. But doing so is not practical on a handheld device because of the small size of the screen.
Yet another approach is used in- desktop presentations
editors ouch as e.g.—Microsoft PowerPoint-—In such editors it io-possible-to chow tho true layout of several different images that are to appear on a single slide of a presentation and show them in sequence on the slide using an animations menu/ toolbar.—However,—doing so requires that in the editor (view)—the images be displayed one on top of the other—(i.e. overlapping,—so that the topmost at least partially obscures the others).
What is therefore needed is a way of providing
instructions for creating a complex multimedia message such as an MMS message on a handheld device, i.e. e.g. a multimedia message that is more than two levels.
DISCLOSURE OF INVENTION
Accordingly, in a first aspect of the invention, a method is provided for by which a multimedia presentation editor hosted by a communication or computing terminal having a display device, interfaces with a user so as to allow the user to create or edit a presentation including a slide in turn including a plurality of objects for display in playing the presentation, characterized by: a step in which the objects in each set of objects of the slide to be displayed successively one after the other when the presentation is played are instead assembled by the editor one under another in respective columns, and each single object of the slide to be displayed continuously on the slide when the presentation is played are also assembled by the editor in respective one-object columns, thereby providing a plurality of columns, wherein at least one of the columns has a plurality of objects; and a step in which the editor displays at the same time each column side-by-side with each other column on the

display device; the objects of the slide thus forming on the
display device when displayed by the editor one or more side-by-side vertical columns some of which may include only a single object and some of which include more than one object, thereby providing that some parts of the slide may remain fixed while the slide is displayed in play mode and some parts will change.
In accord with the first object of the invention, the
multimedia presentation may be for communication as an MMS message.
In accord with the first object of the invention, SMIL
may be used with the editor to prescribe how the multimedia presentation is to be played.
In a second aspect of the invention, a computer program
product is provided comprising: a computer readable storage structure embodying computer program code thereon for execution by a computer processor in a communication or computing terminal, with said computer program code characterized in that it includes instructions for performing the steps of a method according to the first aspect of the invention.
In a third aspect of the invention, a communications or
computing terminal is provided having a display device and including a multimedia presentation editor for creating or editing a presentation including a slide in turn including a plurality of objects for display in playing the presentation, characterized in that the editor comprises means for performing the steps of a method according to the first aspect of the invention.
In a fourth aspect of the invention, a telecommunications
network is provided including a plurality of telecommunications terminals at least one of which is

according to the third aspect of the invention. ... TBD based—on the claims as in the final draft of the application -
BRIEF DESCRIPTION OF THE DRAWINGS
The above and other objects, features and advantages of the invention will become apparent from a consideration of the subsequent detailed description presented in connection with accompanying drawings, in which:
Fig. 1 illustrates the structure of a presentation object used in MMS according to the OMA MMS 1.1 and 1.2 specifications.
Fig. 2 illustrates the structure of message timing achievable using the invention, without making the user interface more complicated; notice the added dynamic image-changing.
Fig. 3 illustrates the approach used by a typical multimedia editor intended for use with a desktop computer.
Fig. 4A illustrates an editor screen in an actual implementation of the invention--in a Series 90 MMS Editor. When the same presentation is displayed in play mode, the images are shown one after the other, instead of at the same time (i.e. they are not all displayed at the same time),
Fig. 4B illustrates the screens in play mode corresponding to the editor screen displayed in Fig. 4A.
Fig. 5 is a flowchart illustrating a method according to the invention by which an editor hosted e.g. by a handheld device having a small screen enables a user to create a
slide for a presentation.

BEST MODE FOR CARRYING OUT THE INVENTION
The invention provides a hybrid solution for how to create complex multimedia presentations on a handheld device, taking what is appropriate from the various existing solutions so as to provide increased editing capability on a handheld, editing that is intuitive and relatively fast.
Referring now to Fig. 2, in editing a presentation 20 using an editor according to the invention, the parts of a slide 21 that change (i.e. typically the images, in that the images in a set of images 23a-c are to be shown when played one at a time and one after the other, but on the same slide 21) are shown like "frames" are shown by editors for desktop computers, i.e. next to each other (more specifically, one on top of the other, as shown in Fig. 2). But the parts of the slide 21 that are static--usually the text 22 for a slide--are shown only once, i.e. are not repeated for each part (usually an image) that changes. Such a hybrid solution saves space on the screen.
The proposed solution assumes that the layout rules--i.e. e.g. the SMIL for the presentation--are fixed and that the part of a slide that does not change (typically the text) is fixed for the duration of a slide. For example, it is reasonable to suppose that a user might take three pictures with a built-in camera and might want to show the pictures in sequence in a presentation. At the same time the user might want a block of text to appear with all of the picture, such as e.g., "These are the pictures I took in front of my house." This is a likely use case because typing long text on a small device like a mobile phone (especially if it does not have a full "qwerty" keyboard) is time-consuming and so a user would likely not want to input a lot of different text blocks, whereas taking pictures is easy to do and fast. Also, it is unlikely that a user would want to manipulate the layout of a

slide for a presentation on a handheld device because on a small screen there is not enough space for any (significant) manipulation.
Using these assumptions, as explained above, the solution provided by the invention is to display images one under another (not overlapping, but arranged in a column) in the presentation editor--i.e. in edit mode--with instructions for play mode (provided e.g. using SMIL) that the images be displayed in a temporal sequence, one after the other. At the same time the horizontal layout remains true, i.e. corresponds to the layout seen when the presentation is played. Thus, the vertical layout in the editor does not correspond to the actual layout seen when the presentation is played: the vertical dimension in the editor represents time.
Referring now to Fig. 4A, a display device 10a of a communications or computing terminal 10 for an exemplary slide 21 is shown when the slide 21 is displayed by an editor according to the invention. The slide 21 includes two pictures 23a-b and accompanying text block 22, and so in edit mode the screen is as shown in Fig. 4A, with the two pictures 23a-b arranged in a vertical column (of two rows) and appearing on the screen at the same time, and the text block 22 appearing as the one and only row of another vertical column. The corresponding screen in play mode for the slide would show the two pictures 23a-b one after the other in time (i.e. not at the same time), with the (same) text block 22 displayed for each. The instructions for so playing the slide (i.e. for displaying it in play mode) are included e.g. in an SMIL object (not shown) included with the image objects 23a-b and text object 22 in e.g. an MMS message. Note that if the text were longer, or if there were more images in the first column, the display device 10a would provide scroll controls typically on the right hand side so as to allow viewing all the text.

The SMIL, in simplified form, corresponding to the _editor
screen of Fig. 4A--i.e. indicated by the editor screen of FigL 4A as how the presentation is to be played, can be (more or less) as follows:

(The "more or less" is because, as in the earlier exemplary SMIL code fragment, the SMIL code fragment here is also simplified encoding; an actual encoding in SMIL would include several more elements and attributes, none of which are relevant to the invention and so are omitted here for clarity.) To specify a presentation including both the slide(s) corresponding to the editor view of Fig. 4A and also another slide (or slides, depending on how you count) in whicl the same text is repeated for three different images, the SMI1 code fragment would be something like:

_ As can be seen from the above SMIL code fragments, the invention allows creating a slide that is described by more than two (and in fact here three) levels of time containers in SMIL (as opposed to three levels of SMIL).
Referring now to Fig. 4B, the two screens in play mode
corresponding to the single editor screen (which, depending on the display device 10a, may not be visible all at once, and so may require scrolling) displayed in Fig. 4A are shown on a display device that may be the display device 10a of the communications or computing terminal 10 on which the exemplary slide 21_was created using an editor according to the invention (as is indicated in Fig. 4B), or that may be any other display device (not necessarily communicatively coupled to the communications or computing terminal 10). As indicated by the above code fragment for slide 1, in play mode, while slide 1 is being displayed, first imagel is shown and then, after about 10 seconds, image 2 is shown, i.e. on the same slide.
Note that in some embodiments, to generate the SMIL (or
comparable) code, the user using the editor would click on or otherwise signal the editor that the user would like to prescribe properties for an image being displayed in edit mode, and the user would then be presented with a dialog box in which the user is able to indicate e.g. the duration the image is to be displayed. The SMIL code can then be generated automatically based on the properties ascribed to each image and the arrangement of objects on the editor screen. Also, if a duration is not provided for the images, the editor can be configured to generate the SMIL code assuming a default duration for a slide and dividing the default duration for the slide into time segments of the same duration for each image. Alternatively, in some embodiments, a user can be presented

with text editor by which the user can provide the SMIL__code for_a_ slide, referring to images either based on names associated with each and included in the respective properties of the images, or based on the order in which the images appear on the screen in edit mode.
An advantage of the solution provided by the invention--at least in comparison to the frame-based approach of the prior art--is that it saves screen space and, in addition, has a more familiar look-and-feel for users already used to slide-based editors provided for use on desktop computers. To save screen space though, an editor according to the invention does not show the actual vertical alignment of the text versus image (i.e. as it is seen in playing the presentation); the user of the editor must preview the presentation in player mode to see the actual vertical alignment.
Referring now to Fig. 5 (and also to Figs. 2 and 4), the invention is shown as a method by which a multimedia presentation editor hosted by the communication or computing terminal 10 having the display device (screen) 10a, interfaces with a user so as to allow the user to create or edit the presentation 20 including a slide 21 that in turn includes a plurality of objects such as the text object 22 and the image objects 23a-c for display (and also objects 24 for providing audible components of the presentation), the method including: a step 51 in which the displayable objects 22 23a-c in each set of (typically image) objects of the slide 21 that are to be displayed sequentially (one after the other in time) in play mode are instead assembled by the editor in multi-object columns 25b, i.e. one under another, and the objects that are to be displayed continuously are assembled into one-object-long columns 25a; and a step 52 in which each column 25a-b is displayed side-by-side with each other column 25a-b. Thus, if a column includes only a single object, that object is a fixed element of the slide, i.e. it appears for the entire time the

slide is displayed in play mode. On the other hand, in case of a column including more than one object, each object is displayed for only some of the time the slide is displayed in play mode. In other words, the displayable objects 22 23a-c of the slide 21 form on the display device 10a in edit mode one or more side-by-side vertical columns 25a-b some of which may include only a single object 22 and some of which may include more than one object 23a-c, thus providing that some parts of the slide 20 may remain fixed (the part with the text object 22 in the illustration of Fig. 2) while the slide is displayed in play mode and some parts may change (the part with the image objects 23a-b in the illustration of Fig. 2).
Although the invention has been shown and described in
the case of unchanging text 22 and changing images 23a-c of a slide 21, so that in edit mode there are two side-by-side columns, it is also within the scope of the invention that there be more than two columns, and even that none of the columns include a single object. For example, a first column might include two objects, a second column three, and a third column four. In such a case, the timing relationships between the objects in the three columns can be specified by e.g. SMIL, or can even be automatically figure by a play device, based on the smallest number evenly divisible by the numbers of objects in each of the columns, in this case 12. An automatic determination of the timing relationship in this case would provide that each object in a column be displayed for a time proportional to the ratio of the smallest number evenly divisible by the numbers of objects in each of the columns to (divided by) the number of objects in the subject column.
The invention has been described in terms (primarily) of the steps of a method. The invention also comprehends an apparatus for performing the above described steps. Thus, for each step described above, there can be a corresponding module

of an apparatus, although it is also possible for the functionality for performing more than one of the above-described steps to be incorporated into a single module. Such modules may be implemented as hardware, or may be implemented as software or firmware for execution by a processor. In particular, in the case of firmware or software, the invention is provided as a computer program product including a computer readable storage structure embodying computer program code--i.e. the software or firmware--thereon for execution by a computer processor provided with the communication or computing terminal 10.
It is important to understand that the invention is
especially of use in creating presentations in any situation in which a small screen/ display is used, such as in handheld communication or computing terminals including e.g. digital cameras, personal digital assistants (PDAs) and so on, i.e. in any device hosting a microprocessor enabling a user of the device to manipulate images on a display. Thus, the invention is not restricted to creating presentations that are communicated, as e.g. an MMS message; the invention pertains only to the creating of a presentation. The presentation may be played by the same device or by another device, one not even necessarily having a small screen. Moreover the presentation need not be telecommunicated to the other device, i.e. communicated over a wireline or wireless
telecommunication network(s); the presentation can be created using e.g. a cell phone and then shown e.g. via an external display such as a TV or other video display device. Further, the invention can be used to create different kinds of presentations, including presentations compatible with Microsoft Powerpoint.
It is to be understood that the above-described arrangements are only illustrative of the application of the principles of the present invention. Numerous modifications

and alternative arrangements may be devised by those skilled in the art without departing from the scope of the present invention, and the appended claims are intended to cover such modifications and arrangements.

What is claimed is:
1. A method by which a multimedia presentation editor hosted by a communication or computing terminal (10) having a display device (10a), interfaces with a user so as to allow the user to create or edit a presentation (20) including a slide (21) in turn including a plurality of objects (21 22a~c) for display in playing the presentation (20), characterized by:
a step (51) in which the objects (2-3—23a-c) in each set of objects of the slide (21) to be displayed successively one after the other when the presentation (20) is played__are instead assembled by the editor one under another in a: respective columns (2 5a—h), and each single object (22) of the slide (21) to be displayed continuously on the slide (21) when the presentation (20) is played are also assembled by the editor in respective one-object columns (25a), thereby providing a plurality of columns (25a-b), wherein at least one of the columns (25a) has a plurality of objects (23a-c); and
a step (52) in which the editor displays at the same time each column (25a-b) side-by-side with each other column (25a-b) on the display device (10a);
the objects (22 23a-c) of the slide (21) thus forming on the display device (10a) when displayed by the editor one or more side-by-side vertical columns (25a-b) some of which may include only a single object and some of which may include more than one object, thereby providing that some parts of the slide (21) may remain fixed while the slide (21) is displayed in play mode and some parts will change.
2. A method as in claim 1, wherein the multimedia presentation (20) is for communication as an MMS message.
3. A method as in claim 1,—wherein the multimedia presentation

(20)—is for communication as an-MMS message.
43. A method as in claim 1, wherein SMIL is used with the editor to prescribe how the multimedia presentation (20) is to be played.
C14. A computer program product comprising: a computer readable storage structure embodying computer program code thereon for execution by a computer processor in a communication or computing terminal (10), with said computer program code characterized in that it includes instructions for performing the steps of the method of claim 1.
A15. A communications or computing terminal (10) having a display device (10a) and including a multimedia presentation editor for creating or editing a presentation (20) including a slide (21) in turn including a plurality of objects (21 22a-c) for display in playing the presentation (20), characterized in that the editor comprises:
means (51) by which the objects (23a-c) in each set of objects of the slide (21) to be displayed successively one after the other when the presentation (20) is played are instead assembled by the editor one under another in respective columns (25a), and each single object (22) of the slide (21) to be displayed continuously on the slide (21) when the presentation (20) is played are also assembled by the editor in respective one-object columns (25a), thereby providing a plurality of columns (25a-b), wherein at least one of the columns (25a) has a plurality of objects (23a-c)which in which the objects—(22 23a e-)—in each set of objects- of -the slide—(-2-1-)—to be displayed successively when the presentation (20)—is played-arc instead assembled by the-editor one under another in a column—(25a-b); and

means (52) by which the editor displays at the same time each column (25a-b) side-by-side with each other column (25a-b) on the display device (10a) ;
the objects (22 23a-c) of the slide (21) thus forming on the display device (10a) when displayed by the editor one or more side-by-side vertical columns (25a-b) some of which may include only a single object and some of which may—include more than one object, thereby providing that some parts of the slide (21) may remain fixed while the slide (21) is displayed in play mode and some parts will change.
6. A communications or computing terminal (10) as in claim 5, wherein the multimedia presentation (20) is for communication as an MMS message.
7. A communications or computing terminal (10) as in claim 5, wherein SMIL is used with the editor to prescribe how the multimedia presentation (20) is to be played.
8. A telecommunications network including a plurality of telecommunications terminals (10) at least one of which is according to claim A15.

A METHOD FOR CREATING AND EDITING MULTIMEDIA PRESENTATIONS ON A SMALL DISPLAY TERMINAL AND ASSOCIATED TERMINAL

Documents:

Inventors:

PCT Conventions: